00000100:00100000:1.0:1789760687.137229:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 658780828682 time 658780568266 state 0x1 ref 1
00000100:00100000:1.0:1789760687.137258:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 658780828682 time 658823940483 state 0x0 ref 1
00000100:00100000:1.0:1789760687.137270:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520805760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760687.137337:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17735680, mtime: 0x6aad94b0, atime: 0x0, ctime: 0x6aad94b0, blocks: 0x8807
00010000:00010000:1.0:1789760687.137346:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.137362:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=658s v=(0 0)
00010000:00010000:1.0:1789760687.137603:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760687.137610:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.137625:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760687.170532:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17735680 -> 17739776
00010000:00010000:1.0:1789760687.170552:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.170566:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.170576:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.170584:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760687.170590:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.170600:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.170618:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.170625:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60a947 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17735680->17739775] (req 17735680->17739775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760687.170726:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520805760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33453us (33678us total) trans 4294971650 rc 0/0
00000100:00100000:1.0:1789760687.170738:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4363
00000100:00100000:1.0:1789760687.170748:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 658780828682 time 658823940483 state 0x2 ref 0
00000100:00100000:1.0:1789760687.182537:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760687.253897:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17739776 -> 17743872
00010000:00010000:1.0:1789760687.253912:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60a94e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17739776->17743871] (req 17739776->17743871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.253925:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60a94e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17739776->17743871] (req 17739776->17743871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.253934:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60a94e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17739776->17743871] (req 17739776->17743871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.253948:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760687.253953:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60a94e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17739776->17743871] (req 17739776->17743871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.253962:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60a94e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17739776->17743871] (req 17739776->17743871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.253979:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60a94e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17739776->17743871] (req 17739776->17743871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.253987:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60a94e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17739776->17743871] (req 17739776->17743871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760687.254078:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520805888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 71310us (71547us total) trans 4294971651 rc 0/0
00000100:00100000:1.0:1789760687.254087:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4364
00000100:00100000:1.0:1789760687.254097:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 658824200899 time 658869434747 state 0x2 ref 0
00002000:00010000:1.0:1789760687.322559:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17743872 -> 17747968
00010000:00010000:1.0:1789760687.322578:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60a955 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17743872->17747967] (req 17743872->17747967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.322592:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60a955 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17743872->17747967] (req 17743872->17747967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.322620:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60a955 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17743872->17747967] (req 17743872->17747967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.322627:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760687.322632:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60a955 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17743872->17747967] (req 17743872->17747967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.322641:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60a955 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17743872->17747967] (req 17743872->17747967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.322661:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60a955 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17743872->17747967] (req 17743872->17747967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.322669:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60a955 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17743872->17747967] (req 17743872->17747967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760687.322847:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520806016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52304us (57120us total) trans 4294971652 rc 0/0
00000100:00100000:1.0:1789760687.322859:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4365
00000100:00100000:1.0:1789760687.322869:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 658869695163 time 658957209036 state 0x2 ref 0
00000001:00080000:1.0:1789760687.428893:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971653 is committed
00000100:00100000:1.0:1789760687.437060:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520806272
00000100:00100000:1.0:1789760687.437072:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520806272
00000100:00100000:1.0:1789760687.437124:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 658957469452 time 659015478413 state 0x0 ref 1
00000100:00100000:1.0:1789760687.437157:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659015738829 time 659015478413 state 0x1 ref 1
00000100:00100000:1.0:1789760687.437185:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659015738829 time 659123867425 state 0x0 ref 1
00000100:00100000:1.0:1789760687.437197:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520806272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760687.437246:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17752064, mtime: 0x6aad94b0, atime: 0x0, ctime: 0x6aad94b0, blocks: 0x8807
00010000:00010000:1.0:1789760687.437255:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60a963 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.437271:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=659s v=(0 0)
00010000:00010000:1.0:1789760687.437275:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760687.437281:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60a963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17752064->17756159] (req 17752064->17756159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.437295:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60a963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17752064->17756159] (req 17752064->17756159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760687.502274:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760687.586118:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17756160 -> 17760256
00010000:00010000:1.0:1789760687.586133:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60a96a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17756160->17760255] (req 17756160->17760255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.586155:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60a96a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17756160->17760255] (req 17756160->17760255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.586166:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60a96a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17756160->17760255] (req 17756160->17760255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.586176:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760687.586180:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60a96a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17756160->17760255] (req 17756160->17760255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.586189:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60a96a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17756160->17760255] (req 17756160->17760255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.586218:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60a96a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17756160->17760255] (req 17756160->17760255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.586227:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60a96a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17756160->17760255] (req 17756160->17760255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760687.586362:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520806400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 83788us (84090us total) trans 4294971655 rc 0/0
00000100:00100000:1.0:1789760687.586372:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4368
00000100:00100000:1.0:1789760687.586382:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659124127841 time 659189240283 state 0x2 ref 0
00000100:00100000:1.0:1789760687.595659:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520806528
00000100:00100000:1.0:1789760687.595669:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520806528
00000100:00100000:1.0:1789760687.595746:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659124127841 time 659189240283 state 0x0 ref 1
00000100:00100000:1.0:1789760687.595761:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659189500699 time 659189240283 state 0x1 ref 1
00000100:00100000:1.0:1789760687.595793:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659189500699 time 659282475957 state 0x0 ref 1
00000100:00100000:1.0:1789760687.595809:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520806528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760687.595854:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17760256, mtime: 0x6aad94b0, atime: 0x0, ctime: 0x6aad94b0, blocks: 0x8807
00010000:00010000:1.0:1789760687.595864:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60a971 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.595879:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=659s v=(0 0)
00010000:00010000:1.0:1789760687.595883:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760687.595889:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60a971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17760256->17764351] (req 17760256->17764351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.595903:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60a971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17760256->17764351] (req 17760256->17764351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760687.689627:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971657 is committed
00000100:00100000:1.0:1789760687.713543:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760687.764934:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520806912
00000100:00100000:1.0:1789760687.764946:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520806912
00000100:00100000:1.0:1789760687.765009:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659344692459 time 659400428491 state 0x0 ref 1
00000100:00100000:1.0:1789760687.765025:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659400688907 time 659400428491 state 0x1 ref 1
00000100:00100000:1.0:1789760687.765059:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659400688907 time 659451740588 state 0x0 ref 1
00000100:00100000:1.0:1789760687.765072:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520806912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760687.765125:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17772544, mtime: 0x6aad94b0, atime: 0x0, ctime: 0x6aad94b0, blocks: 0x8807
00010000:00010000:1.0:1789760687.765135:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60a986 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.765161:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=659s v=(0 0)
00010000:00010000:1.0:1789760687.765166:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760687.765173:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60a986 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17772544->17776639] (req 17772544->17776639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.765187:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60a986 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17772544->17776639] (req 17772544->17776639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760687.830571:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520807040
00000100:00100000:1.0:1789760687.830580:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520807040
00000100:00100000:1.0:1789760687.830636:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659400688907 time 659451740588 state 0x0 ref 1
00000100:00100000:1.0:1789760687.830652:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659452001004 time 659451740588 state 0x1 ref 1
00000100:00100000:1.0:1789760687.830682:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659452001004 time 659517364617 state 0x0 ref 1
00000100:00100000:1.0:1789760687.830694:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520807040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760687.830741:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17776640, mtime: 0x6aad94b0, atime: 0x0, ctime: 0x6aad94b0, blocks: 0x8807
00010000:00010000:1.0:1789760687.830750:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.830765:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=659s v=(0 0)
00010000:00010000:1.0:1789760687.830770:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760687.830776:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.830789:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760687.893598:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17776640 -> 17780736
00010000:00010000:1.0:1789760687.893627:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.893641:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.893649:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.893657:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760687.893661:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.893771:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.893793:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760687.893801:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a98d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17776640->17780735] (req 17776640->17780735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760687.893895:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520807040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63197us (63428us total) trans 4294971660 rc 0/0
00000100:00100000:1.0:1789760687.893905:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4373
00000100:00100000:1.0:1789760687.893914:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659452001004 time 659517364617 state 0x2 ref 0
00000100:00100000:1.0:1789760687.897838:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760688.092645:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520807552
00000100:00100000:1.0:1789760688.092656:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520807552
00000100:00100000:1.0:1789760688.092711:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659630190212 time 659704636760 state 0x0 ref 1
00000100:00100000:1.0:1789760688.092727:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659704897176 time 659704636760 state 0x1 ref 1
00000100:00100000:1.0:1789760688.092757:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659704897176 time 659779438761 state 0x0 ref 1
00000100:00100000:1.0:1789760688.092779:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520807552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760688.092831:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17793024, mtime: 0x6aad94b1, atime: 0x0, ctime: 0x6aad94b1, blocks: 0x8807
00010000:00010000:1.0:1789760688.092840:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a9a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.092857:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=659s v=(0 0)
00010000:00010000:1.0:1789760688.092861:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760688.092868:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a9a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17793024->17797119] (req 17793024->17797119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.092881:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60a9a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17793024->17797119] (req 17793024->17797119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760688.265129:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760688.294811:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17801216 -> 17805312
00010000:00010000:1.0:1789760688.294831:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60a9b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17801216->17805311] (req 17801216->17805311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.294844:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60a9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17801216->17805311] (req 17801216->17805311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.294853:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60a9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17801216->17805311] (req 17801216->17805311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.294861:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760688.294866:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60a9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17801216->17805311] (req 17801216->17805311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.294875:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60a9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17801216->17805311] (req 17801216->17805311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.294893:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60a9b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17801216->17805311] (req 17801216->17805311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.294901:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60a9b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17801216->17805311] (req 17801216->17805311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760688.294995:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520807808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29520us (29871us total) trans 4294971666 rc 0/0
00000100:00100000:1.0:1789760688.295007:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4379
00000100:00100000:1.0:1789760688.295016:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659891902092 time 659952141999 state 0x2 ref 0
00000100:00100000:1.0:1789760688.300302:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520807936
00000100:00100000:1.0:1789760688.300346:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520807936
00000100:00100000:1.0:1789760688.300398:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659891902092 time 659952141999 state 0x0 ref 1
00000100:00100000:1.0:1789760688.300411:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659952402415 time 659952141999 state 0x1 ref 1
00000100:00100000:1.0:1789760688.300432:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 659952402415 time 659987114692 state 0x0 ref 1
00000100:00100000:1.0:1789760688.300444:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520807936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760688.300490:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17805312, mtime: 0x6aad94b1, atime: 0x0, ctime: 0x6aad94b1, blocks: 0x8807
00010000:00010000:1.0:1789760688.300499:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60a9be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.300514:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=659s v=(0 0)
00010000:00010000:1.0:1789760688.300518:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760688.300524:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60a9be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17805312->17809407] (req 17805312->17809407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.300538:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60a9be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17805312->17809407] (req 17805312->17809407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760688.352688:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971667 is committed
00000100:00100000:1.0:1789760688.353974:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760688.409600:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760688.469445:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520808320
00000100:00100000:1.0:1789760688.469456:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520808320
00000100:00100000:1.0:1789760688.469512:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660041159699 time 660096484300 state 0x0 ref 1
00000100:00100000:1.0:1789760688.469527:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660096744716 time 660096484300 state 0x1 ref 1
00000100:00100000:1.0:1789760688.469595:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660096744716 time 660156276724 state 0x0 ref 1
00000100:00100000:1.0:1789760688.469610:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520808320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760688.469661:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17817600, mtime: 0x6aad94b1, atime: 0x0, ctime: 0x6aad94b1, blocks: 0x8807
00010000:00010000:1.0:1789760688.469683:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60a9d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.469700:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=660s v=(0 0)
00010000:00010000:1.0:1789760688.469705:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760688.469710:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60a9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17817600->17821695] (req 17817600->17821695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.469723:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60a9d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17817600->17821695] (req 17817600->17821695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760688.506497:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971670 is committed
00000001:00080000:1.0:1789760688.559584:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971671 is committed
00000001:00080000:1.0:1789760688.620528:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971672 is committed
00000100:00100000:1.0:1789760688.680056:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520808832
00000100:00100000:1.0:1789760688.680067:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520808832
00000100:00100000:1.0:1789760688.680148:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660250946531 time 660314706085 state 0x0 ref 1
00000100:00100000:1.0:1789760688.680169:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660314966501 time 660314706085 state 0x1 ref 1
00000100:00100000:1.0:1789760688.680201:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660314966501 time 660366883581 state 0x0 ref 1
00000100:00100000:1.0:1789760688.680214:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520808832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760688.680278:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17833984, mtime: 0x6aad94b1, atime: 0x0, ctime: 0x6aad94b1, blocks: 0x9007
00010000:00010000:1.0:1789760688.680287:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.680306:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=660s v=(0 0)
00010000:00010000:1.0:1789760688.680311:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760688.680352:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.680368:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760688.716483:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17833984 -> 17838080
00010000:00010000:1.0:1789760688.716500:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.716513:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.716522:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.716534:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760688.716538:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.716547:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.716567:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.716575:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60a9ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17833984->17838079] (req 17833984->17838079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760688.717177:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520808832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36553us (36829us total) trans 4294971674 rc 0/0
00000100:00100000:1.0:1789760688.717189:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4387
00000100:00100000:1.0:1789760688.717199:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660314966501 time 660366883581 state 0x2 ref 0
00000100:00100000:1.0:1789760688.722962:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520808960
00000100:00100000:1.0:1789760688.722972:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520808960
00000100:00100000:1.0:1789760688.723028:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660314966501 time 660366883581 state 0x0 ref 1
00000100:00100000:1.0:1789760688.723044:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660367143997 time 660366883581 state 0x1 ref 1
00000100:00100000:1.0:1789760688.723184:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660367143997 time 660409865493 state 0x0 ref 1
00000100:00100000:1.0:1789760688.723202:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520808960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760688.723356:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17838080, mtime: 0x6aad94b1, atime: 0x0, ctime: 0x6aad94b1, blocks: 0x9007
00010000:00010000:1.0:1789760688.723365:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.723381:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=660s v=(0 0)
00010000:00010000:1.0:1789760688.723385:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760688.723391:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.723416:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760688.763240:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b00ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548729344:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760688.763334:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760688.763838:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b00ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548729344:0@lo:41:osp-pre-0-1.0
00002000:00010000:1.0:1789760688.772106:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17838080 -> 17842176
00010000:00010000:1.0:1789760688.772128:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.772151:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.772159:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.772171:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760688.772176:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.772185:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.772204:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.772740:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60a9f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17838080->17842175] (req 17838080->17842175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760688.772988:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520808960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49782us (50127us total) trans 4294971675 rc 0/0
00000100:00100000:1.0:1789760688.772999:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4388
00000100:00100000:1.0:1789760688.773008:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660367143997 time 660409865493 state 0x2 ref 0
00000100:00100000:1.0:1789760688.869679:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760688.916842:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17850368 -> 17854464
00002000:00010000:1.0:1789760688.916847:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760689 -> 1789760690
00002000:00010000:1.0:1789760688.916850:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760689 -> 1789760690
00010000:00010000:1.0:1789760688.916864:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aa0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17850368->17854463] (req 17850368->17854463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.916884:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aa0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17850368->17854463] (req 17850368->17854463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.916893:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aa0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17850368->17854463] (req 17850368->17854463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.916900:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760688.916904:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aa0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17850368->17854463] (req 17850368->17854463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.916913:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aa0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17850368->17854463] (req 17850368->17854463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.916932:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aa0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17850368->17854463] (req 17850368->17854463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760688.916939:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aa0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17850368->17854463] (req 17850368->17854463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760688.917076:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520809344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47077us (47413us total) trans 4294971678 rc 0/0
00000100:00100000:1.0:1789760688.917087:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4391
00000100:00100000:1.0:1789760688.917098:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660507633207 time 660556665768 state 0x2 ref 0
00000100:00100000:1.0:1789760688.921176:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760688.956993:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760688.996061:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760689.018241:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971681 is committed
00000100:00100000:1.0:1789760689.021905:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760689.046425:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760689.091580:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520810112
00000100:00100000:1.0:1789760689.091590:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520810112
00000100:00100000:1.0:1789760689.091641:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660709040652 time 660733270879 state 0x0 ref 1
00000100:00100000:1.0:1789760689.091656:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660733531295 time 660733270879 state 0x1 ref 1
00000100:00100000:1.0:1789760689.091692:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660733531295 time 660778374573 state 0x0 ref 1
00000100:00100000:1.0:1789760689.091705:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520810112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760689.091754:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17874944, mtime: 0x6aad94b2, atime: 0x0, ctime: 0x6aad94b2, blocks: 0x9007
00010000:00010000:1.0:1789760689.091773:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60aa35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.091790:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=660s v=(0 0)
00010000:00010000:1.0:1789760689.091795:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760689.091801:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60aa35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17874944->17879039] (req 17874944->17879039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.091816:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60aa35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17874944->17879039] (req 17874944->17879039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760689.133023:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760689.166108:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760689.211070:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520810496
00000100:00100000:1.0:1789760689.211079:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520810496
00000100:00100000:1.0:1789760689.211126:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660820170978 time 660853200498 state 0x0 ref 1
00000100:00100000:1.0:1789760689.211151:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660853460914 time 660853200498 state 0x1 ref 1
00000100:00100000:1.0:1789760689.211178:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660853460914 time 660897861602 state 0x0 ref 1
00000100:00100000:1.0:1789760689.211190:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520810496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760689.211236:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17887232, mtime: 0x6aad94b2, atime: 0x0, ctime: 0x6aad94b2, blocks: 0x9007
00010000:00010000:1.0:1789760689.211245:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60aa4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.211260:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=660s v=(0 0)
00010000:00010000:1.0:1789760689.211263:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760689.211269:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60aa4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17887232->17891327] (req 17887232->17891327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.211282:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60aa4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17887232->17891327] (req 17887232->17891327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760689.286162:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00010000:00010000:2.0:1789760689.406729:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760689.406734:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60aa58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17895424->17899519] (req 17895424->17899519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.406743:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60aa58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17895424->17899519] (req 17895424->17899519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.406991:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60aa58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17895424->17899519] (req 17895424->17899519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.407002:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60aa58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17895424->17899519] (req 17895424->17899519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760689.407098:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520810752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 80912us (81248us total) trans 4294971689 rc 0/0
00000100:00100000:2.0:1789760689.407109:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4402
00000100:00100000:2.0:1789760689.407118:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660973442932 time 661012853710 state 0x2 ref 0
00000100:00100000:1.0:1789760689.412182:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520810880
00000100:00100000:1.0:1789760689.412194:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520810880
00000100:00100000:1.0:1789760689.412253:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 660973442932 time 661012853710 state 0x0 ref 1
00000100:00100000:1.0:1789760689.412268:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661013114126 time 661012853710 state 0x1 ref 1
00000100:00100000:1.0:1789760689.412350:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661013114126 time 661099032040 state 0x0 ref 1
00000100:00100000:1.0:1789760689.412364:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520810880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760689.412413:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17899520, mtime: 0x6aad94b2, atime: 0x0, ctime: 0x6aad94b2, blocks: 0x9007
00010000:00010000:1.0:1789760689.412422:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.412438:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=661s v=(0 0)
00010000:00010000:1.0:1789760689.412442:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760689.412449:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.412464:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760689.487583:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17899520 -> 17903616
00010000:00010000:1.0:1789760689.487599:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.487612:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.487621:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.487628:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760689.487634:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.487643:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.487850:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.487860:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60aa5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17899520->17903615] (req 17899520->17903615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760689.488005:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520810880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 75639us (77051us total) trans 4294971690 rc 0/0
00000100:00100000:1.0:1789760689.488017:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4403
00000100:00100000:1.0:1789760689.488038:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661013114126 time 661099032040 state 0x2 ref 0
00002000:00010000:1.0:1789760689.540681:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17903616 -> 17907712
00010000:00010000:1.0:1789760689.540696:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aa66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17903616->17907711] (req 17903616->17907711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.540708:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aa66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17903616->17907711] (req 17903616->17907711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.540717:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aa66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17903616->17907711] (req 17903616->17907711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.540729:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760689.540734:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aa66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17903616->17907711] (req 17903616->17907711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.540742:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aa66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17903616->17907711] (req 17903616->17907711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.540885:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aa66 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17903616->17907711] (req 17903616->17907711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.540895:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aa66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17903616->17907711] (req 17903616->17907711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760689.540992:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520811008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48534us (48920us total) trans 4294971691 rc 0/0
00000100:00100000:1.0:1789760689.541002:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4404
00000100:00100000:1.0:1789760689.541011:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661099292456 time 661179122104 state 0x2 ref 0
00000001:00080000:2.0:1789760689.592829:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971692 is committed
00000001:00080000:1.0:1789760689.638966:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971693 is committed
00000001:00080000:2.0:1789760689.669456:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971694 is committed
00000100:00100000:2.0:1789760689.677166:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520811520
00000100:00100000:2.0:1789760689.677176:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520811520
00000100:00100000:2.0:1789760689.677230:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661284002004 time 661324763813 state 0x0 ref 1
00000100:00100000:2.0:1789760689.677245:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661325024229 time 661324763813 state 0x1 ref 1
00000100:00100000:2.0:1789760689.677307:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661325024229 time 661363989654 state 0x0 ref 1
00000100:00100000:2.0:1789760689.677347:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520811520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760689.677396:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17920000, mtime: 0x6aad94b2, atime: 0x0, ctime: 0x6aad94b2, blocks: 0x9007
00010000:00010000:2.0:1789760689.677406:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.677421:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=661s v=(0 0)
00010000:00010000:2.0:1789760689.677425:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760689.677431:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.677443:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760689.733583:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17920000 -> 17924096
00010000:00010000:1.0:1789760689.733600:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.733614:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.733627:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.733635:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760689.733640:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.733648:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.733675:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.733683:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60aa82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17920000->17924095] (req 17920000->17924095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760689.733784:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520811520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56435us (57181us total) trans 4294971695 rc 0/0
00000100:00100000:1.0:1789760689.733794:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4408
00000100:00100000:1.0:1789760689.733805:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661325024229 time 661363989654 state 0x2 ref 0
00000100:00100000:2.0:1789760689.737645:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520811648
00000100:00100000:2.0:1789760689.737663:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520811648
00000100:00100000:2.0:1789760689.737714:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661325024229 time 661363989654 state 0x0 ref 1
00000100:00100000:2.0:1789760689.737729:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661364250070 time 661363989654 state 0x1 ref 1
00000100:00100000:2.0:1789760689.737771:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661364250070 time 661424453611 state 0x0 ref 1
00000100:00100000:2.0:1789760689.737783:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520811648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760689.737830:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17924096, mtime: 0x6aad94b2, atime: 0x0, ctime: 0x6aad94b2, blocks: 0x9007
00010000:00010000:2.0:1789760689.737838:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.737854:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=661s v=(0 0)
00010000:00010000:2.0:1789760689.737859:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760689.737866:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.737879:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760689.787183:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17924096 -> 17928192
00010000:00010000:2.0:1789760689.787198:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.787210:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.787218:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.787225:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760689.787230:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.787239:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.787258:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.787265:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aa89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17924096->17928191] (req 17924096->17928191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760689.787401:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520811648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49615us (49881us total) trans 4294971696 rc 0/0
00000100:00100000:2.0:1789760689.787412:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4409
00000100:00100000:2.0:1789760689.787422:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661364250070 time 661424453611 state 0x2 ref 0
00000100:00100000:2.0:1789760689.791935:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1789760689.791961:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548729472:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1789760689.792052:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760689.792300:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548729472
00000100:00100000:1.0:1789760689.792310:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548729472
00000100:00100000:1.0:1789760689.792379:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386
00000100:00100000:1.0:1789760689.792397:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548729472:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1789760689.792440:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:1.0:1789760689.792697:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548729472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (448us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760689.792706:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386
00000100:00100000:2.0:1789760689.792712:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:2.0:1789760689.874687:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17928192 -> 17932288
00010000:00010000:2.0:1789760689.874702:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60aa90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17928192->17932287] (req 17928192->17932287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.874714:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60aa90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17928192->17932287] (req 17928192->17932287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.874724:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60aa90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17928192->17932287] (req 17928192->17932287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.874733:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760689.874738:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60aa90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17928192->17932287] (req 17928192->17932287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.874746:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60aa90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17928192->17932287] (req 17928192->17932287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.874956:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60aa90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17928192->17932287] (req 17928192->17932287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760689.874964:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60aa90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17928192->17932287] (req 17928192->17932287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760689.875056:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520811776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 82194us (82339us total) trans 4294971697 rc 0/0
00000100:00100000:2.0:1789760689.875066:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4410
00000100:00100000:2.0:1789760689.875075:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661424714027 time 661479529340 state 0x2 ref 0
00000100:00100000:2.0:1789760689.878476:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760689.929523:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971698 is committed
00000100:00100000:1.0:1789760689.935914:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520812032
00000100:00100000:1.0:1789760689.935929:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520812032
00000100:00100000:1.0:1789760689.935995:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661479789756 time 661565360362 state 0x0 ref 1
00000100:00100000:1.0:1789760689.936014:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661565620778 time 661565360362 state 0x1 ref 1
00000100:00100000:1.0:1789760689.936090:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661565620778 time 661622772522 state 0x0 ref 1
00000100:00100000:1.0:1789760689.936103:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520812032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760689.936163:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17936384, mtime: 0x6aad94b3, atime: 0x0, ctime: 0x6aad94b3, blocks: 0x9007
00010000:00010000:1.0:1789760689.936173:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aa9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.936187:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=661s v=(0 0)
00010000:00010000:1.0:1789760689.936191:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760689.936197:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aa9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17936384->17940479] (req 17936384->17940479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760689.936211:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aa9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17936384->17940479] (req 17936384->17940479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760689.993522:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971699 is committed
00000100:00100000:2.0:1789760689.997900:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760690.039986:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520812928
00000100:00100000:2.0:1789760690.039997:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520812928
00000001:00080000:2.0:1789760690.074468:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971701 is committed
00002000:00010000:1.0:1789760690.074593:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17944576 -> 17948672
00010000:00010000:1.0:1789760690.074610:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aaac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17944576->17948671] (req 17944576->17948671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.074622:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aaac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17944576->17948671] (req 17944576->17948671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.074631:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aaac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17944576->17948671] (req 17944576->17948671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.074637:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760690.074642:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aaac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17944576->17948671] (req 17944576->17948671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.074651:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aaac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17944576->17948671] (req 17944576->17948671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.074742:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aaac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17944576->17948671] (req 17944576->17948671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.074751:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aaac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17944576->17948671] (req 17944576->17948671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760690.075073:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520812928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34756us (35631us total) trans 4294971701 rc 0/0
00000100:00100000:1.0:1789760690.075084:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4414
00000100:00100000:1.0:1789760690.075094:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661685106891 time 661726981810 state 0x2 ref 0
00000100:00100000:1.0:1789760690.083392:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760690.121664:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971702 is committed
00000100:00100000:1.0:1789760690.131167:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520813184
00000100:00100000:1.0:1789760690.131176:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520813184
00000100:00100000:1.0:1789760690.131224:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661727242226 time 661770277508 state 0x0 ref 1
00000100:00100000:1.0:1789760690.131239:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661770537924 time 661770277508 state 0x1 ref 1
00000100:00100000:1.0:1789760690.131271:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661770537924 time 661817952988 state 0x0 ref 1
00000100:00100000:1.0:1789760690.131281:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520813184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760690.131350:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17952768, mtime: 0x6aad94b3, atime: 0x0, ctime: 0x6aad94b3, blocks: 0x9007
00010000:00010000:1.0:1789760690.131360:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.131376:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=661s v=(0 0)
00010000:00010000:1.0:1789760690.131382:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760690.131388:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.131402:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760690.167264:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17952768 -> 17956864
00010000:00010000:2.0:1789760690.167279:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.167292:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.167303:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.167333:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760690.167338:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.167347:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.167364:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.167372:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60aaba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17952768->17956863] (req 17952768->17956863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760690.167465:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520813184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36177us (36394us total) trans 4294971703 rc 0/0
00000100:00100000:2.0:1789760690.167476:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4416
00000100:00100000:2.0:1789760690.167486:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661770537924 time 661817952988 state 0x2 ref 0
00000100:00100000:1.0:1789760690.172056:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760690.212282:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760690.268246:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971705 is committed
00002000:00010000:2.0:1789760690.268474:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17960960 -> 17965056
00010000:00010000:2.0:1789760690.268489:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17960960->17965055] (req 17960960->17965055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.268502:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17960960->17965055] (req 17960960->17965055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.268516:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17960960->17965055] (req 17960960->17965055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.268523:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760690.268528:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17960960->17965055] (req 17960960->17965055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.268537:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aac8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17960960->17965055] (req 17960960->17965055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.268556:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aac8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17960960->17965055] (req 17960960->17965055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.268564:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17960960->17965055] (req 17960960->17965055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760690.268662:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc825b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520813440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55665us (56376us total) trans 4294971705 rc 0/0
00000100:00100000:2.0:1789760690.268674:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4418
00000100:00100000:2.0:1789760690.268683:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661859187544 time 661899655405 state 0x2 ref 0
00000100:00100000:1.0:1789760690.273051:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760690.297811:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1789760690.297834:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548729600:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1789760690.297918:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00010000:2.0:1789760690.304661:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17965056 -> 17969152
00010000:00010000:2.0:1789760690.304677:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aacf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17965056->17969151] (req 17965056->17969151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.304694:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aacf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17965056->17969151] (req 17965056->17969151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.304702:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aacf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17965056->17969151] (req 17965056->17969151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.304709:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760690.304714:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aacf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17965056->17969151] (req 17965056->17969151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.304722:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aacf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17965056->17969151] (req 17965056->17969151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.304739:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aacf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17965056->17969151] (req 17965056->17969151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.304746:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60aacf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17965056->17969151] (req 17965056->17969151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760690.305051:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520813568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31620us (32003us total) trans 4294971706 rc 0/0
00000100:00100000:2.0:1789760690.305061:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4419
00000100:00100000:2.0:1789760690.305072:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661899915821 time 661960098500 state 0x2 ref 0
00000100:00100000:1.0:1789760690.309196:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760690.357465:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760690.400199:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971708 is committed
00002000:00010000:1.0:1789760690.400279:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17973248 -> 17977344
00010000:00010000:1.0:1789760690.400295:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60aadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17973248->17977343] (req 17973248->17977343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.400306:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60aadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17973248->17977343] (req 17973248->17977343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.400341:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60aadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17973248->17977343] (req 17973248->17977343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.400348:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760690.400353:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60aadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17973248->17977343] (req 17973248->17977343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.400363:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60aadd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17973248->17977343] (req 17973248->17977343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.400382:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60aadd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17973248->17977343] (req 17973248->17977343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.400389:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60aadd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17973248->17977343] (req 17973248->17977343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760690.400471:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520813824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42702us (43011us total) trans 4294971708 rc 0/0
00000100:00100000:1.0:1789760690.400482:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4421
00000100:00100000:1.0:1789760690.400492:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 661996445321 time 662044428162 state 0x2 ref 0
00000100:00100000:1.0:1789760690.407303:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760690.443689:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17977344 -> 17981440
00010000:00010000:1.0:1789760690.443710:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17977344->17981439] (req 17977344->17981439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.443722:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17977344->17981439] (req 17977344->17981439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.443730:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17977344->17981439] (req 17977344->17981439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.443737:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760690.443741:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17977344->17981439] (req 17977344->17981439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.443748:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aae4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17977344->17981439] (req 17977344->17981439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.443767:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aae4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17977344->17981439] (req 17977344->17981439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760690.443779:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60aae4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17977344->17981439] (req 17977344->17981439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760690.449136:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520813952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41536us (41826us total) trans 4294971709 rc 0/0
00000100:00100000:2.0:1789760690.449151:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4422
00000100:00100000:2.0:1789760690.449161:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662044688578 time 662094252316 state 0x2 ref 0
00000100:00100000:2.0:1789760690.459222:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520814080
00000100:00100000:2.0:1789760690.459230:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520814080
00000100:00100000:2.0:1789760690.459280:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662044688578 time 662094252316 state 0x0 ref 1
00000100:00100000:2.0:1789760690.459293:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662094512732 time 662094252316 state 0x1 ref 1
00000100:00100000:2.0:1789760690.459395:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662094512732 time 662146077535 state 0x0 ref 1
00000100:00100000:2.0:1789760690.459407:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520814080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760690.459448:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17981440, mtime: 0x6aad94b3, atime: 0x0, ctime: 0x6aad94b3, blocks: 0x9007
00010000:00010000:2.0:1789760690.459457:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aaeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.459472:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=662s v=(0 0)
00010000:00010000:2.0:1789760690.459475:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760690.459481:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aaeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17981440->17985535] (req 17981440->17985535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.459493:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aaeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17981440->17985535] (req 17981440->17985535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760690.530024:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971710 is committed
00000100:00100000:2.0:1789760690.534068:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760690.609237:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971711 is committed
00000100:00100000:1.0:1789760690.617257:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760690.623070:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662146337951 time 662224624882 state 0x0 ref 1
00000100:00100000:2.0:1789760690.623089:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662224885298 time 662224624882 state 0x1 ref 1
00000100:00100000:2.0:1789760690.623137:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662224885298 time 662309819812 state 0x0 ref 1
00000100:00100000:2.0:1789760690.623152:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520814336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760690.623197:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17989632, mtime: 0x6aad94b3, atime: 0x0, ctime: 0x6aad94b3, blocks: 0x9007
00010000:00010000:2.0:1789760690.623206:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60aaf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.623223:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=662s v=(0 0)
00010000:00010000:2.0:1789760690.623228:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760690.623234:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60aaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17989632->17993727] (req 17989632->17993727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.623248:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60aaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17989632->17993727] (req 17989632->17993727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760690.732083:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971712 is committed
00010000:00010000:2.0:1789760690.747486:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789760690.758738:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520814464
00000100:00100000:2.0:1789760690.758747:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520814464
00000100:00100000:2.0:1789760690.758809:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662224885298 time 662309819812 state 0x0 ref 1
00000100:00100000:2.0:1789760690.758825:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662310080228 time 662309819812 state 0x1 ref 1
00000100:00100000:2.0:1789760690.758852:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662310080228 time 662445535171 state 0x0 ref 1
00000100:00100000:2.0:1789760690.758865:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520814464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760690.758908:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17993728, mtime: 0x6aad94b3, atime: 0x0, ctime: 0x6aad94b3, blocks: 0x9007
00010000:00010000:2.0:1789760690.758918:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.758934:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=662s v=(0 0)
00010000:00010000:2.0:1789760690.758939:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760690.758946:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.758959:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760690.862813:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971713 is committed
00002000:00010000:2.0:1789760690.862917:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 17993728 -> 17997824
00010000:00010000:2.0:1789760690.862934:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.862948:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.862957:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.862963:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760690.862968:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.862977:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.862994:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.863002:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ab00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17993728->17997823] (req 17993728->17997823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760690.863092:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520814464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 104224us (104548us total) trans 4294971713 rc 0/0
00000100:00100000:2.0:1789760690.863102:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4426
00000100:00100000:2.0:1789760690.863112:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662310080228 time 662445535171 state 0x2 ref 0
00000100:00100000:2.0:1789760690.874458:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662310080228 time 662445535171 state 0x0 ref 1
00000100:00100000:2.0:1789760690.874474:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662445795587 time 662445535171 state 0x1 ref 1
00000100:00100000:2.0:1789760690.874498:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662445795587 time 662561181048 state 0x0 ref 1
00000100:00100000:2.0:1789760690.874513:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520814592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760690.874561:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 17997824, mtime: 0x6aad94b3, atime: 0x0, ctime: 0x6aad94b3, blocks: 0x9007
00010000:00010000:2.0:1789760690.874571:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ab07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.874591:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=662s v=(0 0)
00010000:00010000:2.0:1789760690.874596:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760690.874602:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ab07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17997824->18001919] (req 17997824->18001919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760690.874616:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ab07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [17997824->18001919] (req 17997824->18001919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760690.986509:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971714 is committed
00000100:00100000:1.0:1789760690.999483:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760691.074945:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971715 is committed
00000100:00100000:1.0:1789760691.078358:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760691.139080:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760691.198297:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760691.260681:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18014208 -> 18018304
00010000:00010000:1.0:1789760691.260702:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ab23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18014208->18018303] (req 18014208->18018303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.260717:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ab23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18014208->18018303] (req 18014208->18018303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.260725:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ab23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18014208->18018303] (req 18014208->18018303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.260732:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760691.260737:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ab23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18014208->18018303] (req 18014208->18018303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.260761:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ab23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18014208->18018303] (req 18014208->18018303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.260780:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ab23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18014208->18018303] (req 18014208->18018303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.260787:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ab23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18014208->18018303] (req 18014208->18018303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760691.260884:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520815104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62352us (62590us total) trans 4294971718 rc 0/0
00000100:00100000:1.0:1789760691.260896:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4431
00000100:00100000:1.0:1789760691.260917:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662826202844 time 662885200079 state 0x2 ref 0
00000001:00080000:1.0:1789760691.262129:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971718 is committed
00000100:00100000:1.0:1789760691.322579:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548730240:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.322622:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760691.322695:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548730752:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.322717:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760691.328019:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520815360
00000100:00100000:2.0:1789760691.328027:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520815360
00000100:00100000:2.0:1789760691.328076:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662885460495 time 662951560147 state 0x0 ref 1
00000100:00100000:2.0:1789760691.328090:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662951820563 time 662951560147 state 0x1 ref 1
00000100:00100000:2.0:1789760691.328129:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662951820563 time 663014811888 state 0x0 ref 1
00000100:00100000:2.0:1789760691.328141:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520815360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760691.328184:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18022400, mtime: 0x6aad94b4, atime: 0x0, ctime: 0x6aad94b4, blocks: 0x9007
00010000:00010000:2.0:1789760691.328193:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.328208:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:2.0:1789760691.328212:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760691.328219:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.328233:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760691.329011:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548731264:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.329058:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760691.335271:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548730240:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335289:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548730752:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335339:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760691.335368:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548731008:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335415:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760691.335441:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548730112:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335452:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548730624:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335464:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548731136:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335489:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548731008
00000100:00100000:1.0:1789760691.335495:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548731008
00000100:00100000:1.0:1789760691.335532:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254
00000100:00100000:1.0:1789760691.335540:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548731008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335588:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548731008:12345-0@lo:400:kworker.0 Request processed in 48us (171us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760691.335595:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254
00000100:00100000:1.0:1789760691.335628:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548731008:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335824:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548731264
00000100:00100000:1.0:1789760691.335829:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548731264
00000100:00100000:1.0:1789760691.335863:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548730496
00000100:00100000:1.0:1789760691.335866:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548730496
00000100:00100000:1.0:1789760691.335884:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779
00000100:00100000:1.0:1789760691.335890:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548731264:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335930:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548731264:12345-0@lo:400:kworker.0 Request processed in 40us (6872us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760691.335937:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779
00000100:00100000:1.0:1789760691.335949:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780
00000100:00100000:1.0:1789760691.335955:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876699548730496:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.335987:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876699548730496:12345-0@lo:400:kworker.0 Request processed in 33us (648us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760691.335994:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780
00000100:00080000:1.0:1789760691.336010:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789760691.336032:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548731264:0@lo:400:kworker.0
00000100:00100000:1.0:1789760691.336055:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6140e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876699548730496:0@lo:400:kworker.0
00002000:00010000:2.0:1789760691.362410:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18022400 -> 18026496
00010000:00010000:2.0:1789760691.362428:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.362443:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.362453:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.362462:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760691.362467:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.362477:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.362499:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.362507:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ab31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18022400->18026495] (req 18022400->18026495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760691.362655:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520815360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34500us (34709us total) trans 4294971720 rc 0/0
00000100:00100000:2.0:1789760691.362666:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4433
00000100:00100000:2.0:1789760691.362676:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 662951820563 time 663014811888 state 0x2 ref 0
00000100:00100000:2.0:1789760691.367444:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760691.403029:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971721 is committed
00000100:00100000:2.0:1789760691.404463:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760691.432288:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18030592 -> 18034688
00010000:00010000:1.0:1789760691.432303:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18030592->18034687] (req 18030592->18034687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.432335:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18030592->18034687] (req 18030592->18034687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.432345:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18030592->18034687] (req 18030592->18034687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.432352:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760691.432357:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18030592->18034687] (req 18030592->18034687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.432367:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18030592->18034687] (req 18030592->18034687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.432387:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18030592->18034687] (req 18030592->18034687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.432401:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18030592->18034687] (req 18030592->18034687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760691.432536:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520815616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27689us (28078us total) trans 4294971722 rc 0/0
00000100:00100000:1.0:1789760691.432548:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4435
00000100:00100000:1.0:1789760691.432558:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663054578124 time 663091512751 state 0x2 ref 0
00000100:00100000:1.0:1789760691.437288:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760691.472547:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760691.472627:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520815872
00000100:00100000:2.0:1789760691.472635:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520815872
00000100:00100000:2.0:1789760691.472739:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663091773167 time 663124324757 state 0x0 ref 1
00000100:00100000:2.0:1789760691.472816:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663124585173 time 663124324757 state 0x1 ref 1
00000100:00100000:2.0:1789760691.472866:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663124585173 time 663159548369 state 0x0 ref 1
00000100:00100000:2.0:1789760691.472879:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520815872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760691.472984:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18038784, mtime: 0x6aad94b4, atime: 0x0, ctime: 0x6aad94b4, blocks: 0x9007
00010000:00010000:2.0:1789760691.472994:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.473009:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:2.0:1789760691.473014:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760691.473021:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.473040:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760691.498109:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971724 is committed
00002000:00010000:2.0:1789760691.498235:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18038784 -> 18042880
00010000:00010000:2.0:1789760691.498251:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.498264:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.498273:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.498280:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760691.498285:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.498295:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.498342:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.498351:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18038784->18042879] (req 18038784->18042879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760691.498436:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520815872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25555us (25894us total) trans 4294971724 rc 0/0
00000100:00100000:2.0:1789760691.498446:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4437
00000100:00100000:2.0:1789760691.498455:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663124585173 time 663159548369 state 0x2 ref 0
00000100:00100000:1.0:1789760691.502634:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760691.531838:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18042880 -> 18046976
00010000:00010000:1.0:1789760691.531853:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ab54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18042880->18046975] (req 18042880->18046975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.531866:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ab54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18042880->18046975] (req 18042880->18046975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.531875:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ab54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18042880->18046975] (req 18042880->18046975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.531884:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760691.531889:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ab54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18042880->18046975] (req 18042880->18046975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.531904:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ab54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18042880->18046975] (req 18042880->18046975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.531923:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ab54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18042880->18046975] (req 18042880->18046975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.531931:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ab54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18042880->18046975] (req 18042880->18046975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760691.532026:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520816000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28818us (29397us total) trans 4294971725 rc 0/0
00000100:00100000:1.0:1789760691.532037:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4438
00000100:00100000:1.0:1789760691.532047:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663159808785 time 663189873699 state 0x2 ref 0
00000100:00100000:1.0:1789760691.535792:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760691.566232:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971726 is committed
00000100:00100000:2.0:1789760691.571047:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760691.603138:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18051072 -> 18055168
00010000:00010000:1.0:1789760691.603160:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18051072->18055167] (req 18051072->18055167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.603174:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18051072->18055167] (req 18051072->18055167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.603183:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18051072->18055167] (req 18051072->18055167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.603197:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760691.603202:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18051072->18055167] (req 18051072->18055167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.603211:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18051072->18055167] (req 18051072->18055167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.603230:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18051072->18055167] (req 18051072->18055167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.603237:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ab62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18051072->18055167] (req 18051072->18055167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760691.603362:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520816256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32047us (32319us total) trans 4294971727 rc 0/0
00000100:00100000:1.0:1789760691.603372:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4440
00000100:00100000:1.0:1789760691.603381:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663222930507 time 663257977710 state 0x2 ref 0
00000100:00100000:1.0:1789760691.607625:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760691.607891:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520816384
00000100:00100000:2.0:1789760691.607901:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520816384
00000100:00100000:2.0:1789760691.607956:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663222930507 time 663257977710 state 0x0 ref 1
00000100:00100000:2.0:1789760691.607972:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663258238126 time 663257977710 state 0x1 ref 1
00000100:00100000:2.0:1789760691.608034:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663258238126 time 663294715451 state 0x0 ref 1
00000100:00100000:2.0:1789760691.608047:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520816384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760691.608090:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18055168, mtime: 0x6aad94b4, atime: 0x0, ctime: 0x6aad94b4, blocks: 0x9007
00010000:00010000:2.0:1789760691.608099:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.608125:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:2.0:1789760691.608129:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760691.608136:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18055168->18059263] (req 18055168->18059263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.608155:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18055168->18059263] (req 18055168->18059263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760691.638795:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760691.667178:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971729 is committed
00000100:00100000:2.0:1789760691.667634:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520816512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28617us (28843us total) trans 4294971729 rc 0/0
00000100:00100000:2.0:1789760691.667708:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4442
00000100:00100000:2.0:1789760691.667718:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663294975867 time 663325684233 state 0x2 ref 0
00000100:00100000:1.0:1789760691.671287:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760691.671590:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663294975867 time 663325684233 state 0x0 ref 1
00000100:00100000:2.0:1789760691.671604:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663325944649 time 663325684233 state 0x1 ref 1
00000100:00100000:2.0:1789760691.671725:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663325944649 time 663358406269 state 0x0 ref 1
00000100:00100000:2.0:1789760691.671738:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520816640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760691.671852:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18063360, mtime: 0x6aad94b4, atime: 0x0, ctime: 0x6aad94b4, blocks: 0x9007
00010000:00010000:2.0:1789760691.671861:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.671878:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:2.0:1789760691.671882:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760691.671888:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.671903:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760691.698531:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971730 is committed
00002000:00010000:2.0:1789760691.698827:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18063360 -> 18067456
00010000:00010000:2.0:1789760691.698842:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.698855:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.698865:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.698873:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760691.698877:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.698886:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.698906:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.698914:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18063360->18067455] (req 18063360->18067455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760691.699004:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520816640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27263us (27721us total) trans 4294971730 rc 0/0
00000100:00100000:2.0:1789760691.699019:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4443
00000100:00100000:2.0:1789760691.699028:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663325944649 time 663358406269 state 0x2 ref 0
00000100:00100000:1.0:1789760691.702538:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760691.702626:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520816768
00000100:00100000:2.0:1789760691.702637:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520816768
00000100:00100000:2.0:1789760691.702806:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663325944649 time 663358406269 state 0x0 ref 1
00000100:00100000:2.0:1789760691.702823:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663358666685 time 663358406269 state 0x1 ref 1
00000100:00100000:2.0:1789760691.702884:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663358666685 time 663389566092 state 0x0 ref 1
00000100:00100000:2.0:1789760691.702899:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520816768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760691.702944:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18067456, mtime: 0x6aad94b4, atime: 0x0, ctime: 0x6aad94b4, blocks: 0x9007
00010000:00010000:2.0:1789760691.702954:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.702970:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:2.0:1789760691.702974:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760691.702981:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.702995:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760691.735951:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971731 is committed
00002000:00010000:2.0:1789760691.736052:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18067456 -> 18071552
00010000:00010000:2.0:1789760691.736068:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.736080:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.736090:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.736097:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760691.736102:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.736122:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.736206:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.736216:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ab7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18067456->18071551] (req 18067456->18071551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760691.736303:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520816768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33403us (33770us total) trans 4294971731 rc 0/0
00000100:00100000:2.0:1789760691.738277:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4444
00000100:00100000:2.0:1789760691.738291:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663358666685 time 663389566092 state 0x2 ref 0
00000100:00100000:1.0:1789760691.801296:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760691.801611:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520817024
00000100:00100000:2.0:1789760691.801621:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520817024
00000100:00100000:2.0:1789760691.801681:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663389826508 time 663427662954 state 0x0 ref 1
00000100:00100000:2.0:1789760691.801696:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663427923370 time 663427662954 state 0x1 ref 1
00000100:00100000:2.0:1789760691.801725:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663427923370 time 663488407930 state 0x0 ref 1
00000100:00100000:2.0:1789760691.801737:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520817024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760691.801879:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18075648, mtime: 0x6aad94b4, atime: 0x0, ctime: 0x6aad94b4, blocks: 0x9007
00010000:00010000:2.0:1789760691.801888:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.801903:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:2.0:1789760691.801908:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760691.801914:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.801927:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760691.835911:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971733 is committed
00002000:00010000:1.0:1789760691.836056:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18075648 -> 18079744
00010000:00010000:1.0:1789760691.836071:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.836084:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.836094:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.836101:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760691.836105:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.836125:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.836144:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.836151:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ab8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18075648->18079743] (req 18075648->18079743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760691.836243:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520817024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34502us (34952us total) trans 4294971733 rc 0/0
00000100:00100000:1.0:1789760691.836254:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4446
00000100:00100000:1.0:1789760691.836264:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663427923370 time 663488407930 state 0x2 ref 0
00000100:00100000:2.0:1789760691.840404:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760691.863770:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971734 is committed
00000100:00100000:1.0:1789760691.867617:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520817280
00000100:00100000:1.0:1789760691.867626:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520817280
00000100:00100000:1.0:1789760691.867680:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663488668346 time 663527319658 state 0x0 ref 1
00000100:00100000:1.0:1789760691.867694:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663527580074 time 663527319658 state 0x1 ref 1
00000100:00100000:1.0:1789760691.867721:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663527580074 time 663554403970 state 0x0 ref 1
00000100:00100000:1.0:1789760691.867732:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520817280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760691.867783:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18083840, mtime: 0x6aad94b4, atime: 0x0, ctime: 0x6aad94b4, blocks: 0x9007
00010000:00010000:1.0:1789760691.867792:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.867807:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:1.0:1789760691.867811:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760691.867817:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.867831:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760691.901204:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18083840 -> 18087936
00002000:00010000:1.0:1789760691.901209:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760692 -> 1789760693
00002000:00010000:1.0:1789760691.901211:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760692 -> 1789760693
00010000:00010000:1.0:1789760691.901225:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.901238:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.901248:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.901256:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760691.901261:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.901269:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.901289:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760691.901296:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ab9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18083840->18087935] (req 18083840->18087935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760691.905612:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:2.0:1789760691.935441:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18087936 -> 18092032
00010000:00010000:2.0:1789760691.935461:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60aba1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18087936->18092031] (req 18087936->18092031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.935481:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60aba1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18087936->18092031] (req 18087936->18092031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.935491:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60aba1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18087936->18092031] (req 18087936->18092031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.935498:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760691.935502:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60aba1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18087936->18092031] (req 18087936->18092031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.935511:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60aba1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18087936->18092031] (req 18087936->18092031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.935529:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60aba1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18087936->18092031] (req 18087936->18092031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760691.935537:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60aba1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18087936->18092031] (req 18087936->18092031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760691.935622:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520817408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29755us (30015us total) trans 4294971736 rc 0/0
00000100:00100000:2.0:1789760691.935632:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4449
00000100:00100000:2.0:1789760691.935648:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663554664386 time 663592536344 state 0x2 ref 0
00000100:00100000:1.0:1789760691.939460:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760691.993217:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971737 is committed
00000100:00100000:1.0:1789760692.005563:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760692.005653:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520817664
00000100:00100000:2.0:1789760692.005663:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520817664
00000100:00100000:2.0:1789760692.005736:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663592796760 time 663626322178 state 0x0 ref 1
00000100:00100000:2.0:1789760692.005753:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663626582594 time 663626322178 state 0x1 ref 1
00000100:00100000:2.0:1789760692.005800:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663626582594 time 663692481818 state 0x0 ref 1
00000100:00100000:2.0:1789760692.005813:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520817664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760692.005865:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18096128, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:2.0:1789760692.005874:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60abaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.005891:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:2.0:1789760692.005896:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760692.005902:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60abaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18096128->18100223] (req 18096128->18100223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.005918:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60abaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18096128->18100223] (req 18096128->18100223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760692.102184:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971738 is committed
00000100:00100000:2.0:1789760692.108518:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760692.163567:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971739 is committed
00002000:00010000:1.0:1789760692.163635:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18100224 -> 18104320
00010000:00010000:1.0:1789760692.163659:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60abb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18100224->18104319] (req 18100224->18104319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.163672:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60abb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18100224->18104319] (req 18100224->18104319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.163681:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60abb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18100224->18104319] (req 18100224->18104319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.163688:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760692.163693:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60abb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18100224->18104319] (req 18100224->18104319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.163703:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60abb6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18100224->18104319] (req 18100224->18104319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.163721:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60abb6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18100224->18104319] (req 18100224->18104319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.163728:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60abb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18100224->18104319] (req 18100224->18104319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760692.163811:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520817792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55093us (55298us total) trans 4294971739 rc 0/0
00000100:00100000:1.0:1789760692.163821:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4452
00000100:00100000:1.0:1789760692.163830:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663692742234 time 663795385947 state 0x2 ref 0
00000100:00100000:1.0:1789760692.168512:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760692.207188:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971740 is committed
00000100:00100000:1.0:1789760692.222101:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760692.265158:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971741 is committed
00000100:00100000:2.0:1789760692.267411:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760692.296943:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760692.297029:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520818304
00000100:00100000:1.0:1789760692.297038:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520818304
00000100:00100000:1.0:1789760692.297087:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663909361123 time 663954283980 state 0x0 ref 1
00000100:00100000:1.0:1789760692.297101:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663954544396 time 663954283980 state 0x1 ref 1
00000100:00100000:1.0:1789760692.297142:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663954544396 time 663983824770 state 0x0 ref 1
00000100:00100000:1.0:1789760692.297155:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520818304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760692.297200:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18116608, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:1.0:1789760692.297209:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.297223:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=663s v=(0 0)
00010000:00010000:1.0:1789760692.297227:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760692.297233:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.297245:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760692.349508:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18116608 -> 18120704
00010000:00010000:1.0:1789760692.349524:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.349537:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.349546:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.349553:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760692.349558:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.349566:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.349586:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.349593:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60abd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18116608->18120703] (req 18116608->18120703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760692.349679:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520818304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52522us (52742us total) trans 4294971743 rc 0/0
00000100:00100000:1.0:1789760692.349689:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4456
00000100:00100000:1.0:1789760692.349698:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663954544396 time 663983824770 state 0x2 ref 0
00000100:00100000:1.0:1789760692.358383:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760692.358419:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520818432
00000100:00100000:1.0:1789760692.358428:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520818432
00000100:00100000:1.0:1789760692.358478:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663954544396 time 663983824770 state 0x0 ref 1
00000100:00100000:1.0:1789760692.358493:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663984085186 time 663983824770 state 0x1 ref 1
00000100:00100000:1.0:1789760692.358518:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 663984085186 time 664045201211 state 0x0 ref 1
00000100:00100000:1.0:1789760692.358530:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520818432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760692.358575:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18120704, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:1.0:1789760692.358584:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60abd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.358599:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:1.0:1789760692.358603:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760692.358610:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60abd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18120704->18124799] (req 18120704->18124799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.358623:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60abd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18120704->18124799] (req 18120704->18124799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760692.415020:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760692.445040:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971745 is committed
00002000:00010000:2.0:1789760692.445163:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18124800 -> 18128896
00010000:00010000:2.0:1789760692.445180:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60abe0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18124800->18128895] (req 18124800->18128895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.445200:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60abe0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18124800->18128895] (req 18124800->18128895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.445209:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60abe0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18124800->18128895] (req 18124800->18128895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.445217:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760692.445222:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60abe0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18124800->18128895] (req 18124800->18128895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.445232:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60abe0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18124800->18128895] (req 18124800->18128895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.445252:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60abe0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18124800->18128895] (req 18124800->18128895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.445260:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60abe0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18124800->18128895] (req 18124800->18128895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760692.445477:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520818560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30233us (30461us total) trans 4294971745 rc 0/0
00000100:00100000:2.0:1789760692.445488:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4458
00000100:00100000:2.0:1789760692.445497:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664045461627 time 664101910401 state 0x2 ref 0
00000100:00100000:2.0:1789760692.450175:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760692.450224:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520818688
00000100:00100000:1.0:1789760692.450234:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520818688
00000100:00100000:1.0:1789760692.450286:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664045461627 time 664101910401 state 0x0 ref 1
00000100:00100000:1.0:1789760692.450303:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664102170817 time 664101910401 state 0x1 ref 1
00000001:00080000:1.0:1789760692.484954:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971746 is committed
00000100:00100000:1.0:1789760692.486862:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760692.486954:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520818816
00000100:00100000:2.0:1789760692.486963:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520818816
00000100:00100000:2.0:1789760692.487022:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664102170817 time 664137041341 state 0x0 ref 1
00000100:00100000:2.0:1789760692.487034:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664137301757 time 664137041341 state 0x1 ref 1
00000100:00100000:2.0:1789760692.487669:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664137301757 time 664174349375 state 0x0 ref 1
00000100:00100000:2.0:1789760692.487684:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520818816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760692.487730:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18132992, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:2.0:1789760692.487748:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60abee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.487763:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:2.0:1789760692.487767:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760692.487773:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60abee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18132992->18137087] (req 18132992->18137087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.487785:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60abee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18132992->18137087] (req 18132992->18137087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760692.539244:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760692.539334:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520818944
00000100:00100000:1.0:1789760692.539342:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520818944
00000100:00100000:1.0:1789760692.539393:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664137301757 time 664174349375 state 0x0 ref 1
00000100:00100000:1.0:1789760692.539405:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664174609791 time 664174349375 state 0x1 ref 1
00000100:00100000:1.0:1789760692.539422:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664174609791 time 664226106320 state 0x0 ref 1
00000100:00100000:1.0:1789760692.539430:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520818944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760692.539466:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18137088, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:1.0:1789760692.539476:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60abf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.539490:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:1.0:1789760692.539493:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760692.539499:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60abf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18137088->18141183] (req 18137088->18141183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.539509:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60abf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18137088->18141183] (req 18137088->18141183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760692.553302:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971748 is committed
00000100:00100000:2.0:1789760692.556310:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760692.556493:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520819072
00000100:00100000:1.0:1789760692.556503:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520819072
00000100:00100000:1.0:1789760692.556552:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664174609791 time 664226106320 state 0x0 ref 1
00000100:00100000:1.0:1789760692.556567:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664226366736 time 664226106320 state 0x1 ref 1
00000100:00100000:1.0:1789760692.556597:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664226366736 time 664243279181 state 0x0 ref 1
00000100:00100000:1.0:1789760692.556609:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520819072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760692.556659:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18141184, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:1.0:1789760692.556668:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60abfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.556683:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:1.0:1789760692.556687:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760692.556694:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60abfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18141184->18145279] (req 18141184->18145279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.556708:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60abfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18141184->18145279] (req 18141184->18145279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760692.577135:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971749 is committed
00000100:00100000:1.0:1789760692.581771:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760692.614244:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971750 is committed
00000100:00100000:2.0:1789760692.620222:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760692.686011:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18149376 -> 18153472
00010000:00010000:1.0:1789760692.686026:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18149376->18153471] (req 18149376->18153471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.686045:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18149376->18153471] (req 18149376->18153471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.686053:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18149376->18153471] (req 18149376->18153471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.686060:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760692.686065:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18149376->18153471] (req 18149376->18153471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.686073:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18149376->18153471] (req 18149376->18153471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.686091:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18149376->18153471] (req 18149376->18153471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.686099:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18149376->18153471] (req 18149376->18153471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760692.686215:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520819328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65787us (65997us total) trans 4294971751 rc 0/0
00000100:00100000:1.0:1789760692.686226:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4464
00000100:00100000:1.0:1789760692.686236:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664268900516 time 664307090545 state 0x2 ref 0
00000100:00100000:2.0:1789760692.693195:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760692.693247:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520819456
00000100:00100000:1.0:1789760692.693258:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520819456
00000100:00100000:1.0:1789760692.693363:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664268900516 time 664307090545 state 0x0 ref 1
00000100:00100000:1.0:1789760692.693379:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664307350961 time 664307090545 state 0x1 ref 1
00002000:00010000:1.0:1789760692.722462:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18153472 -> 18157568
00010000:00010000:1.0:1789760692.722479:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18153472->18157567] (req 18153472->18157567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.722493:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18153472->18157567] (req 18153472->18157567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.722502:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18153472->18157567] (req 18153472->18157567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.722510:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760692.722515:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18153472->18157567] (req 18153472->18157567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.722525:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18153472->18157567] (req 18153472->18157567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.722543:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18153472->18157567] (req 18153472->18157567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.722551:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ac11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18153472->18157567] (req 18153472->18157567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760692.722648:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520819456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29203us (29458us total) trans 4294971752 rc 0/0
00000100:00100000:1.0:1789760692.722660:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4465
00000100:00100000:1.0:1789760692.722669:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664307350961 time 664380108202 state 0x2 ref 0
00000100:00100000:1.0:1789760692.728532:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520819584
00000100:00100000:1.0:1789760692.728542:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520819584
00000100:00100000:1.0:1789760692.728596:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664307350961 time 664380108202 state 0x0 ref 1
00000100:00100000:1.0:1789760692.728611:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664380368618 time 664380108202 state 0x1 ref 1
00000100:00100000:1.0:1789760692.728650:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664380368618 time 664415333287 state 0x0 ref 1
00000100:00100000:1.0:1789760692.728663:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520819584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760692.728711:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18157568, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:1.0:1789760692.728721:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.728738:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:1.0:1789760692.728742:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760692.728749:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.728762:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760692.777971:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18157568 -> 18161664
00010000:00010000:1.0:1789760692.777988:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.778001:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.778011:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.778018:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760692.778023:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.778032:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.778052:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.778060:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18157568->18161663] (req 18157568->18161663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760692.778164:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520819584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49498us (49753us total) trans 4294971753 rc 0/0
00000100:00100000:1.0:1789760692.778178:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4466
00000100:00100000:1.0:1789760692.778187:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664380368618 time 664415333287 state 0x2 ref 0
00000100:00100000:2.0:1789760692.781552:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520819712
00000100:00100000:2.0:1789760692.781562:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520819712
00000100:00100000:2.0:1789760692.781614:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664380368618 time 664415333287 state 0x0 ref 1
00000100:00100000:2.0:1789760692.781628:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664415593703 time 664415333287 state 0x1 ref 1
00000100:00100000:2.0:1789760692.781662:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664415593703 time 664468344557 state 0x0 ref 1
00000100:00100000:2.0:1789760692.781675:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520819712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760692.781726:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18161664, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:2.0:1789760692.781743:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.781759:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:2.0:1789760692.781763:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760692.781768:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.781781:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760692.824932:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971754 is committed
00002000:00010000:2.0:1789760692.825000:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18161664 -> 18165760
00010000:00010000:2.0:1789760692.825016:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.825029:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.825043:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.825050:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760692.825054:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.825062:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.825082:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760692.825090:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ac1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18161664->18165759] (req 18161664->18165759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760692.825205:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520819712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43527us (43748us total) trans 4294971754 rc 0/0
00000100:00100000:2.0:1789760692.825215:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4467
00000100:00100000:2.0:1789760692.825225:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664415593703 time 664468344557 state 0x2 ref 0
00000100:00100000:2.0:1789760692.829084:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760692.829164:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520819840
00000100:00100000:1.0:1789760692.829176:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520819840
00000100:00100000:1.0:1789760692.829228:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664415593703 time 664468344557 state 0x0 ref 1
00000100:00100000:1.0:1789760692.829243:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664468604973 time 664468344557 state 0x1 ref 1
00000100:00100000:1.0:1789760692.829275:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664468604973 time 664515957391 state 0x0 ref 1
00000100:00100000:1.0:1789760692.829287:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520819840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760692.829354:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18165760, mtime: 0x6aad94b5, atime: 0x0, ctime: 0x6aad94b5, blocks: 0x9007
00010000:00010000:1.0:1789760692.829364:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ac26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.829379:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:1.0:1789760692.829384:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760692.829390:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ac26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18165760->18169855] (req 18165760->18169855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.829403:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ac26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18165760->18169855] (req 18165760->18169855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760692.887635:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971755 is committed
00000100:00100000:1.0:1789760692.892250:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760692.929578:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18169856 -> 18173952
00002000:00010000:1.0:1789760692.929584:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760693 -> 1789760694
00002000:00010000:1.0:1789760692.929587:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760693 -> 1789760694
00010000:00010000:1.0:1789760692.929600:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ac2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18169856->18173951] (req 18169856->18173951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.929613:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ac2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18169856->18173951] (req 18169856->18173951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.929622:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ac2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18169856->18173951] (req 18169856->18173951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.929630:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760692.929636:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ac2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18169856->18173951] (req 18169856->18173951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.929761:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ac2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18169856->18173951] (req 18169856->18173951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.929781:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ac2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18169856->18173951] (req 18169856->18173951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.929789:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ac2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18169856->18173951] (req 18169856->18173951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760692.929934:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520819968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37338us (37689us total) trans 4294971756 rc 0/0
00000100:00100000:1.0:1789760692.929948:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4469
00000100:00100000:1.0:1789760692.929958:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664516217807 time 664579261515 state 0x2 ref 0
00000100:00100000:2.0:1789760692.936856:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760692.937011:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520820096
00000100:00100000:1.0:1789760692.937022:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520820096
00000100:00100000:1.0:1789760692.937075:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664516217807 time 664579261515 state 0x0 ref 1
00000100:00100000:1.0:1789760692.937090:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664579521931 time 664579261515 state 0x1 ref 1
00000100:00100000:1.0:1789760692.937134:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664579521931 time 664623816603 state 0x0 ref 1
00000100:00100000:1.0:1789760692.937146:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520820096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760692.937272:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18173952, mtime: 0x6aad94b6, atime: 0x0, ctime: 0x6aad94b6, blocks: 0x9007
00010000:00010000:1.0:1789760692.937281:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ac34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.937297:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:1.0:1789760692.937301:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760692.937308:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ac34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18173952->18178047] (req 18173952->18178047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760692.937355:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ac34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18173952->18178047] (req 18173952->18178047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760692.982423:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760693.016064:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971758 is committed
00000100:00100000:1.0:1789760693.021295:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760693.068131:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971759 is committed
00000100:00100000:1.0:1789760693.075041:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520820480
00000100:00100000:1.0:1789760693.075050:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520820480
00000100:00100000:1.0:1789760693.075099:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664669651537 time 664708188204 state 0x0 ref 1
00000100:00100000:1.0:1789760693.075126:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664708448620 time 664708188204 state 0x1 ref 1
00000100:00100000:1.0:1789760693.075156:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664708448620 time 664761837822 state 0x0 ref 1
00000100:00100000:1.0:1789760693.075167:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520820480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760693.075214:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18186240, mtime: 0x6aad94b6, atime: 0x0, ctime: 0x6aad94b6, blocks: 0x9007
00010000:00010000:1.0:1789760693.075223:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.075237:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:1.0:1789760693.075241:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760693.075247:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.075260:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760693.137377:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18186240 -> 18190336
00010000:00010000:1.0:1789760693.137401:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.137413:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.137424:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.137432:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760693.137437:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.137447:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.137467:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.137474:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18186240->18190335] (req 18186240->18190335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760693.137558:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520820480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62388us (63055us total) trans 4294971760 rc 0/0
00000100:00100000:1.0:1789760693.137581:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4473
00000100:00100000:1.0:1789760693.137591:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664708448620 time 664761837822 state 0x2 ref 0
00000001:00080000:1.0:1789760693.137640:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971760 is committed
00000100:00100000:2.0:1789760693.148840:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760693.152549:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520820608
00000100:00100000:1.0:1789760693.152808:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520820608
00000100:00100000:1.0:1789760693.153082:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664708448620 time 664761837822 state 0x0 ref 1
00000100:00100000:1.0:1789760693.153113:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664762098238 time 664761837822 state 0x1 ref 1
00000100:00100000:1.0:1789760693.153206:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664762098238 time 664839888278 state 0x0 ref 1
00000100:00100000:1.0:1789760693.153222:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520820608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760693.153272:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18190336, mtime: 0x6aad94b6, atime: 0x0, ctime: 0x6aad94b6, blocks: 0x9007
00010000:00010000:1.0:1789760693.153281:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.153303:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=664s v=(0 0)
00010000:00010000:1.0:1789760693.153307:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760693.153335:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18190336->18194431] (req 18190336->18194431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.153350:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ac50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18190336->18194431] (req 18190336->18194431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760693.284416:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760693.348254:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760693.348487:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520820992
00000100:00100000:2.0:1789760693.348497:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520820992
00000100:00100000:2.0:1789760693.348547:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664931393748 time 664971420111 state 0x0 ref 1
00000100:00100000:2.0:1789760693.348683:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664971680527 time 664971420111 state 0x1 ref 1
00000100:00100000:2.0:1789760693.348744:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664971680527 time 665035426288 state 0x0 ref 1
00000100:00100000:2.0:1789760693.348757:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520820992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760693.348804:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18202624, mtime: 0x6aad94b6, atime: 0x0, ctime: 0x6aad94b6, blocks: 0x9007
00010000:00010000:2.0:1789760693.348812:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ac65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760693.348827:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:2.0:1789760693.348832:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760693.348838:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ac65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18202624->18206719] (req 18202624->18206719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760693.348852:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60ac65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18202624->18206719] (req 18202624->18206719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760693.394149:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520821120
00000100:00100000:1.0:1789760693.394159:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520821120
00000100:00100000:1.0:1789760693.394211:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 664971680527 time 665035426288 state 0x0 ref 1
00000100:00100000:1.0:1789760693.394227:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665035686704 time 665035426288 state 0x1 ref 1
00000100:00100000:1.0:1789760693.394256:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665035686704 time 665080938662 state 0x0 ref 1
00000100:00100000:1.0:1789760693.394272:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520821120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760693.394348:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18206720, mtime: 0x6aad94b6, atime: 0x0, ctime: 0x6aad94b6, blocks: 0x9007
00010000:00010000:1.0:1789760693.394357:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ac6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.394374:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:1.0:1789760693.394378:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760693.394384:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ac6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18206720->18210815] (req 18206720->18210815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.394397:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ac6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18206720->18210815] (req 18206720->18210815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760693.456415:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971765 is committed
00000100:00100000:1.0:1789760693.466083:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760693.532650:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971766 is committed
00000100:00100000:1.0:1789760693.539659:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760693.606503:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18214912 -> 18219008
00010000:00010000:1.0:1789760693.606522:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18214912->18219007] (req 18214912->18219007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.606535:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18214912->18219007] (req 18214912->18219007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.606543:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18214912->18219007] (req 18214912->18219007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.606556:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760693.610488:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18214912->18219007] (req 18214912->18219007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.610505:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18214912->18219007] (req 18214912->18219007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.610528:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18214912->18219007] (req 18214912->18219007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.610537:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18214912->18219007] (req 18214912->18219007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760693.610960:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520821376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 71116us (71305us total) trans 4294971767 rc 0/0
00000100:00100000:1.0:1789760693.610972:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4480
00000100:00100000:1.0:1789760693.610981:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665153298693 time 665226509613 state 0x2 ref 0
00000001:00080000:2.0:1789760693.695578:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971768 is committed
00002000:00010000:1.0:1789760693.696093:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18219008 -> 18223104
00010000:00010000:1.0:1789760693.696120:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ac81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18219008->18223103] (req 18219008->18223103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.696134:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ac81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18219008->18223103] (req 18219008->18223103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.696148:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ac81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18219008->18223103] (req 18219008->18223103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.696157:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760693.696162:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ac81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18219008->18223103] (req 18219008->18223103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.696170:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ac81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18219008->18223103] (req 18219008->18223103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.696266:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ac81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18219008->18223103] (req 18219008->18223103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.696275:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ac81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18219008->18223103] (req 18219008->18223103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760693.696484:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520821504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 71806us (72081us total) trans 4294971768 rc 0/0
00000100:00100000:1.0:1789760693.696495:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4481
00000100:00100000:1.0:1789760693.696504:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665226770029 time 665311344523 state 0x2 ref 0
00000100:00100000:2.0:1789760693.704853:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760693.705291:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520821632
00000100:00100000:1.0:1789760693.705302:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520821632
00000100:00100000:1.0:1789760693.705443:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665226770029 time 665311344523 state 0x0 ref 1
00000100:00100000:1.0:1789760693.705458:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665311604939 time 665311344523 state 0x1 ref 1
00000100:00100000:1.0:1789760693.705532:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665311604939 time 665392213372 state 0x0 ref 1
00000100:00100000:1.0:1789760693.705545:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520821632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760693.705605:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18223104, mtime: 0x6aad94b6, atime: 0x0, ctime: 0x6aad94b6, blocks: 0x9007
00010000:00010000:1.0:1789760693.705615:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.705638:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:1.0:1789760693.705643:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760693.705650:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.705664:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760693.746219:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18223104 -> 18227200
00010000:00010000:1.0:1789760693.746236:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.746249:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.746258:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.746266:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760693.746271:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.746281:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.746301:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.746309:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ac88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18223104->18227199] (req 18223104->18227199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760693.746418:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520821632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40870us (41571us total) trans 4294971769 rc 0/0
00000100:00100000:1.0:1789760693.746429:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4482
00000100:00100000:1.0:1789760693.746439:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665311604939 time 665392213372 state 0x2 ref 0
00000100:00100000:2.0:1789760693.755155:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760693.819732:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971771 is committed
00002000:00010000:2.0:1789760693.819858:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18231296 -> 18235392
00010000:00010000:2.0:1789760693.819872:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18231296->18235391] (req 18231296->18235391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760693.819886:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18231296->18235391] (req 18231296->18235391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760693.819896:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18231296->18235391] (req 18231296->18235391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760693.819904:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760693.819909:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18231296->18235391] (req 18231296->18235391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760693.819917:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18231296->18235391] (req 18231296->18235391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760693.819935:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18231296->18235391] (req 18231296->18235391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760693.819943:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ac96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18231296->18235391] (req 18231296->18235391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760693.820031:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520821888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25511us (25675us total) trans 4294971771 rc 0/0
00000100:00100000:2.0:1789760693.820042:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4484
00000100:00100000:2.0:1789760693.820051:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665442311278 time 665481187896 state 0x2 ref 0
00000100:00100000:1.0:1789760693.824784:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520822016
00000100:00100000:1.0:1789760693.824794:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520822016
00000100:00100000:1.0:1789760693.824845:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665442311278 time 665481187896 state 0x0 ref 1
00000100:00100000:1.0:1789760693.824859:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665481448312 time 665481187896 state 0x1 ref 1
00000100:00100000:1.0:1789760693.824890:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665481448312 time 665511572281 state 0x0 ref 1
00000100:00100000:1.0:1789760693.824902:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520822016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760693.824945:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18235392, mtime: 0x6aad94b6, atime: 0x0, ctime: 0x6aad94b6, blocks: 0x9007
00010000:00010000:1.0:1789760693.824953:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.824969:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:1.0:1789760693.824973:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760693.824979:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.824998:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760693.869348:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18235392 -> 18239488
00010000:00010000:1.0:1789760693.869363:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.869374:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.869383:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.869390:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760693.869395:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.869404:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.869426:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.869434:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ac9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18235392->18239487] (req 18235392->18239487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760693.869533:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520822016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44628us (44832us total) trans 4294971772 rc 0/0
00000100:00100000:1.0:1789760693.869544:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4485
00000100:00100000:1.0:1789760693.869553:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665481448312 time 665511572281 state 0x2 ref 0
00000100:00100000:1.0:1789760693.875107:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760693.905273:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971773 is committed
00002000:00010000:1.0:1789760693.905383:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18239488 -> 18243584
00002000:00010000:1.0:1789760693.905388:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760694 -> 1789760695
00002000:00010000:1.0:1789760693.905391:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760694 -> 1789760695
00010000:00010000:1.0:1789760693.905403:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18239488->18243583] (req 18239488->18243583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.905416:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18239488->18243583] (req 18239488->18243583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.905425:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18239488->18243583] (req 18239488->18243583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.905433:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760693.905438:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18239488->18243583] (req 18239488->18243583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.905447:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aca4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18239488->18243583] (req 18239488->18243583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.905466:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aca4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18239488->18243583] (req 18239488->18243583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.905473:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60aca4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18239488->18243583] (req 18239488->18243583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760693.905566:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520822144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29944us (30515us total) trans 4294971773 rc 0/0
00000100:00100000:1.0:1789760693.905576:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4486
00000100:00100000:1.0:1789760693.905585:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665511832697 time 665562289400 state 0x2 ref 0
00000100:00100000:2.0:1789760693.910159:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760693.968220:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18243584 -> 18247680
00010000:00010000:1.0:1789760693.968235:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60acab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18243584->18247679] (req 18243584->18247679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.968247:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60acab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18243584->18247679] (req 18243584->18247679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.968257:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60acab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18243584->18247679] (req 18243584->18247679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.968271:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760693.968275:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60acab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18243584->18247679] (req 18243584->18247679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.968283:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60acab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18243584->18247679] (req 18243584->18247679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.968302:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60acab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18243584->18247679] (req 18243584->18247679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.968310:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60acab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18243584->18247679] (req 18243584->18247679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760693.968433:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520822272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57854us (58278us total) trans 4294971774 rc 0/0
00000100:00100000:1.0:1789760693.968443:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4487
00000100:00100000:1.0:1789760693.968452:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665562549816 time 665597242794 state 0x2 ref 0
00000100:00100000:2.0:1789760693.973928:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760693.977760:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520822400
00000100:00100000:1.0:1789760693.977773:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520822400
00000100:00100000:1.0:1789760693.977830:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665562549816 time 665597242794 state 0x0 ref 1
00000100:00100000:1.0:1789760693.977846:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665597503210 time 665597242794 state 0x1 ref 1
00000100:00100000:1.0:1789760693.977881:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665597503210 time 665664564595 state 0x0 ref 1
00000100:00100000:1.0:1789760693.977897:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520822400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760693.977944:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18247680, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760693.977952:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.977967:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:1.0:1789760693.977977:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760693.977983:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760693.977997:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760694.011309:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971775 is committed
00002000:00010000:1.0:1789760694.011462:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18247680 -> 18251776
00010000:00010000:1.0:1789760694.011476:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.011489:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.011499:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.011505:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760694.011510:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.011519:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.011536:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.011543:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18247680->18251775] (req 18247680->18251775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760694.011742:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520822400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33844us (37816us total) trans 4294971775 rc 0/0
00000100:00100000:1.0:1789760694.011753:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4488
00000100:00100000:1.0:1789760694.011762:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665597503210 time 665664564595 state 0x2 ref 0
00000100:00100000:2.0:1789760694.017868:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760694.018404:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520822528
00000100:00100000:1.0:1789760694.018416:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520822528
00000100:00100000:1.0:1789760694.018488:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665597503210 time 665664564595 state 0x0 ref 1
00000100:00100000:1.0:1789760694.018505:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665664825011 time 665664564595 state 0x1 ref 1
00000100:00100000:1.0:1789760694.018540:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665664825011 time 665705222839 state 0x0 ref 1
00000100:00100000:1.0:1789760694.018553:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520822528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.018602:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18251776, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.018611:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.018629:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:1.0:1789760694.018634:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.018640:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.018654:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760694.039655:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18251776 -> 18255872
00010000:00010000:1.0:1789760694.039672:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.039684:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.039693:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.039700:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760694.039705:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.039715:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.039739:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.039758:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18251776->18255871] (req 18251776->18255871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760694.040213:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520822528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 21296us (21988us total) trans 4294971776 rc 0/0
00000100:00100000:1.0:1789760694.040225:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4489
00000100:00100000:1.0:1789760694.040235:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665664825011 time 665705222839 state 0x2 ref 0
00000100:00100000:2.0:1789760694.042620:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760694.070982:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18255872 -> 18259968
00010000:00010000:1.0:1789760694.070999:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60acc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18255872->18259967] (req 18255872->18259967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.071012:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60acc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18255872->18259967] (req 18255872->18259967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.071021:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60acc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18255872->18259967] (req 18255872->18259967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.071028:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760694.071033:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60acc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18255872->18259967] (req 18255872->18259967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.071042:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60acc0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18255872->18259967] (req 18255872->18259967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.071066:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60acc0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18255872->18259967] (req 18255872->18259967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.071073:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60acc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18255872->18259967] (req 18255872->18259967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760694.071203:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520822656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28141us (28583us total) trans 4294971777 rc 0/0
00000100:00100000:1.0:1789760694.071213:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4490
00000100:00100000:1.0:1789760694.071223:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665705483255 time 665729727717 state 0x2 ref 0
00000100:00100000:2.0:1789760694.074607:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760694.074814:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520822784
00000100:00100000:1.0:1789760694.074824:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520822784
00000100:00100000:1.0:1789760694.074875:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665705483255 time 665729727717 state 0x0 ref 1
00000100:00100000:1.0:1789760694.074890:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665729988133 time 665729727717 state 0x1 ref 1
00000100:00100000:1.0:1789760694.074961:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665729988133 time 665761641916 state 0x0 ref 1
00000100:00100000:1.0:1789760694.074974:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520822784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.075025:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18259968, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.075033:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.075048:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:1.0:1789760694.075053:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.075059:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18259968->18264063] (req 18259968->18264063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.075072:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60acc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18259968->18264063] (req 18259968->18264063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760694.112083:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971778 is committed
00000100:00100000:2.0:1789760694.122958:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760694.123058:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520822912
00000100:00100000:1.0:1789760694.123067:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520822912
00000100:00100000:1.0:1789760694.123131:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665729988133 time 665761641916 state 0x0 ref 1
00000100:00100000:1.0:1789760694.123146:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665761902332 time 665761641916 state 0x1 ref 1
00000100:00100000:1.0:1789760694.123178:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665761902332 time 665809860198 state 0x0 ref 1
00000100:00100000:1.0:1789760694.123191:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520822912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.123238:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18264064, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.123247:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.123262:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:1.0:1789760694.123266:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.123272:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.123287:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760694.154895:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971779 is committed
00002000:00010000:2.0:1789760694.154956:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18264064 -> 18268160
00010000:00010000:2.0:1789760694.154971:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.154984:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.154993:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.155001:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760694.155006:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.155015:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.155035:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.155043:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18264064->18268159] (req 18264064->18268159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760694.155131:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520822912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31937us (32179us total) trans 4294971779 rc 0/0
00000100:00100000:2.0:1789760694.155140:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4492
00000100:00100000:2.0:1789760694.155150:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665761902332 time 665809860198 state 0x2 ref 0
00000100:00100000:2.0:1789760694.158720:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760694.187701:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971780 is committed
00000100:00100000:2.0:1789760694.190991:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760694.217705:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18272256 -> 18276352
00010000:00010000:1.0:1789760694.217786:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60acdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18272256->18276351] (req 18272256->18276351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.217801:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60acdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18272256->18276351] (req 18272256->18276351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.217811:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60acdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18272256->18276351] (req 18272256->18276351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.217819:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760694.217824:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60acdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18272256->18276351] (req 18272256->18276351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.217834:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60acdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18272256->18276351] (req 18272256->18276351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.217855:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60acdc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18272256->18276351] (req 18272256->18276351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.217863:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60acdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18272256->18276351] (req 18272256->18276351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760694.217980:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971781 is committed
00000100:00100000:1.0:1789760694.218005:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520823168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26795us (27015us total) trans 4294971781 rc 0/0
00000100:00100000:1.0:1789760694.218021:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4494
00000100:00100000:1.0:1789760694.218030:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665845962382 time 665877876609 state 0x2 ref 0
00000100:00100000:2.0:1789760694.221221:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760694.246724:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18276352 -> 18280448
00010000:00010000:1.0:1789760694.246743:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ace3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18276352->18280447] (req 18276352->18280447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.246757:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ace3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18276352->18280447] (req 18276352->18280447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.246767:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ace3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18276352->18280447] (req 18276352->18280447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.246774:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760694.246779:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ace3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18276352->18280447] (req 18276352->18280447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.246787:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ace3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18276352->18280447] (req 18276352->18280447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.246806:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ace3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18276352->18280447] (req 18276352->18280447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.246814:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ace3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18276352->18280447] (req 18276352->18280447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760694.246910:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520823296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25424us (25693us total) trans 4294971782 rc 0/0
00000100:00100000:1.0:1789760694.246921:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4495
00000100:00100000:1.0:1789760694.246930:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665878137025 time 665908153671 state 0x2 ref 0
00000001:00080000:2.0:1789760694.247000:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971782 is committed
00000100:00100000:2.0:1789760694.250391:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520823424
00000100:00100000:2.0:1789760694.250402:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520823424
00000100:00100000:2.0:1789760694.250454:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665878137025 time 665908153671 state 0x0 ref 1
00000100:00100000:2.0:1789760694.250468:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665908414087 time 665908153671 state 0x1 ref 1
00000100:00100000:2.0:1789760694.250549:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665908414087 time 665937231306 state 0x0 ref 1
00000100:00100000:2.0:1789760694.250563:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520823424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760694.250607:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18280448, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:2.0:1789760694.250618:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.250633:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:2.0:1789760694.250637:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760694.250643:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.250656:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760694.276479:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18280448 -> 18284544
00010000:00010000:2.0:1789760694.276501:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.276517:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.276526:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.276534:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760694.276539:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.276548:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.276566:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.276575:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60acea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18280448->18284543] (req 18280448->18284543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760694.276672:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520823424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26108us (26388us total) trans 4294971783 rc 0/0
00000100:00100000:2.0:1789760694.276682:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4496
00000100:00100000:2.0:1789760694.276692:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665908414087 time 665937231306 state 0x2 ref 0
00000001:00080000:1.0:1789760694.277639:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971783 is committed
00000100:00100000:1.0:1789760694.280828:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520823552
00000100:00100000:1.0:1789760694.280837:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520823552
00000100:00100000:1.0:1789760694.280886:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665908414087 time 665937231306 state 0x0 ref 1
00000100:00100000:1.0:1789760694.280901:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665937491722 time 665937231306 state 0x1 ref 1
00000100:00100000:1.0:1789760694.280930:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665937491722 time 665967613788 state 0x0 ref 1
00000100:00100000:1.0:1789760694.280942:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520823552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.280989:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18284544, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.280998:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.281014:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=665s v=(0 0)
00010000:00010000:1.0:1789760694.281019:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.281025:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18284544->18288639] (req 18284544->18288639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.281039:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18284544->18288639] (req 18284544->18288639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760694.308592:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971784 is committed
00000100:00100000:1.0:1789760694.314428:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520823680
00000100:00100000:1.0:1789760694.314444:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520823680
00000100:00100000:1.0:1789760694.314506:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665937491722 time 665967613788 state 0x0 ref 1
00000100:00100000:1.0:1789760694.314523:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665967874204 time 665967613788 state 0x1 ref 1
00000100:00100000:1.0:1789760694.314561:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665967874204 time 666001243252 state 0x0 ref 1
00000100:00100000:1.0:1789760694.314573:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520823680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.314627:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18288640, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.314636:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.314654:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:1.0:1789760694.314659:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.314666:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.314694:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760694.352166:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971785 is committed
00002000:00010000:2.0:1789760694.352301:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18288640 -> 18292736
00010000:00010000:2.0:1789760694.352394:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.352409:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.352418:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.352427:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760694.352432:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.352442:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.352466:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.352474:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60acf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18288640->18292735] (req 18288640->18292735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760694.352557:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520823680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37981us (40503us total) trans 4294971785 rc 0/0
00000100:00100000:2.0:1789760694.352567:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4498
00000100:00100000:2.0:1789760694.352576:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665967874204 time 666001243252 state 0x2 ref 0
00000100:00100000:2.0:1789760694.356827:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760694.356994:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520823808
00000100:00100000:1.0:1789760694.357004:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520823808
00000100:00100000:1.0:1789760694.357054:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 665967874204 time 666001243252 state 0x0 ref 1
00000100:00100000:1.0:1789760694.357068:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666001503668 time 666001243252 state 0x1 ref 1
00000100:00100000:1.0:1789760694.357106:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666001503668 time 666043788761 state 0x0 ref 1
00000100:00100000:1.0:1789760694.357119:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520823808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.357175:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18292736, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.357185:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.357201:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:1.0:1789760694.357206:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.357212:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.357226:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760694.399802:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18292736 -> 18296832
00010000:00010000:1.0:1789760694.399818:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.399831:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.399841:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.399849:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760694.399854:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.399863:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.399883:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.399890:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60acff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18292736->18296831] (req 18292736->18296831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760694.399985:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520823808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42863us (43161us total) trans 4294971786 rc 0/0
00000100:00100000:1.0:1789760694.399995:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4499
00000100:00100000:1.0:1789760694.400005:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666001503668 time 666043788761 state 0x2 ref 0
00000100:00100000:2.0:1789760694.405025:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520823936
00000100:00100000:2.0:1789760694.405034:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520823936
00000100:00100000:2.0:1789760694.405084:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666001503668 time 666043788761 state 0x0 ref 1
00000100:00100000:2.0:1789760694.405139:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666044049177 time 666043788761 state 0x1 ref 1
00000100:00100000:2.0:1789760694.406145:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666044049177 time 666092822950 state 0x0 ref 1
00000100:00100000:2.0:1789760694.406172:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520823936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760694.406220:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18296832, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:2.0:1789760694.406230:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.406250:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:2.0:1789760694.406255:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760694.406261:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.406274:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760694.487868:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18296832 -> 18300928
00010000:00010000:2.0:1789760694.487884:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.487896:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.487905:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.487913:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760694.487917:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.487926:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.487945:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.487953:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18296832->18300927] (req 18296832->18300927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760694.489859:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520823936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 83679us (85000us total) trans 4294971787 rc 0/0
00000100:00100000:2.0:1789760694.489873:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4500
00000100:00100000:2.0:1789760694.489883:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666044049177 time 666092822950 state 0x2 ref 0
00000100:00100000:1.0:1789760694.500461:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520824064
00000100:00100000:1.0:1789760694.500476:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520824064
00000100:00100000:1.0:1789760694.500548:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666044049177 time 666092822950 state 0x0 ref 1
00000100:00100000:1.0:1789760694.500564:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666093083366 time 666092822950 state 0x1 ref 1
00000100:00100000:1.0:1789760694.500739:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666093083366 time 666187420177 state 0x0 ref 1
00000100:00100000:1.0:1789760694.500757:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520824064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.500806:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18300928, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.500816:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.500831:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:1.0:1789760694.500835:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.500842:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.500856:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760694.601448:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18300928 -> 18305024
00010000:00010000:2.0:1789760694.601528:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.601544:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.601554:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.601562:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760694.601567:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.601576:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.601603:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.601612:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60ad0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18300928->18305023] (req 18300928->18305023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760694.602179:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520824064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 101419us (105136us total) trans 4294971788 rc 0/0
00000100:00100000:2.0:1789760694.602191:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4501
00000100:00100000:2.0:1789760694.602200:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666093083366 time 666187420177 state 0x2 ref 0
00000100:00100000:1.0:1789760694.607483:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520824192
00000100:00100000:1.0:1789760694.607492:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520824192
00000100:00100000:1.0:1789760694.607546:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666093083366 time 666187420177 state 0x0 ref 1
00000100:00100000:1.0:1789760694.607562:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666187680593 time 666187420177 state 0x1 ref 1
00000100:00100000:1.0:1789760694.607593:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666187680593 time 666294275362 state 0x0 ref 1
00000100:00100000:1.0:1789760694.607606:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520824192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.607654:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18305024, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.607664:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ad14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.607687:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:1.0:1789760694.607691:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.607698:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ad14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18305024->18309119] (req 18305024->18309119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.607711:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ad14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18305024->18309119] (req 18305024->18309119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760694.687674:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760694.790570:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971790 is committed
00000100:00100000:2.0:1789760694.796664:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760694.862779:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971791 is committed
00000100:00100000:2.0:1789760694.877501:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760694.878143:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520824576
00000100:00100000:1.0:1789760694.878153:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520824576
00000100:00100000:1.0:1789760694.878204:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666375135055 time 666484078551 state 0x0 ref 1
00000100:00100000:1.0:1789760694.878219:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666484338967 time 666484078551 state 0x1 ref 1
00000100:00100000:1.0:1789760694.878250:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666484338967 time 666564933090 state 0x0 ref 1
00000100:00100000:1.0:1789760694.878269:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520824576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760694.878344:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18317312, mtime: 0x6aad94b7, atime: 0x0, ctime: 0x6aad94b7, blocks: 0x9007
00010000:00010000:1.0:1789760694.878354:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ad29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.878370:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:1.0:1789760694.878388:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760694.878395:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ad29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18317312->18321407] (req 18317312->18321407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760694.878410:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60ad29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18317312->18321407] (req 18317312->18321407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760694.906880:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548731648:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1789760694.907000:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760694.907566:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548731648
00000100:00100000:2.0:1789760694.907575:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548731648
00000100:00100000:2.0:1789760694.907615:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390
00000100:00100000:2.0:1789760694.907633:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548731648:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1789760694.907678:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:2.0:1789760694.907725:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548731648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (725us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760694.907733:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390
00000100:00100000:2.0:1789760694.907775:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548731648:0@lo:41:osp-pre-1-0.0
00000001:00080000:2.0:1789760694.940986:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971792 is committed
00000100:00100000:1.0:1789760694.950677:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520824704
00000100:00100000:1.0:1789760694.950688:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520824704
00000100:00100000:2.0:1789760694.950836:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666484338967 time 666564933090 state 0x0 ref 1
00000100:00100000:2.0:1789760694.950851:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666565193506 time 666564933090 state 0x1 ref 1
00000100:00100000:2.0:1789760694.951112:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666565193506 time 666637793253 state 0x0 ref 1
00000100:00100000:2.0:1789760694.951127:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520824704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760694.951186:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18321408, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760694.951196:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60ad30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.951213:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:2.0:1789760694.951217:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760694.951227:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60ad30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18321408->18325503] (req 18321408->18325503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.951241:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60ad30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18321408->18325503] (req 18321408->18325503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760694.978911:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971793 is committed
00000100:00100000:2.0:1789760694.983929:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520824832
00000100:00100000:2.0:1789760694.983939:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520824832
00000100:00100000:2.0:1789760694.983993:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666565193506 time 666637793253 state 0x0 ref 1
00000100:00100000:2.0:1789760694.984008:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666638053669 time 666637793253 state 0x1 ref 1
00000100:00100000:2.0:1789760694.984035:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666638053669 time 666670718404 state 0x0 ref 1
00000100:00100000:2.0:1789760694.984047:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520824832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760694.984102:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18325504, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760694.984111:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.984126:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:2.0:1789760694.984131:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760694.984137:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760694.984151:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760695.010296:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18325504 -> 18329600
00010000:00010000:2.0:1789760695.010340:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.010354:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.010365:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.010372:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760695.010377:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.010388:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.010407:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.010416:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ad37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18325504->18329599] (req 18325504->18329599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760695.010677:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520824832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26625us (26885us total) trans 4294971794 rc 0/0
00000100:00100000:2.0:1789760695.010689:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4507
00000100:00100000:2.0:1789760695.010698:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666638053669 time 666670718404 state 0x2 ref 0
00000100:00100000:2.0:1789760695.017304:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760695.053105:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971795 is committed
00000001:00080000:1.0:1789760695.085256:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971796 is committed
00000100:00100000:2.0:1789760695.088720:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.127804:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.131048:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.131093:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.131122:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.131141:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.131162:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.131187:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520825728
00000100:00100000:2.0:1789760695.131195:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520825728
00000100:00100000:2.0:1789760695.131241:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520825984
00000100:00100000:2.0:1789760695.131244:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520825984
00000100:00100000:2.0:1789760695.131259:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520825600
00000100:00100000:2.0:1789760695.131262:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520825600
00000100:00100000:2.0:1789760695.131274:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520825856
00000100:00100000:2.0:1789760695.131276:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520825856
00000100:00100000:2.0:1789760695.131290:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 783
00000100:00100000:2.0:1789760695.131298:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520825728:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760695.131380:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520825728:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 82us (294us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760695.131388:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 783
00000100:00100000:2.0:1789760695.131406:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 784
00000100:00100000:2.0:1789760695.131412:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520825984:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760695.131434:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520825984:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (312us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760695.131440:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 784
00000100:00100000:2.0:1789760695.131466:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 785
00000100:00100000:2.0:1789760695.131473:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2405:x1876699520825600:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760695.131496:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2405:x1876699520825600:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760695.131502:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 785
00000100:00100000:2.0:1789760695.131513:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 786
00000100:00100000:2.0:1789760695.131520:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520825856:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760695.131539:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520825856:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 20us (376us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760695.131544:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 786
00000100:00080000:2.0:1789760695.131566:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:2.0:1789760695.131570:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00002000:00010000:2.0:1789760695.160851:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18341888 -> 18345984
00010000:00010000:2.0:1789760695.160869:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ad53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18341888->18345983] (req 18341888->18345983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.160882:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ad53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18341888->18345983] (req 18341888->18345983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.160892:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ad53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18341888->18345983] (req 18341888->18345983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.160899:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760695.160904:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ad53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18341888->18345983] (req 18341888->18345983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.160913:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ad53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18341888->18345983] (req 18341888->18345983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.160932:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ad53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18341888->18345983] (req 18341888->18345983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.160941:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ad53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18341888->18345983] (req 18341888->18345983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760695.161066:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520825344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33006us (33264us total) trans 4294971798 rc 0/0
00000100:00100000:2.0:1789760695.161079:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4511
00000100:00100000:2.0:1789760695.161100:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666775847506 time 666814725416 state 0x2 ref 0
00000100:00100000:2.0:1789760695.165125:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760695.191763:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971799 is committed
00000100:00100000:2.0:1789760695.200288:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520826240
00000100:00100000:2.0:1789760695.200302:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520826240
00000100:00100000:2.0:1789760695.200394:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666814985832 time 666852278787 state 0x0 ref 1
00000100:00100000:2.0:1789760695.200409:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666852539203 time 666852278787 state 0x1 ref 1
00000100:00100000:2.0:1789760695.200437:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666852539203 time 666887119892 state 0x0 ref 1
00000100:00100000:2.0:1789760695.200450:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520826240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.200497:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18350080, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760695.200507:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60ad61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.200524:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:2.0:1789760695.200528:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.200534:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60ad61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18350080->18354175] (req 18350080->18354175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.200548:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60ad61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18350080->18354175] (req 18350080->18354175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760695.235207:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.272076:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760695.304918:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520826624
00000100:00100000:1.0:1789760695.304927:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520826624
00000100:00100000:1.0:1789760695.304987:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666922357132 time 666959023244 state 0x0 ref 1
00000100:00100000:1.0:1789760695.305003:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666959283660 time 666959023244 state 0x1 ref 1
00000100:00100000:1.0:1789760695.305029:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666959283660 time 666991712318 state 0x0 ref 1
00000100:00100000:1.0:1789760695.305041:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520826624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760695.305093:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18362368, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:1.0:1789760695.305102:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.305117:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=666s v=(0 0)
00010000:00010000:1.0:1789760695.305122:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760695.305129:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.305143:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760695.340711:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18362368 -> 18366464
00010000:00010000:1.0:1789760695.340787:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.340800:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.340810:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.340817:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760695.340822:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.340831:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.340851:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.340860:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ad76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18362368->18366463] (req 18362368->18366463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760695.340981:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520826624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35936us (36135us total) trans 4294971803 rc 0/0
00000100:00100000:1.0:1789760695.340995:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4516
00000100:00100000:1.0:1789760695.341005:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666959283660 time 666991712318 state 0x2 ref 0
00000100:00100000:1.0:1789760695.344476:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.344571:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520826752
00000100:00100000:2.0:1789760695.344580:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520826752
00000100:00100000:2.0:1789760695.344681:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666959283660 time 666991712318 state 0x0 ref 1
00000100:00100000:2.0:1789760695.344696:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666991972734 time 666991712318 state 0x1 ref 1
00000100:00100000:2.0:1789760695.344806:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666991972734 time 667031487646 state 0x0 ref 1
00000100:00100000:2.0:1789760695.344819:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520826752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.344864:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18366464, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760695.344873:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ad7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.344888:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:2.0:1789760695.344893:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.344899:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ad7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18366464->18370559] (req 18366464->18370559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.344912:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60ad7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18366464->18370559] (req 18366464->18370559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760695.376431:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520826880
00000100:00100000:2.0:1789760695.376439:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520826880
00000100:00100000:2.0:1789760695.376486:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 666991972734 time 667031487646 state 0x0 ref 1
00000100:00100000:2.0:1789760695.376501:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667031748062 time 667031487646 state 0x1 ref 1
00000100:00100000:2.0:1789760695.376569:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667031748062 time 667063250973 state 0x0 ref 1
00000100:00100000:2.0:1789760695.376582:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520826880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.376632:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18370560, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760695.376642:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.376657:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:2.0:1789760695.376662:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.376668:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.376680:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760695.415767:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18370560 -> 18374656
00010000:00010000:2.0:1789760695.415786:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.415800:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.415809:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.415817:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760695.415822:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.415832:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.415850:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.415858:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ad84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18370560->18374655] (req 18370560->18374655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760695.415947:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520826880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39362us (39598us total) trans 4294971805 rc 0/0
00000100:00100000:2.0:1789760695.415957:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4518
00000100:00100000:2.0:1789760695.415966:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667031748062 time 667063250973 state 0x2 ref 0
00000100:00100000:2.0:1789760695.418272:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789760695.418282:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548731904:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1789760695.418339:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1789760695.418381:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1789760695.418555:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789760695.418577:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548731904:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1789760695.419819:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760695.444308:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971806 is committed
00000100:00100000:1.0:1789760695.448970:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520827136
00000100:00100000:1.0:1789760695.448981:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520827136
00000100:00100000:1.0:1789760695.449038:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667063511389 time 667106652507 state 0x0 ref 1
00000100:00100000:1.0:1789760695.449052:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667106912923 time 667106652507 state 0x1 ref 1
00000100:00100000:1.0:1789760695.449094:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667106912923 time 667135766940 state 0x0 ref 1
00000100:00100000:1.0:1789760695.449108:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520827136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760695.449153:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18378752, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:1.0:1789760695.449162:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.449176:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:1.0:1789760695.449181:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760695.449187:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.449201:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760695.481726:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18378752 -> 18382848
00010000:00010000:1.0:1789760695.481745:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.481759:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.481769:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.481777:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760695.481782:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.481792:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.481811:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.481820:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ad92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18378752->18382847] (req 18378752->18382847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760695.482246:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520827136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33135us (34035us total) trans 4294971807 rc 0/0
00000100:00100000:1.0:1789760695.482262:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4520
00000100:00100000:1.0:1789760695.482272:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667106912923 time 667135766940 state 0x2 ref 0
00000100:00100000:1.0:1789760695.494179:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.494266:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520827264
00000100:00100000:2.0:1789760695.494275:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520827264
00000100:00100000:2.0:1789760695.494509:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667106912923 time 667135766940 state 0x0 ref 1
00000100:00100000:2.0:1789760695.494524:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667136027356 time 667135766940 state 0x1 ref 1
00000100:00100000:2.0:1789760695.494585:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667136027356 time 667181267664 state 0x0 ref 1
00000100:00100000:2.0:1789760695.494598:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520827264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.494642:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18382848, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760695.494651:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.494666:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:2.0:1789760695.494670:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.494677:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.494691:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760695.519797:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18382848 -> 18386944
00010000:00010000:2.0:1789760695.519811:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.519824:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.519834:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.519842:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760695.519847:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.519857:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.519874:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.519882:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ad99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18382848->18386943] (req 18382848->18386943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760695.519968:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520827264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25368us (25793us total) trans 4294971808 rc 0/0
00000100:00100000:2.0:1789760695.519978:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4521
00000100:00100000:2.0:1789760695.519988:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667136027356 time 667181267664 state 0x2 ref 0
00000100:00100000:2.0:1789760695.522990:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760695.546373:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18386944 -> 18391040
00010000:00010000:1.0:1789760695.546390:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ada0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18386944->18391039] (req 18386944->18391039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.546404:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ada0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18386944->18391039] (req 18386944->18391039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.546413:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ada0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18386944->18391039] (req 18386944->18391039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.546421:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760695.546426:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ada0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18386944->18391039] (req 18386944->18391039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.546436:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ada0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18386944->18391039] (req 18386944->18391039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.546455:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ada0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18386944->18391039] (req 18386944->18391039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.546462:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ada0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18386944->18391039] (req 18386944->18391039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760695.546552:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520827392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23180us (23565us total) trans 4294971809 rc 0/0
00000100:00100000:1.0:1789760695.546563:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4522
00000100:00100000:1.0:1789760695.546583:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667181528080 time 667210040624 state 0x2 ref 0
00010000:00010000:0.0:1789760695.551686:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.551706:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760695.592883:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971810 is committed
00002000:00010000:0.0:1789760695.593154:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18391040 -> 18395136
00010000:00010000:0.0:1789760695.593227:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.593241:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.593251:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.593259:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760695.593264:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.593274:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.593292:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.593300:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ada7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18391040->18395135] (req 18391040->18395135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760695.593427:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520827520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41820us (42259us total) trans 4294971810 rc 0/0
00000100:00100000:0.0:1789760695.593439:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4523
00000100:00100000:0.0:1789760695.593449:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667210301040 time 667238273711 state 0x2 ref 0
00000100:00100000:0.0:1789760695.596515:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760695.596641:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520827648
00000100:00100000:1.0:1789760695.596649:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520827648
00000100:00100000:1.0:1789760695.596699:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667210301040 time 667238273711 state 0x0 ref 1
00000100:00100000:1.0:1789760695.596723:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667238534127 time 667238273711 state 0x1 ref 1
00000100:00100000:1.0:1789760695.596750:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667238534127 time 667283432776 state 0x0 ref 1
00000100:00100000:1.0:1789760695.596761:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520827648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760695.596804:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18395136, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:1.0:1789760695.596813:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.596829:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:1.0:1789760695.596833:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760695.596839:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.596853:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760695.657918:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18395136 -> 18399232
00010000:00010000:2.0:1789760695.657934:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.657947:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.657956:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.657964:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760695.657969:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.657978:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.657996:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.658004:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60adae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18395136->18399231] (req 18395136->18399231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760695.658104:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520827648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61338us (61592us total) trans 4294971811 rc 0/0
00000100:00100000:2.0:1789760695.658115:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4524
00000100:00100000:2.0:1789760695.658124:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667238534127 time 667283432776 state 0x2 ref 0
00000100:00100000:2.0:1789760695.661479:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520827776
00000100:00100000:2.0:1789760695.661489:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520827776
00000100:00100000:2.0:1789760695.661541:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667238534127 time 667283432776 state 0x0 ref 1
00000100:00100000:2.0:1789760695.661555:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667283693192 time 667283432776 state 0x1 ref 1
00000100:00100000:2.0:1789760695.661583:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667283693192 time 667348265324 state 0x0 ref 1
00000100:00100000:2.0:1789760695.661600:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520827776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.661643:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18399232, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760695.661651:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.661666:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:2.0:1789760695.661670:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.661676:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.661689:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760695.744611:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971812 is committed
00002000:00010000:1.0:1789760695.744764:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18399232 -> 18403328
00010000:00010000:1.0:1789760695.744780:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.744798:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.744806:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.744813:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760695.744818:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.744827:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.744846:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.744855:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60adb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18399232->18403327] (req 18399232->18403327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760695.744947:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520827776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 83345us (83655us total) trans 4294971812 rc 0/0
00000100:00100000:1.0:1789760695.744962:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4525
00000100:00100000:1.0:1789760695.744972:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667283693192 time 667348265324 state 0x2 ref 0
00000100:00100000:1.0:1789760695.752569:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520827904
00000100:00100000:1.0:1789760695.752585:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520827904
00000100:00100000:1.0:1789760695.752649:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667283693192 time 667348265324 state 0x0 ref 1
00000100:00100000:1.0:1789760695.752664:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667348525740 time 667348265324 state 0x1 ref 1
00000100:00100000:1.0:1789760695.752702:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667348525740 time 667439384316 state 0x0 ref 1
00000100:00100000:1.0:1789760695.752717:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520827904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760695.752765:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18403328, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:1.0:1789760695.752775:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.752794:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:1.0:1789760695.752799:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760695.752806:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.752820:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760695.817779:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971813 is committed
00002000:00010000:1.0:1789760695.817914:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18403328 -> 18407424
00010000:00010000:1.0:1789760695.817929:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.817942:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.817952:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.817960:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760695.817964:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.817973:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.817991:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.817999:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60adbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18403328->18407423] (req 18403328->18407423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760695.818092:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520827904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65365us (68494us total) trans 4294971813 rc 0/0
00000100:00100000:1.0:1789760695.818103:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4526
00000100:00100000:1.0:1789760695.818112:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667348525740 time 667439384316 state 0x2 ref 0
00000100:00100000:0.0:1789760695.823515:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.823615:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520828032
00000100:00100000:2.0:1789760695.823625:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520828032
00000100:00100000:2.0:1789760695.823671:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667348525740 time 667439384316 state 0x0 ref 1
00000100:00100000:2.0:1789760695.823685:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667439644732 time 667439384316 state 0x1 ref 1
00000100:00100000:2.0:1789760695.823744:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667439644732 time 667510426358 state 0x0 ref 1
00000100:00100000:2.0:1789760695.823755:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520828032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.823800:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18407424, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760695.823808:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.823825:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:2.0:1789760695.823830:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.823836:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.823849:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760695.858001:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971814 is committed
00002000:00010000:1.0:1789760695.858108:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18407424 -> 18411520
00010000:00010000:1.0:1789760695.858124:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.858136:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.858146:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.858154:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760695.858158:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.858167:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.858184:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.858192:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60adc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18407424->18411519] (req 18407424->18411519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760695.858277:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520828032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34518us (34765us total) trans 4294971814 rc 0/0
00000100:00100000:1.0:1789760695.858286:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4527
00000100:00100000:1.0:1789760695.858295:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667439644732 time 667510426358 state 0x2 ref 0
00000100:00100000:2.0:1789760695.862016:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520828160
00000100:00100000:2.0:1789760695.862025:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520828160
00000100:00100000:2.0:1789760695.862072:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667439644732 time 667510426358 state 0x0 ref 1
00000100:00100000:2.0:1789760695.862098:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667510686774 time 667510426358 state 0x1 ref 1
00000100:00100000:2.0:1789760695.862126:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667510686774 time 667548808267 state 0x0 ref 1
00000100:00100000:2.0:1789760695.862137:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520828160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.862183:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18411520, mtime: 0x6aad94b8, atime: 0x0, ctime: 0x6aad94b8, blocks: 0x9007
00010000:00010000:2.0:1789760695.862192:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60adca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.862207:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:2.0:1789760695.862211:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.862217:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60adca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18411520->18415615] (req 18411520->18415615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.862236:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60adca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18411520->18415615] (req 18411520->18415615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760695.897975:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971815 is committed
00000100:00100000:2.0:1789760695.904745:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760695.904895:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520828288
00000100:00100000:1.0:1789760695.904903:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520828288
00000100:00100000:1.0:1789760695.904954:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667510686774 time 667548808267 state 0x0 ref 1
00000100:00100000:1.0:1789760695.904969:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667549068683 time 667548808267 state 0x1 ref 1
00000100:00100000:1.0:1789760695.905029:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667549068683 time 667591711642 state 0x0 ref 1
00000100:00100000:1.0:1789760695.905042:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520828288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760695.905103:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18415616, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:1.0:1789760695.905112:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60add1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.905128:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:1.0:1789760695.905132:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760695.905138:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60add1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18415616->18419711] (req 18415616->18419711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760695.905152:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60add1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18415616->18419711] (req 18415616->18419711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760695.945423:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971816 is committed
00000100:00100000:1.0:1789760695.948399:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.948458:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520828416
00000100:00100000:2.0:1789760695.948468:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520828416
00000100:00100000:2.0:1789760695.948517:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667549068683 time 667591711642 state 0x0 ref 1
00000100:00100000:2.0:1789760695.948532:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667591972058 time 667591711642 state 0x1 ref 1
00000100:00100000:2.0:1789760695.948559:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667591972058 time 667635242001 state 0x0 ref 1
00000100:00100000:2.0:1789760695.948571:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520828416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.948949:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18419712, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:2.0:1789760695.948958:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.948973:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:2.0:1789760695.948978:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.948983:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.948996:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760695.981091:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971817 is committed
00002000:00010000:0.0:1789760695.981146:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18419712 -> 18423808
00010000:00010000:0.0:1789760695.981160:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.981173:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.981183:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.981191:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760695.981195:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.981204:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.981223:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760695.981231:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60add8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18419712->18423807] (req 18419712->18423807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760695.981342:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520828416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32740us (32918us total) trans 4294971817 rc 0/0
00000100:00100000:0.0:1789760695.981353:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4530
00000100:00100000:0.0:1789760695.981362:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667591972058 time 667635242001 state 0x2 ref 0
00000100:00100000:0.0:1789760695.986177:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760695.986454:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520828544
00000100:00100000:2.0:1789760695.986463:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520828544
00000100:00100000:2.0:1789760695.986519:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667591972058 time 667635242001 state 0x0 ref 1
00000100:00100000:2.0:1789760695.986533:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667635502417 time 667635242001 state 0x1 ref 1
00000100:00100000:2.0:1789760695.986595:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667635502417 time 667673276703 state 0x0 ref 1
00000100:00100000:2.0:1789760695.986607:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520828544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760695.986660:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18423808, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:2.0:1789760695.986669:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.986684:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:2.0:1789760695.986688:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760695.986693:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760695.986707:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760696.019840:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18423808 -> 18427904
00010000:00010000:0.0:1789760696.019855:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.019869:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.019878:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.019886:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760696.019890:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.019905:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.019923:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.019931:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60addf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18423808->18427903] (req 18423808->18427903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760696.020048:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520828544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33439us (33876us total) trans 4294971818 rc 0/0
00000100:00100000:0.0:1789760696.020058:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4531
00000100:00100000:0.0:1789760696.020068:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667635502417 time 667673276703 state 0x2 ref 0
00000100:00100000:2.0:1789760696.025536:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00080000:2.0:1789760696.026597:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:1.0:1789760696.053665:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18427904 -> 18432000
00010000:00010000:1.0:1789760696.053682:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ade6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18427904->18431999] (req 18427904->18431999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.053701:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ade6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18427904->18431999] (req 18427904->18431999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.053770:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ade6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18427904->18431999] (req 18427904->18431999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.053781:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760696.053785:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ade6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18427904->18431999] (req 18427904->18431999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.053795:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ade6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18427904->18431999] (req 18427904->18431999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.053815:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ade6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18427904->18431999] (req 18427904->18431999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.053823:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ade6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18427904->18431999] (req 18427904->18431999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760696.053912:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc825b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520828672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28000us (28379us total) trans 4294971819 rc 0/0
00000100:00100000:1.0:1789760696.053922:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4532
00000100:00100000:1.0:1789760696.053932:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667673537119 time 667712580230 state 0x2 ref 0
00000100:00100000:1.0:1789760696.057921:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:0.0:1789760696.090167:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971820 is committed
00000100:00100000:0.0:1789760696.094172:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520828928
00000100:00100000:0.0:1789760696.094182:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520828928
00000100:00100000:0.0:1789760696.094232:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667712840646 time 667744830068 state 0x0 ref 1
00000100:00100000:0.0:1789760696.094304:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667745090484 time 667744830068 state 0x1 ref 1
00000100:00100000:0.0:1789760696.094405:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667745090484 time 667781086471 state 0x0 ref 1
00000100:00100000:0.0:1789760696.094418:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520828928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.094461:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18436096, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.094470:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.094484:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:0.0:1789760696.094489:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.094495:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.094508:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760696.125291:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18436096 -> 18440192
00010000:00010000:1.0:1789760696.125307:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.125337:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.125347:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.125354:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760696.125359:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.125368:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.125388:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.125397:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60adf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18436096->18440191] (req 18436096->18440191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760696.125843:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520828928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31421us (31738us total) trans 4294971821 rc 0/0
00000100:00100000:1.0:1789760696.125853:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4534
00000100:00100000:1.0:1789760696.125863:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667745090484 time 667781086471 state 0x2 ref 0
00000100:00100000:2.0:1789760696.131615:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760696.131687:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520829056
00000100:00100000:0.0:1789760696.131698:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520829056
00000100:00100000:0.0:1789760696.131755:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667745090484 time 667781086471 state 0x0 ref 1
00000100:00100000:0.0:1789760696.131770:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667781346887 time 667781086471 state 0x1 ref 1
00000100:00100000:0.0:1789760696.131807:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667781346887 time 667818489787 state 0x0 ref 1
00000100:00100000:0.0:1789760696.131819:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520829056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.131861:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18440192, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.131870:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.131887:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:0.0:1789760696.131891:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.131897:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.131912:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760696.187210:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18440192 -> 18444288
00010000:00010000:0.0:1789760696.187226:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.187238:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.187246:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.187253:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760696.187259:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.187268:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.187286:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.187294:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60adfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18440192->18444287] (req 18440192->18444287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760696.187410:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520829056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55587us (55805us total) trans 4294971822 rc 0/0
00000100:00100000:0.0:1789760696.187421:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4535
00000100:00100000:0.0:1789760696.187488:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667781346887 time 667818489787 state 0x2 ref 0
00000100:00100000:0.0:1789760696.191935:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760696.192091:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520829184
00000100:00100000:1.0:1789760696.192101:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520829184
00000100:00100000:1.0:1789760696.192152:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667781346887 time 667818489787 state 0x0 ref 1
00000100:00100000:1.0:1789760696.192167:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667818750203 time 667818489787 state 0x1 ref 1
00000100:00100000:1.0:1789760696.192199:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667818750203 time 667878881105 state 0x0 ref 1
00000100:00100000:1.0:1789760696.192211:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520829184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760696.192261:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18444288, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:1.0:1789760696.192270:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.192286:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:1.0:1789760696.192290:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760696.192296:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.192308:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760696.294771:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18444288 -> 18448384
00010000:00010000:0.0:1789760696.294785:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.294799:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.294808:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.294816:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760696.294821:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.294831:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.294848:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.294862:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60ae02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18444288->18448383] (req 18444288->18448383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760696.294949:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520829184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 102735us (103017us total) trans 4294971823 rc 0/0
00000100:00100000:0.0:1789760696.294959:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4536
00000100:00100000:0.0:1789760696.294968:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667818750203 time 667878881105 state 0x2 ref 0
00000100:00100000:1.0:1789760696.299797:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520829312
00000100:00100000:1.0:1789760696.299806:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520829312
00000100:00100000:1.0:1789760696.299856:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667818750203 time 667878881105 state 0x0 ref 1
00000100:00100000:1.0:1789760696.299872:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667879141521 time 667878881105 state 0x1 ref 1
00000100:00100000:1.0:1789760696.299901:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667879141521 time 667986584286 state 0x0 ref 1
00000100:00100000:1.0:1789760696.299913:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520829312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760696.299955:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18448384, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:1.0:1789760696.299964:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ae09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.299979:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=667s v=(0 0)
00010000:00010000:1.0:1789760696.299984:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760696.299990:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ae09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18448384->18452479] (req 18448384->18452479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.300004:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ae09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18448384->18452479] (req 18448384->18452479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760696.341370:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971824 is committed
00000100:00100000:2.0:1789760696.344996:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760696.346182:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520829440
00000100:00100000:0.0:1789760696.346196:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520829440
00000100:00100000:0.0:1789760696.346252:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667879141521 time 667986584286 state 0x0 ref 1
00000100:00100000:0.0:1789760696.346268:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667986844702 time 667986584286 state 0x1 ref 1
00000100:00100000:0.0:1789760696.346304:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667986844702 time 668032987236 state 0x0 ref 1
00000100:00100000:0.0:1789760696.346931:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520829440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.346981:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18452480, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.346990:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.347007:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760696.347011:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.347017:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.347037:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760696.382151:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18452480 -> 18456576
00010000:00010000:2.0:1789760696.382169:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.382182:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.382192:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.382365:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760696.382372:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.382383:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.382402:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.382411:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ae10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18452480->18456575] (req 18452480->18456575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760696.382495:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520829440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36174us (37501us total) trans 4294971825 rc 0/0
00000100:00100000:2.0:1789760696.382506:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4538
00000100:00100000:2.0:1789760696.382515:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667986844702 time 668032987236 state 0x2 ref 0
00000001:00080000:0.0:1789760696.384110:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971825 is committed
00000100:00100000:0.0:1789760696.391821:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760696.391904:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520829568
00000100:00100000:1.0:1789760696.391913:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520829568
00000100:00100000:1.0:1789760696.391960:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 667986844702 time 668032987236 state 0x0 ref 1
00000100:00100000:1.0:1789760696.391975:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668033247652 time 668032987236 state 0x1 ref 1
00000100:00100000:1.0:1789760696.392001:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668033247652 time 668078684637 state 0x0 ref 1
00000100:00100000:1.0:1789760696.392019:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520829568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760696.392067:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18456576, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:1.0:1789760696.392088:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.392104:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:1.0:1789760696.392108:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760696.392114:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.392127:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760696.423907:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971826 is committed
00002000:00010000:1.0:1789760696.424010:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18456576 -> 18460672
00010000:00010000:1.0:1789760696.424025:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.424038:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.424048:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.424055:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760696.424061:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.424070:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.424105:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.424113:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ae17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18456576->18460671] (req 18456576->18460671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760696.424201:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520829568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32180us (32384us total) trans 4294971826 rc 0/0
00000100:00100000:1.0:1789760696.424211:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4539
00000100:00100000:1.0:1789760696.424220:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668033247652 time 668078684637 state 0x2 ref 0
00000100:00100000:1.0:1789760696.430677:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760696.430748:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520829696
00000100:00100000:0.0:1789760696.430758:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520829696
00000100:00100000:0.0:1789760696.430806:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668033247652 time 668078684637 state 0x0 ref 1
00000100:00100000:0.0:1789760696.430820:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668078945053 time 668078684637 state 0x1 ref 1
00000100:00100000:0.0:1789760696.430849:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668078945053 time 668117532111 state 0x0 ref 1
00000100:00100000:0.0:1789760696.430861:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520829696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.430902:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18460672, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.430912:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.430928:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760696.430932:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.430938:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.430952:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760696.442458:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548732032:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.442524:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.442566:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548732544:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.442589:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760696.442682:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548732032
00000100:00100000:2.0:1789760696.442690:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548732032
00000100:00100000:2.0:1789760696.442739:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453
00000100:00100000:2.0:1789760696.442747:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda0059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548732032:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760696.442804:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda0059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548732032:12345-0@lo:400:kworker.0 Request processed in 57us (279us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760696.442811:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453
00000100:00100000:0.0:1789760696.442908:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548733056:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.442934:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.442957:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548733568:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.442975:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443006:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548732032:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443019:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:0.0:1789760696.443024:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548732160:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443044:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443060:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548732672:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443086:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443101:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548733184:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443119:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443211:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548732288:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443234:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443250:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548732800:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443266:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443278:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548733312:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443297:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443311:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:0.0:1789760696.443334:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548732416:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443353:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443362:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548732928:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443378:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443392:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548733440:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443408:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.443433:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548732544
00000100:00100000:0.0:1789760696.443437:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548732544
00000100:00100000:0.0:1789760696.443460:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548732288
00000100:00100000:0.0:1789760696.443463:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548732288
00000100:00100000:0.0:1789760696.443474:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391
00000100:00100000:0.0:1789760696.443481:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548732544:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443517:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548732544:12345-0@lo:400:kworker.0 Request processed in 37us (927us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760696.443523:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391
00000100:00100000:0.0:1789760696.443535:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392
00000100:00100000:0.0:1789760696.443540:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548732288:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.443565:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548732288:12345-0@lo:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760696.443571:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392
00000100:00100000:0.0:1789760696.443590:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548733056
00000100:00100000:0.0:1789760696.443593:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548733056
00000100:00100000:2.0:1789760696.443691:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548733568
00000100:00100000:2.0:1789760696.443695:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548733568
00000100:00100000:0.0:1789760696.443746:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548732928
00000100:00100000:0.0:1789760696.443749:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548732928
00000100:00100000:1.0:1789760696.445152:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548733440
00000100:00100000:1.0:1789760696.445159:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548733440
00000100:00100000:2.0:1789760696.445226:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255
00000100:00100000:2.0:1789760696.445234:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548733056:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760696.445298:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548733056:12345-0@lo:400:kworker.0 Request processed in 65us (2363us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760696.445305:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255
00000100:00100000:2.0:1789760696.445328:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256
00000100:00100000:2.0:1789760696.445334:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548733568:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760696.445361:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548733568:12345-0@lo:400:kworker.0 Request processed in 27us (2385us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760696.445367:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256
00000100:00100000:0.0:1789760696.445520:0:9637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257
00000100:00100000:0.0:1789760696.445527:0:9637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548732928:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.445559:0:9637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548732928:12345-0@lo:400:kworker.0 Request processed in 33us (2180us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760696.445565:0:9637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257
00000100:00100000:0.0:1789760696.445629:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548733696:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760696.445659:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760696.445692:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548733696
00000100:00100000:0.0:1789760696.445695:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548733696
00000100:00100000:0.0:1789760696.445959:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548733824
00000100:00100000:0.0:1789760696.445963:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548733824
00000100:00100000:0.0:1789760696.445977:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324
00000100:00100000:0.0:1789760696.445983:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548733696:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:0.0:1789760696.446005:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760696.446045:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548733696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (385us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760696.446050:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324
00000100:00100000:0.0:1789760696.446061:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325
00000100:00100000:0.0:1789760696.446067:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548733824:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1789760696.446087:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760696.446113:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548733824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (289us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760696.446118:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325
00000100:00100000:0.0:1789760696.446154:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc174f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548733824:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760696.446180:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548732928:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.446192:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548732288:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.446216:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548732544:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.446227:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548733056:0@lo:400:kworker.0
00000100:00100000:0.0:1789760696.446235:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548733568:0@lo:400:kworker.0
00000100:00100000:2.0:1789760696.446705:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548733696:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760696.447904:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258
00000100:00100000:1.0:1789760696.447919:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548733440:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.448353:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548733440:12345-0@lo:400:kworker.0 Request processed in 438us (4941us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760696.448363:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258
00000100:00100000:2.0:1789760696.448387:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548733440:0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.448400:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548732160
00000100:00100000:1.0:1789760696.448408:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548732160
00000100:00100000:1.0:1789760696.448434:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548732672
00000100:00100000:1.0:1789760696.448438:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548732672
00000100:00100000:1.0:1789760696.448530:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548733184
00000100:00100000:1.0:1789760696.448534:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548733184
00000100:00100000:1.0:1789760696.448560:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548732800
00000100:00100000:1.0:1789760696.448564:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548732800
00000100:00100000:1.0:1789760696.448585:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548733312
00000100:00100000:1.0:1789760696.448588:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548733312
00000100:00100000:1.0:1789760696.448607:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548732416
00000100:00100000:1.0:1789760696.448610:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548732416
00000100:00100000:1.0:1789760696.448623:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787
00000100:00100000:1.0:1789760696.448632:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548732160:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.448688:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548732160:12345-0@lo:400:kworker.0 Request processed in 58us (5641us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760696.448695:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787
00000100:00100000:1.0:1789760696.448708:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788
00000100:00100000:1.0:1789760696.448788:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548732672:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760696.448797:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548732160:0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.448834:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548732672:12345-0@lo:400:kworker.0 Request processed in 118us (5755us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760696.448841:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788
00000100:00100000:2.0:1789760696.448847:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548732672:0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.448858:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789
00000100:00100000:1.0:1789760696.448867:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548733184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.448909:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548733184:12345-0@lo:400:kworker.0 Request processed in 44us (5788us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760696.448915:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789
00000100:00100000:1.0:1789760696.448929:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790
00000100:00100000:1.0:1789760696.448934:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548732800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760696.448986:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548733184:0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.449048:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548732800:12345-0@lo:400:kworker.0 Request processed in 112us (5779us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760696.449056:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790
00000100:00100000:1.0:1789760696.449069:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791
00000100:00100000:1.0:1789760696.449086:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548733312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.449120:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548733312:12345-0@lo:400:kworker.0 Request processed in 45us (5822us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760696.449289:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791
00000100:00100000:1.0:1789760696.449306:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792
00000100:00100000:1.0:1789760696.449333:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548732416:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.449371:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548732416:12345-0@lo:400:kworker.0 Request processed in 59us (6017us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760696.449379:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792
00000100:00100000:1.0:1789760696.449433:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548732416:0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.449445:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548732800:0@lo:400:kworker.0
00000100:00100000:1.0:1789760696.449458:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548733312:0@lo:400:kworker.0
00002000:00010000:2.0:1789760696.489420:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18460672 -> 18464768
00010000:00010000:2.0:1789760696.489436:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.489533:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.489544:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.489551:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760696.489556:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.489565:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.489584:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.489643:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ae1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18460672->18464767] (req 18460672->18464767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760696.489737:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520829696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58873us (59064us total) trans 4294971827 rc 0/0
00000100:00100000:2.0:1789760696.489748:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4540
00000100:00100000:2.0:1789760696.489756:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668078945053 time 668117532111 state 0x2 ref 0
00000100:00100000:2.0:1789760696.492939:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760696.525881:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971828 is committed
00000100:00100000:0.0:1789760696.532527:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760696.533020:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520829952
00000100:00100000:2.0:1789760696.533030:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520829952
00000100:00100000:2.0:1789760696.533089:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668117792527 time 668180034523 state 0x0 ref 1
00000100:00100000:2.0:1789760696.533104:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668180294939 time 668180034523 state 0x1 ref 1
00000100:00100000:2.0:1789760696.533134:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668180294939 time 668219816434 state 0x0 ref 1
00000100:00100000:2.0:1789760696.533145:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520829952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760696.533187:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18468864, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:2.0:1789760696.533196:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.533213:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:2.0:1789760696.533217:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760696.533223:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760696.533237:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760696.581999:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971829 is committed
00002000:00010000:1.0:1789760696.582072:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18468864 -> 18472960
00010000:00010000:1.0:1789760696.582099:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.582112:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.582122:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.582130:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760696.582135:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.582160:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.582178:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.582186:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ae2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18468864->18472959] (req 18468864->18472959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760696.582271:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520829952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49123us (49748us total) trans 4294971829 rc 0/0
00000100:00100000:1.0:1789760696.582281:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4542
00000100:00100000:1.0:1789760696.582300:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668180294939 time 668219816434 state 0x2 ref 0
00000100:00100000:1.0:1789760696.588521:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760696.589242:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520830080
00000100:00100000:0.0:1789760696.589252:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520830080
00000100:00100000:0.0:1789760696.589330:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668180294939 time 668219816434 state 0x0 ref 1
00000100:00100000:0.0:1789760696.589347:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668220076850 time 668219816434 state 0x1 ref 1
00000100:00100000:0.0:1789760696.589376:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668220076850 time 668276058623 state 0x0 ref 1
00000100:00100000:0.0:1789760696.589387:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520830080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.589432:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18472960, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.589441:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.589457:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760696.589462:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.589468:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.589484:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760696.643127:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971830 is committed
00002000:00010000:0.0:1789760696.643225:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18472960 -> 18477056
00010000:00010000:0.0:1789760696.643239:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.643251:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.643260:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.643267:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760696.643272:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.643281:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.643299:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.643307:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18472960->18477055] (req 18472960->18477055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760696.643410:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520830080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54020us (54893us total) trans 4294971830 rc 0/0
00000100:00100000:0.0:1789760696.643425:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4543
00000100:00100000:0.0:1789760696.643434:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668220076850 time 668276058623 state 0x2 ref 0
00000100:00100000:2.0:1789760696.646556:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760696.646666:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520830208
00000100:00100000:0.0:1789760696.646675:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520830208
00000100:00100000:0.0:1789760696.646731:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668220076850 time 668276058623 state 0x0 ref 1
00000100:00100000:0.0:1789760696.646746:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668276319039 time 668276058623 state 0x1 ref 1
00000100:00100000:0.0:1789760696.646772:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668276319039 time 668333454749 state 0x0 ref 1
00000100:00100000:0.0:1789760696.646783:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520830208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.646825:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18477056, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.646832:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.646848:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760696.646852:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.646859:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.646872:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760696.692912:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18477056 -> 18481152
00010000:00010000:1.0:1789760696.692926:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.692940:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.692949:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.692962:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760696.692967:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.692976:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.692995:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.693004:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ae3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18477056->18481151] (req 18477056->18481151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760696.693096:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520830208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46309us (46598us total) trans 4294971831 rc 0/0
00000100:00100000:1.0:1789760696.693106:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4544
00000100:00100000:1.0:1789760696.693115:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668276319039 time 668333454749 state 0x2 ref 0
00000100:00100000:1.0:1789760696.699893:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760696.749041:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18481152 -> 18485248
00010000:00010000:1.0:1789760696.749057:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ae41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18481152->18485247] (req 18481152->18485247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.749070:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ae41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18481152->18485247] (req 18481152->18485247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.749094:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ae41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18481152->18485247] (req 18481152->18485247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.749101:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760696.749106:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ae41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18481152->18485247] (req 18481152->18485247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.749115:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ae41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18481152->18485247] (req 18481152->18485247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.749134:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ae41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18481152->18485247] (req 18481152->18485247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.749141:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ae41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18481152->18485247] (req 18481152->18485247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760696.749299:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520830336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49173us (53137us total) trans 4294971832 rc 0/0
00000100:00100000:1.0:1789760696.749310:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4545
00000100:00100000:1.0:1789760696.749358:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668333715165 time 668386794721 state 0x2 ref 0
00000100:00100000:2.0:1789760696.752136:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760696.752213:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520830464
00000100:00100000:1.0:1789760696.752222:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520830464
00000100:00100000:1.0:1789760696.752272:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668333715165 time 668386794721 state 0x0 ref 1
00000100:00100000:1.0:1789760696.752286:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668387055137 time 668386794721 state 0x1 ref 1
00000100:00100000:1.0:1789760696.752392:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668387055137 time 668439073202 state 0x0 ref 1
00000100:00100000:1.0:1789760696.752406:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520830464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760696.752455:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18485248, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:1.0:1789760696.752464:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ae48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.752479:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:1.0:1789760696.752484:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760696.752490:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ae48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18485248->18489343] (req 18485248->18489343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.752504:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60ae48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18485248->18489343] (req 18485248->18489343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760696.782586:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971833 is committed
00000100:00100000:2.0:1789760696.793221:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760696.793398:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520830592
00000100:00100000:0.0:1789760696.793408:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520830592
00000100:00100000:0.0:1789760696.793460:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668387055137 time 668439073202 state 0x0 ref 1
00000100:00100000:0.0:1789760696.793476:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668439333618 time 668439073202 state 0x1 ref 1
00000100:00100000:0.0:1789760696.793558:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668439333618 time 668480240023 state 0x0 ref 1
00000100:00100000:0.0:1789760696.793587:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520830592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.793641:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18489344, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.793650:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.793666:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760696.793671:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.793678:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.793692:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760696.838105:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18489344 -> 18493440
00010000:00010000:1.0:1789760696.838121:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.838134:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.838143:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.838150:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760696.838156:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.838165:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.838183:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.838190:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ae4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18489344->18493439] (req 18489344->18493439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760696.838276:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520830592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44702us (45058us total) trans 4294971834 rc 0/0
00000100:00100000:1.0:1789760696.838293:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4547
00000100:00100000:1.0:1789760696.838302:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668439333618 time 668480240023 state 0x2 ref 0
00000100:00100000:0.0:1789760696.842521:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520830720
00000100:00100000:0.0:1789760696.842530:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520830720
00000100:00100000:0.0:1789760696.842590:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668439333618 time 668480240023 state 0x0 ref 1
00000100:00100000:0.0:1789760696.842604:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668480500439 time 668480240023 state 0x1 ref 1
00000100:00100000:0.0:1789760696.842630:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668480500439 time 668529312685 state 0x0 ref 1
00000100:00100000:0.0:1789760696.842642:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520830720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.842685:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18493440, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.842695:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.842710:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760696.842714:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.842720:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.842810:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760696.876204:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18493440 -> 18497536
00010000:00010000:1.0:1789760696.876224:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.876238:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.876248:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.876260:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760696.876266:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.876274:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.876374:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760696.876383:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ae56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18493440->18497535] (req 18493440->18497535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760696.876469:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520830720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33825us (34151us total) trans 4294971835 rc 0/0
00000100:00100000:1.0:1789760696.876479:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4548
00000100:00100000:1.0:1789760696.876488:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668480500439 time 668529312685 state 0x2 ref 0
00000100:00100000:2.0:1789760696.889286:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760696.890842:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520830848
00000100:00100000:1.0:1789760696.890855:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520830848
00010000:00010000:0.0:1789760696.891418:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789760696.896566:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668480500439 time 668529312685 state 0x0 ref 1
00000100:00100000:0.0:1789760696.897046:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668529573101 time 668529312685 state 0x1 ref 1
00000100:00100000:0.0:1789760696.897136:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668529573101 time 668583817899 state 0x0 ref 1
00000100:00100000:0.0:1789760696.897151:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520830848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760696.897204:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18497536, mtime: 0x6aad94b9, atime: 0x0, ctime: 0x6aad94b9, blocks: 0x9007
00010000:00010000:0.0:1789760696.897213:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.897229:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760696.897234:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760696.897241:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.897254:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760696.970792:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971836 is committed
00002000:00010000:0.0:1789760696.971103:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18497536 -> 18501632
00002000:00010000:0.0:1789760696.971108:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760697 -> 1789760698
00002000:00010000:0.0:1789760696.971111:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760697 -> 1789760698
00010000:00010000:0.0:1789760696.971133:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.971147:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.971157:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.971165:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760696.971170:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.971455:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.971477:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760696.971491:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18497536->18501631] (req 18497536->18501631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760696.971685:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520830848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 74430us (82302us total) trans 4294971836 rc 0/0
00000100:00100000:0.0:1789760696.971696:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4549
00000100:00100000:0.0:1789760696.971705:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668529573101 time 668583817899 state 0x2 ref 0
00000100:00100000:0.0:1789760696.981217:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760697.022723:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971837 is committed
00000100:00100000:1.0:1789760697.031067:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760697.031230:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520831104
00000100:00100000:0.0:1789760697.031241:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520831104
00000100:00100000:0.0:1789760697.031292:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668584078315 time 668668133344 state 0x0 ref 1
00000100:00100000:0.0:1789760697.031306:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668668393760 time 668668133344 state 0x1 ref 1
00000100:00100000:0.0:1789760697.031375:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668668393760 time 668718056374 state 0x0 ref 1
00000100:00100000:0.0:1789760697.031387:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520831104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.031435:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18505728, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:0.0:1789760697.031445:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.031462:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760697.031467:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.031474:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.031490:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760697.113203:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971838 is committed
00002000:00010000:2.0:1789760697.113398:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18505728 -> 18509824
00010000:00010000:2.0:1789760697.113413:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.113426:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.113435:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.113443:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760697.113447:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.113457:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.113476:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.113490:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ae6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18505728->18509823] (req 18505728->18509823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760697.113592:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520831104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 82203us (82530us total) trans 4294971838 rc 0/0
00000100:00100000:2.0:1789760697.113607:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4551
00000100:00100000:2.0:1789760697.113616:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668668393760 time 668718056374 state 0x2 ref 0
00000100:00100000:2.0:1789760697.120530:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760697.120976:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520831232
00000100:00100000:0.0:1789760697.120986:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520831232
00000100:00100000:0.0:1789760697.121037:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668668393760 time 668718056374 state 0x0 ref 1
00000100:00100000:0.0:1789760697.121051:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668718316790 time 668718056374 state 0x1 ref 1
00000100:00100000:0.0:1789760697.121088:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668718316790 time 668807770386 state 0x0 ref 1
00000100:00100000:0.0:1789760697.121098:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520831232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.121299:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18509824, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:0.0:1789760697.121308:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.121767:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760697.121772:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.121779:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.121793:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760697.178528:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18509824 -> 18513920
00010000:00010000:2.0:1789760697.178543:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.178556:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.178565:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.178573:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760697.178577:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.178586:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.178663:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.178671:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ae72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18509824->18513919] (req 18509824->18513919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760697.178869:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520831232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57711us (58289us total) trans 4294971839 rc 0/0
00000100:00100000:2.0:1789760697.178880:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4552
00000100:00100000:2.0:1789760697.178890:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668718316790 time 668807770386 state 0x2 ref 0
00000100:00100000:0.0:1789760697.181689:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760697.181758:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520831360
00000100:00100000:2.0:1789760697.181766:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520831360
00000100:00100000:2.0:1789760697.181886:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668718316790 time 668807770386 state 0x0 ref 1
00000100:00100000:2.0:1789760697.181901:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668808030802 time 668807770386 state 0x1 ref 1
00000100:00100000:2.0:1789760697.181931:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668808030802 time 668868613631 state 0x0 ref 1
00000100:00100000:2.0:1789760697.181943:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520831360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760697.181987:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18513920, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:2.0:1789760697.181995:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60ae79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.182010:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:2.0:1789760697.182014:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760697.182020:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60ae79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18513920->18518015] (req 18513920->18518015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.182033:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60ae79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18513920->18518015] (req 18513920->18518015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760697.229275:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760697.305592:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971841 is committed
00002000:00010000:0.0:1789760697.306126:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18518016 -> 18522112
00010000:00010000:0.0:1789760697.306142:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ae80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18518016->18522111] (req 18518016->18522111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.306154:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ae80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18518016->18522111] (req 18518016->18522111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.306164:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ae80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18518016->18522111] (req 18518016->18522111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.306172:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760697.306176:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ae80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18518016->18522111] (req 18518016->18522111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.306185:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ae80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18518016->18522111] (req 18518016->18522111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.306203:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ae80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18518016->18522111] (req 18518016->18522111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.306210:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ae80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18518016->18522111] (req 18518016->18522111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760697.306303:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520831488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76395us (77033us total) trans 4294971841 rc 0/0
00000100:00100000:0.0:1789760697.306348:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4554
00000100:00100000:0.0:1789760697.306357:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668868874047 time 668916574946 state 0x2 ref 0
00000100:00100000:2.0:1789760697.313615:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760697.313729:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520831616
00000100:00100000:0.0:1789760697.313739:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520831616
00000100:00100000:0.0:1789760697.313793:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668868874047 time 668916574946 state 0x0 ref 1
00000100:00100000:0.0:1789760697.313818:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668916835362 time 668916574946 state 0x1 ref 1
00000100:00100000:0.0:1789760697.313843:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668916835362 time 669000526800 state 0x0 ref 1
00000100:00100000:0.0:1789760697.313855:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520831616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.313903:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18522112, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:0.0:1789760697.313912:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.313929:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=668s v=(0 0)
00010000:00010000:0.0:1789760697.313934:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.313940:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.313955:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760697.359440:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18522112 -> 18526208
00010000:00010000:2.0:1789760697.359460:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.359473:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.359482:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.359489:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760697.359494:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.359503:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.359522:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.359536:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ae87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18522112->18526207] (req 18522112->18526207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760697.359627:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520831616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45769us (46026us total) trans 4294971842 rc 0/0
00000100:00100000:2.0:1789760697.359637:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4555
00000100:00100000:2.0:1789760697.359646:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668916835362 time 669000526800 state 0x2 ref 0
00000001:00080000:2.0:1789760697.359681:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971842 is committed
00000100:00100000:2.0:1789760697.368444:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760697.368826:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520831744
00000100:00100000:0.0:1789760697.368837:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520831744
00000100:00100000:0.0:1789760697.368891:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 668916835362 time 669000526800 state 0x0 ref 1
00000100:00100000:0.0:1789760697.368908:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669000787216 time 669000526800 state 0x1 ref 1
00000100:00100000:0.0:1789760697.368939:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669000787216 time 669055621964 state 0x0 ref 1
00000100:00100000:0.0:1789760697.368952:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520831744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.368997:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18526208, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:0.0:1789760697.369006:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ae8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.369022:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:0.0:1789760697.369027:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.369033:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ae8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18526208->18530303] (req 18526208->18530303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.369046:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ae8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18526208->18530303] (req 18526208->18530303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760697.458111:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971843 is committed
00000100:00100000:2.0:1789760697.469110:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520831872
00000100:00100000:2.0:1789760697.469119:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520831872
00000100:00100000:2.0:1789760697.469167:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669000787216 time 669055621964 state 0x0 ref 1
00000100:00100000:2.0:1789760697.469182:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669055882380 time 669055621964 state 0x1 ref 1
00000100:00100000:2.0:1789760697.469210:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669055882380 time 669155892657 state 0x0 ref 1
00000100:00100000:2.0:1789760697.469221:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520831872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760697.469275:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18530304, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:2.0:1789760697.469285:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60ae95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.469300:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:2.0:1789760697.469306:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760697.469337:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60ae95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18530304->18534399] (req 18530304->18534399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.469352:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60ae95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18530304->18534399] (req 18530304->18534399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760697.525809:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971844 is committed
00000100:00100000:2.0:1789760697.529130:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760697.529195:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520832000
00000100:00100000:0.0:1789760697.529203:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520832000
00000100:00100000:0.0:1789760697.529256:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669055882380 time 669155892657 state 0x0 ref 1
00000100:00100000:0.0:1789760697.529270:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669156153073 time 669155892657 state 0x1 ref 1
00000100:00100000:0.0:1789760697.529290:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669156153073 time 669215973088 state 0x0 ref 1
00000100:00100000:0.0:1789760697.529301:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520832000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.529356:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18534400, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:0.0:1789760697.529364:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.529379:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:0.0:1789760697.529383:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.529389:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.529402:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760697.579486:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971845 is committed
00002000:00010000:0.0:1789760697.579550:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18534400 -> 18538496
00010000:00010000:0.0:1789760697.579563:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.579575:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.579861:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.579871:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760697.579875:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.579891:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.579912:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.579920:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ae9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18534400->18538495] (req 18534400->18538495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760697.580161:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520832000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50856us (51034us total) trans 4294971845 rc 0/0
00000100:00100000:0.0:1789760697.580172:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4558
00000100:00100000:0.0:1789760697.580180:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669156153073 time 669215973088 state 0x2 ref 0
00000100:00100000:2.0:1789760697.585567:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:2.0:1789760697.648345:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18538496 -> 18542592
00010000:00010000:2.0:1789760697.648366:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60aea3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18538496->18542591] (req 18538496->18542591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.648380:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60aea3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18538496->18542591] (req 18538496->18542591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.648389:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60aea3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18538496->18542591] (req 18538496->18542591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.648397:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760697.648401:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60aea3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18538496->18542591] (req 18538496->18542591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.648409:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60aea3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18538496->18542591] (req 18538496->18542591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.648428:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60aea3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18538496->18542591] (req 18538496->18542591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.648436:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60aea3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18538496->18542591] (req 18538496->18542591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760697.648531:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520832128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62469us (62967us total) trans 4294971846 rc 0/0
00000100:00100000:2.0:1789760697.648542:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4559
00000100:00100000:2.0:1789760697.648551:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669216233504 time 669272728338 state 0x2 ref 0
00000001:00080000:0.0:1789760697.648739:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971846 is committed
00000100:00100000:0.0:1789760697.652563:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520832256
00000100:00100000:0.0:1789760697.652572:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520832256
00000100:00100000:0.0:1789760697.652637:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669216233504 time 669272728338 state 0x0 ref 1
00000100:00100000:0.0:1789760697.652652:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669272988754 time 669272728338 state 0x1 ref 1
00000100:00100000:0.0:1789760697.652677:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669272988754 time 669339360273 state 0x0 ref 1
00000100:00100000:0.0:1789760697.652689:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520832256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.652740:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18542592, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:0.0:1789760697.652749:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.652764:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:0.0:1789760697.652768:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.652775:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.652788:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760697.697570:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18542592 -> 18546688
00010000:00010000:0.0:1789760697.697605:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.697618:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.697627:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.697633:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760697.697638:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.697646:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.697671:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.697678:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60aeaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18542592->18546687] (req 18542592->18546687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760697.697769:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520832256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45077us (45303us total) trans 4294971847 rc 0/0
00000100:00100000:0.0:1789760697.697779:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4560
00000100:00100000:0.0:1789760697.697788:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669272988754 time 669339360273 state 0x2 ref 0
00000001:00080000:2.0:1789760697.698396:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971847 is committed
00000100:00100000:2.0:1789760697.702718:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520832384
00000100:00100000:2.0:1789760697.702729:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520832384
00000100:00100000:2.0:1789760697.702784:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669272988754 time 669339360273 state 0x0 ref 1
00000100:00100000:2.0:1789760697.702810:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669339620689 time 669339360273 state 0x1 ref 1
00000100:00100000:2.0:1789760697.702840:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669339620689 time 669389522339 state 0x0 ref 1
00000100:00100000:2.0:1789760697.702854:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520832384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760697.702899:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18546688, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:2.0:1789760697.702919:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60aeb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.702935:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:2.0:1789760697.702939:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760697.702946:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60aeb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18546688->18550783] (req 18546688->18550783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.702959:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60aeb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18546688->18550783] (req 18546688->18550783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760697.739222:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971848 is committed
00000100:00100000:2.0:1789760697.753274:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520832512
00000100:00100000:2.0:1789760697.753284:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520832512
00000100:00100000:2.0:1789760697.753380:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669339620689 time 669389522339 state 0x0 ref 1
00000100:00100000:2.0:1789760697.753396:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669389782755 time 669389522339 state 0x1 ref 1
00000100:00100000:2.0:1789760697.753418:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669389782755 time 669440100474 state 0x0 ref 1
00000100:00100000:2.0:1789760697.753431:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520832512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760697.753482:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18550784, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:2.0:1789760697.753492:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.753507:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:2.0:1789760697.753512:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760697.753518:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.753532:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760697.818035:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18550784 -> 18554880
00010000:00010000:2.0:1789760697.818050:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.818063:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.818082:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.818089:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760697.818094:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.818103:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.818125:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760697.818132:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60aeb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18550784->18554879] (req 18550784->18554879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760697.818362:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520832512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64928us (65490us total) trans 4294971849 rc 0/0
00000100:00100000:2.0:1789760697.818377:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4562
00000100:00100000:2.0:1789760697.818387:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669389782755 time 669440100474 state 0x2 ref 0
00000100:00100000:2.0:1789760697.822544:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760697.864622:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971850 is committed
00000100:00100000:1.0:1789760697.871226:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760697.871438:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520832768
00000100:00100000:0.0:1789760697.871449:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520832768
00000100:00100000:0.0:1789760697.871506:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669440360890 time 669509425519 state 0x0 ref 1
00000100:00100000:0.0:1789760697.871522:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669509685935 time 669509425519 state 0x1 ref 1
00000100:00100000:0.0:1789760697.871552:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669509685935 time 669558235583 state 0x0 ref 1
00000100:00100000:0.0:1789760697.871564:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520832768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.871620:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18558976, mtime: 0x6aad94ba, atime: 0x0, ctime: 0x6aad94ba, blocks: 0x9007
00010000:00010000:0.0:1789760697.871629:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.871645:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:0.0:1789760697.871650:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.871656:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.871672:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760697.923893:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18558976 -> 18563072
00002000:00010000:0.0:1789760697.923898:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760698 -> 1789760699
00002000:00010000:0.0:1789760697.923900:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760698 -> 1789760699
00010000:00010000:0.0:1789760697.923914:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.923928:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.923938:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.923946:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760697.923950:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.923958:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.923980:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.923987:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aec6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18558976->18563071] (req 18558976->18563071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760697.924087:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520832768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52520us (52867us total) trans 4294971851 rc 0/0
00000100:00100000:0.0:1789760697.924097:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4564
00000100:00100000:0.0:1789760697.924106:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669509685935 time 669558235583 state 0x2 ref 0
00000100:00100000:1.0:1789760697.927566:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760697.927755:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520832896
00000100:00100000:0.0:1789760697.927764:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520832896
00000100:00100000:0.0:1789760697.927872:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669509685935 time 669558235583 state 0x0 ref 1
00000100:00100000:0.0:1789760697.927888:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669558495999 time 669558235583 state 0x1 ref 1
00000100:00100000:0.0:1789760697.927917:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669558495999 time 669614599648 state 0x0 ref 1
00000100:00100000:0.0:1789760697.927930:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520832896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.927975:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18563072, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:0.0:1789760697.927985:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.928001:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:0.0:1789760697.928006:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.928012:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.928031:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760697.962611:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18563072 -> 18567168
00010000:00010000:0.0:1789760697.962631:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.962644:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.962654:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.962662:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760697.962666:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.962675:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.962693:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.962711:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60aecd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18563072->18567167] (req 18563072->18567167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760697.962971:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520832896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35039us (35409us total) trans 4294971852 rc 0/0
00000100:00100000:0.0:1789760697.962982:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4565
00000100:00100000:0.0:1789760697.962992:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669558495999 time 669614599648 state 0x2 ref 0
00000100:00100000:2.0:1789760697.968180:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760697.968489:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520833024
00000100:00100000:0.0:1789760697.968499:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520833024
00000100:00100000:0.0:1789760697.968548:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669558495999 time 669614599648 state 0x0 ref 1
00000100:00100000:0.0:1789760697.968562:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669614860064 time 669614599648 state 0x1 ref 1
00000100:00100000:0.0:1789760697.968590:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669614860064 time 669655273091 state 0x0 ref 1
00000100:00100000:0.0:1789760697.968608:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520833024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760697.968657:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18567168, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:0.0:1789760697.968666:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aed4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.968682:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:0.0:1789760697.968687:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760697.968693:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18567168->18571263] (req 18567168->18571263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760697.968705:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60aed4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18567168->18571263] (req 18567168->18571263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760698.006058:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760698.006351:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520833152
00000100:00100000:2.0:1789760698.006360:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520833152
00000100:00100000:2.0:1789760698.006429:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669614860064 time 669655273091 state 0x0 ref 1
00000100:00100000:2.0:1789760698.006445:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669655533507 time 669655273091 state 0x1 ref 1
00000100:00100000:2.0:1789760698.006466:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669655533507 time 669693149186 state 0x0 ref 1
00000100:00100000:2.0:1789760698.006478:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520833152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760698.006524:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18571264, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:2.0:1789760698.006532:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60aedb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.006548:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:2.0:1789760698.006552:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760698.006559:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60aedb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18571264->18575359] (req 18571264->18575359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.006573:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60aedb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18571264->18575359] (req 18571264->18575359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760698.040975:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971854 is committed
00000100:00100000:0.0:1789760698.041060:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520833280
00000100:00100000:0.0:1789760698.041079:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520833280
00000100:00100000:0.0:1789760698.041130:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669655533507 time 669693149186 state 0x0 ref 1
00000100:00100000:0.0:1789760698.041145:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669693409602 time 669693149186 state 0x1 ref 1
00000100:00100000:0.0:1789760698.041175:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669693409602 time 669727857692 state 0x0 ref 1
00000100:00100000:0.0:1789760698.041187:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520833280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760698.041236:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18575360, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:0.0:1789760698.041245:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60aee2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.041271:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:0.0:1789760698.041276:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760698.041282:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60aee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18575360->18579455] (req 18575360->18579455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.041296:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60aee2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18575360->18579455] (req 18575360->18579455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760698.072907:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971855 is committed
00000100:00100000:0.0:1789760698.076113:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760698.123347:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971856 is committed
00000100:00100000:1.0:1789760698.126907:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:0.0:1789760698.161381:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18583552 -> 18587648
00010000:00010000:0.0:1789760698.161400:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aef0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18583552->18587647] (req 18583552->18587647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.161419:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aef0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18583552->18587647] (req 18583552->18587647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.161429:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aef0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18583552->18587647] (req 18583552->18587647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.161436:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760698.161441:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aef0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18583552->18587647] (req 18583552->18587647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.161451:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aef0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18583552->18587647] (req 18583552->18587647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.161471:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aef0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18583552->18587647] (req 18583552->18587647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.161479:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60aef0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18583552->18587647] (req 18583552->18587647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760698.161572:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520833536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34423us (34672us total) trans 4294971857 rc 0/0
00000100:00100000:0.0:1789760698.161584:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4570
00000100:00100000:0.0:1789760698.161593:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669763362438 time 669813817568 state 0x2 ref 0
00000001:00080000:1.0:1789760698.161934:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971857 is committed
00000100:00100000:0.0:1789760698.165155:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760698.165243:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520833664
00000100:00100000:2.0:1789760698.165253:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520833664
00000100:00100000:2.0:1789760698.165306:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669763362438 time 669813817568 state 0x0 ref 1
00000100:00100000:2.0:1789760698.165355:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669814077984 time 669813817568 state 0x1 ref 1
00000100:00100000:2.0:1789760698.165382:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669814077984 time 669852064443 state 0x0 ref 1
00000100:00100000:2.0:1789760698.165394:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520833664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760698.165438:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18587648, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:2.0:1789760698.165448:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.165462:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:2.0:1789760698.165466:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760698.165472:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.165486:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760698.250352:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18587648 -> 18591744
00010000:00010000:2.0:1789760698.250368:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.250385:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.250393:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.250401:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760698.250405:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.250412:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.250430:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.250437:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60aef7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18587648->18591743] (req 18587648->18591743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760698.250523:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520833664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 85125us (85370us total) trans 4294971858 rc 0/0
00000100:00100000:2.0:1789760698.250533:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4571
00000100:00100000:2.0:1789760698.250542:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669814077984 time 669852064443 state 0x2 ref 0
00000100:00100000:2.0:1789760698.254942:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520833792
00000100:00100000:2.0:1789760698.254952:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520833792
00000100:00100000:2.0:1789760698.255004:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669814077984 time 669852064443 state 0x0 ref 1
00000100:00100000:2.0:1789760698.255019:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669852324859 time 669852064443 state 0x1 ref 1
00000100:00100000:2.0:1789760698.255059:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669852324859 time 669941733609 state 0x0 ref 1
00000100:00100000:2.0:1789760698.255081:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520833792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760698.255131:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18591744, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:2.0:1789760698.255140:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.255155:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:2.0:1789760698.255160:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760698.255166:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.255180:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760698.302377:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18591744 -> 18595840
00010000:00010000:1.0:1789760698.302394:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.302406:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.302415:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.302422:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760698.302427:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.302437:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.302457:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.302465:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60aefe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18591744->18595839] (req 18591744->18595839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760698.302548:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520833792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47464us (47706us total) trans 4294971859 rc 0/0
00000100:00100000:1.0:1789760698.302558:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4572
00000100:00100000:1.0:1789760698.302567:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669852324859 time 669941733609 state 0x2 ref 0
00000100:00100000:0.0:1789760698.307031:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520833920
00000100:00100000:0.0:1789760698.307042:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520833920
00000100:00100000:0.0:1789760698.307108:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669852324859 time 669941733609 state 0x0 ref 1
00000100:00100000:0.0:1789760698.307124:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669941994025 time 669941733609 state 0x1 ref 1
00000100:00100000:0.0:1789760698.307154:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669941994025 time 669993837096 state 0x0 ref 1
00000100:00100000:0.0:1789760698.307167:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520833920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760698.307214:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18595840, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:0.0:1789760698.307224:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60af05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.307239:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=669s v=(0 0)
00010000:00010000:0.0:1789760698.307245:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760698.307251:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60af05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18595840->18599935] (req 18595840->18599935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.307265:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60af05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18595840->18599935] (req 18595840->18599935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760698.355703:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971860 is committed
00000100:00100000:0.0:1789760698.358406:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520834048
00000100:00100000:0.0:1789760698.358415:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520834048
00000100:00100000:0.0:1789760698.358468:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669941994025 time 669993837096 state 0x0 ref 1
00000100:00100000:0.0:1789760698.358482:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669994097512 time 669993837096 state 0x1 ref 1
00000100:00100000:0.0:1789760698.358513:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669994097512 time 670045195517 state 0x0 ref 1
00000100:00100000:0.0:1789760698.358526:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520834048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760698.358569:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18599936, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:0.0:1789760698.358577:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.358592:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:0.0:1789760698.358606:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760698.358613:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.358627:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760698.390757:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18599936 -> 18604032
00010000:00010000:1.0:1789760698.390778:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.390792:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.390801:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.390809:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760698.390815:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.390824:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.390844:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.390857:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18599936->18604031] (req 18599936->18604031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760698.390948:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520834048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32419us (32854us total) trans 4294971861 rc 0/0
00000100:00100000:1.0:1789760698.390959:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4574
00000100:00100000:1.0:1789760698.390968:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 669994097512 time 670045195517 state 0x2 ref 0
00000001:00080000:2.0:1789760698.391234:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971861 is committed
00000100:00100000:1.0:1789760698.396153:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760698.437532:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971862 is committed
00000100:00100000:1.0:1789760698.441920:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520834304
00000100:00100000:1.0:1789760698.441931:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520834304
00000100:00100000:1.0:1789760698.441984:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670045455933 time 670083263808 state 0x0 ref 1
00000100:00100000:1.0:1789760698.441999:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670083524224 time 670083263808 state 0x1 ref 1
00000100:00100000:1.0:1789760698.442030:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670083524224 time 670128713317 state 0x0 ref 1
00000100:00100000:1.0:1789760698.442042:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520834304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760698.442098:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18608128, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:1.0:1789760698.442107:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.442122:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:1.0:1789760698.442126:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760698.442132:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.442146:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760698.470989:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971863 is committed
00002000:00010000:1.0:1789760698.471087:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18608128 -> 18612224
00010000:00010000:1.0:1789760698.471104:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.471117:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.471127:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.471134:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760698.471139:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.471148:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.471169:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.471177:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18608128->18612223] (req 18608128->18612223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760698.471266:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520834304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29220us (29513us total) trans 4294971863 rc 0/0
00000100:00100000:1.0:1789760698.471276:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4576
00000100:00100000:1.0:1789760698.471286:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670083524224 time 670128713317 state 0x2 ref 0
00000100:00100000:1.0:1789760698.476899:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760698.511346:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971864 is committed
00002000:00010000:0.0:1789760698.511433:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18612224 -> 18616320
00010000:00010000:0.0:1789760698.511457:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60af21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18612224->18616319] (req 18612224->18616319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.511471:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60af21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18612224->18616319] (req 18612224->18616319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.511480:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60af21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18612224->18616319] (req 18612224->18616319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.511488:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760698.511493:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60af21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18612224->18616319] (req 18612224->18616319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.511503:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60af21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18612224->18616319] (req 18612224->18616319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.511522:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60af21 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18612224->18616319] (req 18612224->18616319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.511529:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60af21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18612224->18616319] (req 18612224->18616319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760698.511677:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520834432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34521us (34783us total) trans 4294971864 rc 0/0
00000100:00100000:0.0:1789760698.511688:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4577
00000100:00100000:0.0:1789760698.511705:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670128973733 time 670163822363 state 0x2 ref 0
00000100:00100000:2.0:1789760698.515386:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760698.515514:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520834560
00000100:00100000:1.0:1789760698.515525:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520834560
00000100:00100000:1.0:1789760698.515582:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670128973733 time 670163822363 state 0x0 ref 1
00000100:00100000:1.0:1789760698.515608:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670164082779 time 670163822363 state 0x1 ref 1
00000100:00100000:1.0:1789760698.515638:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670164082779 time 670202320630 state 0x0 ref 1
00000100:00100000:1.0:1789760698.515651:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520834560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760698.515711:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18616320, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:1.0:1789760698.515720:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.515736:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:1.0:1789760698.515740:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760698.515747:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.515762:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760698.541762:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18616320 -> 18620416
00010000:00010000:2.0:1789760698.541777:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.541796:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.541805:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.541813:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760698.541818:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.541828:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.541848:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.541855:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60af28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18616320->18620415] (req 18616320->18620415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760698.541952:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520834560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26297us (26569us total) trans 4294971865 rc 0/0
00000100:00100000:2.0:1789760698.541962:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4578
00000100:00100000:2.0:1789760698.541972:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670164082779 time 670202320630 state 0x2 ref 0
00000100:00100000:2.0:1789760698.545210:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760698.571598:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971866 is committed
00000100:00100000:2.0:1789760698.575918:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520834816
00000100:00100000:2.0:1789760698.575928:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520834816
00000100:00100000:2.0:1789760698.575981:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670202581046 time 670232090285 state 0x0 ref 1
00000100:00100000:2.0:1789760698.575996:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670232350701 time 670232090285 state 0x1 ref 1
00000100:00100000:2.0:1789760698.576027:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670232350701 time 670262709373 state 0x0 ref 1
00000100:00100000:2.0:1789760698.576039:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520834816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760698.576094:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18624512, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:2.0:1789760698.576103:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.576119:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:2.0:1789760698.576124:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760698.576131:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.576145:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760698.612094:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18624512 -> 18628608
00010000:00010000:1.0:1789760698.612110:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.612123:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.612132:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.612139:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760698.612145:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.612153:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.612172:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.612180:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60af36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18624512->18628607] (req 18624512->18628607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760698.612277:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520834816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36236us (36427us total) trans 4294971867 rc 0/0
00000100:00100000:1.0:1789760698.612291:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4580
00000100:00100000:1.0:1789760698.612301:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670232350701 time 670262709373 state 0x2 ref 0
00000100:00100000:1.0:1789760698.616416:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760698.616685:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520834944
00000100:00100000:0.0:1789760698.616704:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520834944
00000100:00100000:0.0:1789760698.616760:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670232350701 time 670262709373 state 0x0 ref 1
00000100:00100000:0.0:1789760698.616776:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670262969789 time 670262709373 state 0x1 ref 1
00000100:00100000:0.0:1789760698.616807:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670262969789 time 670303489630 state 0x0 ref 1
00000100:00100000:0.0:1789760698.616820:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520834944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760698.616867:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18628608, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:0.0:1789760698.616876:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.616893:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:0.0:1789760698.616898:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760698.616904:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.616930:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760698.643441:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18628608 -> 18632704
00010000:00010000:0.0:1789760698.643461:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.643475:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.643485:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.643492:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760698.643497:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.643507:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.643526:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.643534:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18628608->18632703] (req 18628608->18632703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760698.643636:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520834944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26813us (27225us total) trans 4294971868 rc 0/0
00000100:00100000:0.0:1789760698.643647:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4581
00000100:00100000:0.0:1789760698.643657:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670262969789 time 670303489630 state 0x2 ref 0
00000001:00080000:1.0:1789760698.646926:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971868 is committed
00000100:00100000:0.0:1789760698.647342:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760698.647444:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520835072
00000100:00100000:2.0:1789760698.647454:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520835072
00000100:00100000:2.0:1789760698.647508:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670262969789 time 670303489630 state 0x0 ref 1
00000100:00100000:2.0:1789760698.647522:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670303750046 time 670303489630 state 0x1 ref 1
00000100:00100000:2.0:1789760698.647598:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670303750046 time 670334270974 state 0x0 ref 1
00000100:00100000:2.0:1789760698.647612:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520835072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760698.647662:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18632704, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:2.0:1789760698.647671:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.647687:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:2.0:1789760698.647803:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760698.647810:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.647825:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760698.680338:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971869 is committed
00002000:00010000:0.0:1789760698.680444:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18632704 -> 18636800
00010000:00010000:0.0:1789760698.680459:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.680472:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.680482:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.680490:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760698.680495:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.680505:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.680529:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.680538:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60af44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18632704->18636799] (req 18632704->18636799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760698.680743:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520835072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33128us (33400us total) trans 4294971869 rc 0/0
00000100:00100000:0.0:1789760698.680755:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4582
00000100:00100000:0.0:1789760698.680765:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670303750046 time 670334270974 state 0x2 ref 0
00000100:00100000:2.0:1789760698.685291:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760698.754829:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971870 is committed
00002000:00010000:1.0:1789760698.754891:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18636800 -> 18640896
00010000:00010000:1.0:1789760698.754908:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18636800->18640895] (req 18636800->18640895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.754921:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18636800->18640895] (req 18636800->18640895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.754931:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18636800->18640895] (req 18636800->18640895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.754940:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760698.754944:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18636800->18640895] (req 18636800->18640895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.754953:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18636800->18640895] (req 18636800->18640895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.754984:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18636800->18640895] (req 18636800->18640895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.754999:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18636800->18640895] (req 18636800->18640895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760698.755104:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520835200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 69393us (69822us total) trans 4294971870 rc 0/0
00000100:00100000:1.0:1789760698.755114:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4583
00000100:00100000:1.0:1789760698.755124:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670334531390 time 670372365223 state 0x2 ref 0
00000100:00100000:1.0:1789760698.768535:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760698.768641:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520835328
00000100:00100000:2.0:1789760698.768650:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520835328
00000100:00100000:2.0:1789760698.768699:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670334531390 time 670372365223 state 0x0 ref 1
00000100:00100000:2.0:1789760698.768714:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670372625639 time 670372365223 state 0x1 ref 1
00000100:00100000:2.0:1789760698.768746:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670372625639 time 670455427831 state 0x0 ref 1
00000100:00100000:2.0:1789760698.768757:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520835328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760698.768805:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18640896, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:2.0:1789760698.768815:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.768831:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:2.0:1789760698.768836:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760698.768842:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760698.768855:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760698.824415:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18640896 -> 18644992
00010000:00010000:1.0:1789760698.824437:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.824450:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.824460:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.824467:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760698.824472:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.824481:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.825102:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.825110:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60af52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18640896->18644991] (req 18640896->18644991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760698.825215:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520835328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56455us (56685us total) trans 4294971871 rc 0/0
00000100:00100000:1.0:1789760698.825226:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4584
00000100:00100000:1.0:1789760698.825236:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670372625639 time 670455427831 state 0x2 ref 0
00000001:00080000:1.0:1789760698.825391:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971871 is committed
00000100:00100000:0.0:1789760698.830558:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760698.830889:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520835456
00000100:00100000:1.0:1789760698.830899:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520835456
00000100:00100000:1.0:1789760698.830949:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670372625639 time 670455427831 state 0x0 ref 1
00000100:00100000:1.0:1789760698.830965:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670455688247 time 670455427831 state 0x1 ref 1
00000100:00100000:1.0:1789760698.830997:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670455688247 time 670517679823 state 0x0 ref 1
00000100:00100000:1.0:1789760698.831010:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520835456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760698.831055:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18644992, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:1.0:1789760698.831077:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.831098:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:1.0:1789760698.831103:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760698.831109:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18644992->18649087] (req 18644992->18649087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760698.831123:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18644992->18649087] (req 18644992->18649087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760698.868421:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971872 is committed
00000100:00100000:2.0:1789760698.879899:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760698.880114:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520835584
00000100:00100000:0.0:1789760698.880124:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520835584
00000100:00100000:0.0:1789760698.880177:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670455688247 time 670517679823 state 0x0 ref 1
00000100:00100000:0.0:1789760698.880193:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670517940239 time 670517679823 state 0x1 ref 1
00000100:00100000:0.0:1789760698.880227:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670517940239 time 670566909667 state 0x0 ref 1
00000100:00100000:0.0:1789760698.880239:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520835584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760698.880285:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18649088, mtime: 0x6aad94bb, atime: 0x0, ctime: 0x6aad94bb, blocks: 0x9007
00010000:00010000:0.0:1789760698.880295:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.880346:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:0.0:1789760698.880351:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760698.880358:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.880372:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760698.941447:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18649088 -> 18653184
00002000:00010000:0.0:1789760698.941456:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760699 -> 1789760700
00002000:00010000:0.0:1789760698.941459:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760699 -> 1789760700
00010000:00010000:0.0:1789760698.941472:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.941486:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.941495:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.941503:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760698.941508:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.941528:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.941555:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.941563:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60af60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18649088->18653183] (req 18649088->18653183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760698.941674:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520835584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61431us (61778us total) trans 4294971873 rc 0/0
00000100:00100000:0.0:1789760698.941685:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4586
00000100:00100000:0.0:1789760698.941694:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670517940239 time 670566909667 state 0x2 ref 0
00010000:00010000:2.0:1789760698.943815:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789760698.955126:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:0.0:1789760698.991879:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18653184 -> 18657280
00010000:00010000:0.0:1789760698.991897:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18653184->18657279] (req 18653184->18657279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.991911:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18653184->18657279] (req 18653184->18657279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.991920:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18653184->18657279] (req 18653184->18657279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.991928:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760698.991933:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18653184->18657279] (req 18653184->18657279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.991948:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18653184->18657279] (req 18653184->18657279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.991968:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af67 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18653184->18657279] (req 18653184->18657279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760698.991976:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60af67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18653184->18657279] (req 18653184->18657279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760698.992081:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520835712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36703us (36960us total) trans 4294971874 rc 0/0
00000100:00100000:0.0:1789760698.992092:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4587
00000100:00100000:0.0:1789760698.992102:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670567170083 time 670642043576 state 0x2 ref 0
00000100:00100000:1.0:1789760699.002222:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789760699.002245:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548733952:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760699.002339:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760699.003387:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548733952:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760699.003556:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.004138:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520835840
00000100:00100000:2.0:1789760699.004144:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520835840
00000100:00100000:2.0:1789760699.004185:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670567170083 time 670642043576 state 0x0 ref 1
00000100:00100000:2.0:1789760699.004198:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670642303992 time 670642043576 state 0x1 ref 1
00000100:00100000:2.0:1789760699.004227:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670642303992 time 670690909301 state 0x0 ref 1
00000100:00100000:2.0:1789760699.004239:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520835840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.004284:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18657280, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:2.0:1789760699.004294:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.004311:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:2.0:1789760699.004348:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.004355:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.004370:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760699.063867:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971875 is committed
00002000:00010000:0.0:1789760699.064143:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18657280 -> 18661376
00010000:00010000:0.0:1789760699.064158:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.064172:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.064181:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.064194:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760699.064199:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.064209:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.064228:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.064236:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60af6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18657280->18661375] (req 18657280->18661375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760699.064376:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520835840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60134us (60816us total) trans 4294971875 rc 0/0
00000100:00100000:0.0:1789760699.064387:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4588
00000100:00100000:0.0:1789760699.064396:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670642303992 time 670690909301 state 0x2 ref 0
00000100:00100000:2.0:1789760699.067899:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760699.068048:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520835968
00000100:00100000:1.0:1789760699.068068:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520835968
00000100:00100000:1.0:1789760699.068122:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670642303992 time 670690909301 state 0x0 ref 1
00000100:00100000:1.0:1789760699.068137:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670691169717 time 670690909301 state 0x1 ref 1
00000100:00100000:1.0:1789760699.068160:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670691169717 time 670754842817 state 0x0 ref 1
00000100:00100000:1.0:1789760699.068172:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc825b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520835968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760699.068216:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18661376, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:1.0:1789760699.068225:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.068245:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:1.0:1789760699.068250:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760699.068256:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.068270:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760699.141361:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18661376 -> 18665472
00010000:00010000:2.0:1789760699.141380:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.141392:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.141402:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.141409:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.141414:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.141423:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.141446:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.141453:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60af75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18661376->18665471] (req 18661376->18665471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.141531:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc825b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520835968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73355us (73635us total) trans 4294971876 rc 0/0
00000100:00100000:2.0:1789760699.141550:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4589
00000100:00100000:2.0:1789760699.141560:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670691169717 time 670754842817 state 0x2 ref 0
00000001:00080000:1.0:1789760699.142373:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971876 is committed
00000100:00100000:1.0:1789760699.148451:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760699.148542:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520836096
00000100:00100000:0.0:1789760699.148551:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520836096
00000100:00100000:0.0:1789760699.148696:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670691169717 time 670754842817 state 0x0 ref 1
00000100:00100000:0.0:1789760699.148711:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670755103233 time 670754842817 state 0x1 ref 1
00000100:00100000:0.0:1789760699.148741:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670755103233 time 670835424146 state 0x0 ref 1
00000100:00100000:0.0:1789760699.148757:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520836096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760699.148801:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18665472, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:0.0:1789760699.148810:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.148824:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:0.0:1789760699.148828:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760699.148834:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.148848:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760699.205785:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18665472 -> 18669568
00010000:00010000:0.0:1789760699.205801:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.205814:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.205823:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.205830:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760699.205835:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.205844:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.205863:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.205871:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60af7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18665472->18669567] (req 18665472->18669567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760699.205992:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520836096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57232us (57544us total) trans 4294971877 rc 0/0
00000100:00100000:0.0:1789760699.206002:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4590
00000100:00100000:0.0:1789760699.206012:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670755103233 time 670835424146 state 0x2 ref 0
00000100:00100000:0.0:1789760699.221347:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760699.221697:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520836224
00000100:00100000:1.0:1789760699.221707:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520836224
00000100:00100000:1.0:1789760699.221762:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670755103233 time 670835424146 state 0x0 ref 1
00000100:00100000:1.0:1789760699.221777:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670835684562 time 670835424146 state 0x1 ref 1
00000100:00100000:1.0:1789760699.221810:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670835684562 time 670908492251 state 0x0 ref 1
00000100:00100000:1.0:1789760699.221823:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520836224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760699.221870:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18669568, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:1.0:1789760699.221879:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.221895:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:1.0:1789760699.221900:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760699.221907:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.221921:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760699.258780:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18669568 -> 18673664
00010000:00010000:1.0:1789760699.258802:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.258817:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.258828:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.258836:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760699.258841:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.258855:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.258876:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.258884:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18669568->18673663] (req 18669568->18673663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760699.259024:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520836224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37199us (37681us total) trans 4294971878 rc 0/0
00000100:00100000:1.0:1789760699.259036:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4591
00000100:00100000:1.0:1789760699.259046:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670835684562 time 670908492251 state 0x2 ref 0
00000100:00100000:2.0:1789760699.267358:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760699.267449:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520836352
00000100:00100000:0.0:1789760699.267459:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520836352
00000100:00100000:0.0:1789760699.267512:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670835684562 time 670908492251 state 0x0 ref 1
00000100:00100000:0.0:1789760699.267528:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670908752667 time 670908492251 state 0x1 ref 1
00000100:00100000:0.0:1789760699.267596:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670908752667 time 670954278151 state 0x0 ref 1
00000100:00100000:0.0:1789760699.267609:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520836352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760699.267658:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18673664, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:0.0:1789760699.267669:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.267686:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:0.0:1789760699.267691:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760699.267698:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.267713:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760699.290822:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18673664 -> 18677760
00010000:00010000:2.0:1789760699.290841:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.290866:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.290875:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.290882:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.290886:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.290900:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.290918:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.290926:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60af8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18673664->18677759] (req 18673664->18677759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.291016:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520836352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23403us (23705us total) trans 4294971879 rc 0/0
00000100:00100000:2.0:1789760699.291026:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4592
00000100:00100000:2.0:1789760699.291036:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670908752667 time 670954278151 state 0x2 ref 0
00000001:00080000:1.0:1789760699.294515:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971879 is committed
00000100:00100000:0.0:1789760699.296302:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.296422:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520836480
00000100:00100000:2.0:1789760699.296437:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520836480
00000100:00100000:2.0:1789760699.296484:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670908752667 time 670954278151 state 0x0 ref 1
00000100:00100000:2.0:1789760699.296495:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670954538567 time 670954278151 state 0x1 ref 1
00000100:00100000:2.0:1789760699.296511:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670954538567 time 670983194192 state 0x0 ref 1
00000100:00100000:2.0:1789760699.296523:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520836480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.296571:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18677760, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:2.0:1789760699.296581:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.296608:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=670s v=(0 0)
00010000:00010000:2.0:1789760699.296613:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.296619:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.296634:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760699.344232:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971880 is committed
00002000:00010000:2.0:1789760699.344566:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18677760 -> 18681856
00010000:00010000:2.0:1789760699.344581:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.344651:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.344660:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.344667:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.344672:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.344681:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.344773:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.344782:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18677760->18681855] (req 18677760->18681855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.344906:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520836480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48380us (48604us total) trans 4294971880 rc 0/0
00000100:00100000:2.0:1789760699.344916:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4593
00000100:00100000:2.0:1789760699.344925:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670954538567 time 670983194192 state 0x2 ref 0
00000100:00100000:0.0:1789760699.353028:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.353215:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520836608
00000100:00100000:2.0:1789760699.353225:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520836608
00000100:00100000:2.0:1789760699.353296:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670954538567 time 670983194192 state 0x0 ref 1
00000100:00100000:2.0:1789760699.353340:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670983454608 time 670983194192 state 0x1 ref 1
00000100:00100000:2.0:1789760699.353363:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670983454608 time 671040046241 state 0x0 ref 1
00000100:00100000:2.0:1789760699.353375:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520836608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.353422:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18681856, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:2.0:1789760699.353441:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.353464:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760699.353468:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.353474:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.353494:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760699.419819:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971881 is committed
00002000:00010000:2.0:1789760699.420001:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18681856 -> 18685952
00010000:00010000:2.0:1789760699.420017:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.420028:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.420037:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.420045:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.420050:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.420069:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.420087:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.420095:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60af98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18681856->18685951] (req 18681856->18685951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.420192:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520836608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66814us (67168us total) trans 4294971881 rc 0/0
00000100:00100000:2.0:1789760699.420202:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4594
00000100:00100000:2.0:1789760699.420211:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670983454608 time 671040046241 state 0x2 ref 0
00000100:00100000:2.0:1789760699.432199:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760699.432306:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520836736
00000100:00100000:1.0:1789760699.432355:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520836736
00000100:00100000:1.0:1789760699.432408:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 670983454608 time 671040046241 state 0x0 ref 1
00000100:00100000:1.0:1789760699.432423:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671040306657 time 671040046241 state 0x1 ref 1
00000100:00100000:1.0:1789760699.432451:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671040306657 time 671119133939 state 0x0 ref 1
00000100:00100000:1.0:1789760699.432462:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520836736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760699.432508:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18685952, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:1.0:1789760699.432517:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.432532:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:1.0:1789760699.432536:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760699.432542:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.432561:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760699.473963:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971882 is committed
00002000:00010000:2.0:1789760699.474075:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18685952 -> 18690048
00010000:00010000:2.0:1789760699.474091:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.474103:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.474111:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.474118:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.474122:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.474130:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.474148:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.474159:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60af9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18685952->18690047] (req 18685952->18690047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.474249:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520836736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41783us (42066us total) trans 4294971882 rc 0/0
00000100:00100000:2.0:1789760699.474259:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4595
00000100:00100000:2.0:1789760699.474268:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671040306657 time 671119133939 state 0x2 ref 0
00000100:00100000:0.0:1789760699.479468:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760699.479565:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520836864
00000100:00100000:1.0:1789760699.479574:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520836864
00000100:00100000:1.0:1789760699.479680:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671040306657 time 671119133939 state 0x0 ref 1
00000100:00100000:1.0:1789760699.479695:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671119394355 time 671119133939 state 0x1 ref 1
00000100:00100000:1.0:1789760699.479725:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671119394355 time 671166407641 state 0x0 ref 1
00000100:00100000:1.0:1789760699.479738:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520836864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760699.479783:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18690048, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:1.0:1789760699.479792:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.479807:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:1.0:1789760699.479812:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760699.479819:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.479833:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760699.520113:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18690048 -> 18694144
00010000:00010000:0.0:1789760699.520127:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.520205:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.520216:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.520224:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760699.520229:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.520238:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.520256:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.520263:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60afa6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18690048->18694143] (req 18690048->18694143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760699.520425:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520836864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40684us (40961us total) trans 4294971883 rc 0/0
00000100:00100000:0.0:1789760699.520435:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4596
00000100:00100000:0.0:1789760699.520444:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671119394355 time 671166407641 state 0x2 ref 0
00000100:00100000:0.0:1789760699.533267:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.533625:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520836992
00000100:00100000:2.0:1789760699.533634:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520836992
00000100:00100000:1.0:1789760699.533758:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671119394355 time 671166407641 state 0x0 ref 1
00000100:00100000:1.0:1789760699.533774:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671166668057 time 671166407641 state 0x1 ref 1
00000100:00100000:1.0:1789760699.533838:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671166668057 time 671220519742 state 0x0 ref 1
00000100:00100000:1.0:1789760699.533851:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520836992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760699.533898:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18694144, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:1.0:1789760699.533908:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.533924:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:1.0:1789760699.533929:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760699.533934:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.533947:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760699.573127:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971884 is committed
00002000:00010000:0.0:1789760699.573232:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18694144 -> 18698240
00010000:00010000:0.0:1789760699.573249:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.573261:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.573270:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.573282:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760699.573287:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.573297:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.573403:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760699.573411:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60afad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18694144->18698239] (req 18694144->18698239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760699.573488:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520836992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39635us (40228us total) trans 4294971884 rc 0/0
00000100:00100000:0.0:1789760699.573499:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4597
00000100:00100000:0.0:1789760699.573509:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671166668057 time 671220519742 state 0x2 ref 0
00000100:00100000:1.0:1789760699.577896:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.577986:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520837120
00000100:00100000:2.0:1789760699.577996:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520837120
00000100:00100000:2.0:1789760699.578049:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671166668057 time 671220519742 state 0x0 ref 1
00000100:00100000:2.0:1789760699.578074:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671220780158 time 671220519742 state 0x1 ref 1
00000100:00100000:2.0:1789760699.578135:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671220780158 time 671264816882 state 0x0 ref 1
00000100:00100000:2.0:1789760699.578149:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520837120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.578203:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18698240, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:2.0:1789760699.578213:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.578229:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760699.578233:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.578239:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.578253:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760699.624491:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971885 is committed
00002000:00010000:2.0:1789760699.624658:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18698240 -> 18702336
00010000:00010000:2.0:1789760699.624677:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.624698:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.624707:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.624715:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.624720:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.624728:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.624749:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.624758:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18698240->18702335] (req 18698240->18702335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.624854:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520837120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46703us (46961us total) trans 4294971885 rc 0/0
00000100:00100000:2.0:1789760699.624865:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4598
00000100:00100000:2.0:1789760699.624874:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671220780158 time 671264816882 state 0x2 ref 0
00000100:00100000:1.0:1789760699.628932:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.629079:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520837248
00000100:00100000:2.0:1789760699.629089:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520837248
00000100:00100000:2.0:1789760699.629141:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671220780158 time 671264816882 state 0x0 ref 1
00000100:00100000:2.0:1789760699.629156:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671265077298 time 671264816882 state 0x1 ref 1
00000100:00100000:2.0:1789760699.629434:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671265077298 time 671316114251 state 0x0 ref 1
00000100:00100000:2.0:1789760699.629449:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520837248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.629500:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18702336, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:2.0:1789760699.629509:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.629524:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760699.629528:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.629534:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.629548:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760699.671242:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18702336 -> 18706432
00010000:00010000:2.0:1789760699.671258:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.671272:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.671282:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.671288:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.671293:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.671302:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.671355:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.671364:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60afbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18702336->18706431] (req 18702336->18706431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.671458:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520837248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42007us (42531us total) trans 4294971886 rc 0/0
00000100:00100000:2.0:1789760699.671472:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4599
00000100:00100000:2.0:1789760699.671481:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671265077298 time 671316114251 state 0x2 ref 0
00000100:00100000:1.0:1789760699.675694:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.675857:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520837376
00000100:00100000:2.0:1789760699.675867:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520837376
00000100:00100000:2.0:1789760699.675919:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671265077298 time 671316114251 state 0x0 ref 1
00000100:00100000:2.0:1789760699.675933:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671316374667 time 671316114251 state 0x1 ref 1
00000100:00100000:2.0:1789760699.675963:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671316374667 time 671362645883 state 0x0 ref 1
00000100:00100000:2.0:1789760699.675974:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520837376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.676020:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18706432, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:2.0:1789760699.676030:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.676045:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760699.676125:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.676132:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.676146:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760699.729173:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18706432 -> 18710528
00010000:00010000:2.0:1789760699.729192:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.729205:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.729214:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.729222:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.729226:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.729235:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.729254:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.729261:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18706432->18710527] (req 18706432->18710527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.729371:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520837376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53394us (53693us total) trans 4294971887 rc 0/0
00000100:00100000:2.0:1789760699.729443:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4600
00000100:00100000:2.0:1789760699.729452:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671316374667 time 671362645883 state 0x2 ref 0
00000100:00100000:2.0:1789760699.732603:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520837504
00000100:00100000:2.0:1789760699.732613:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520837504
00000100:00100000:2.0:1789760699.732663:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671316374667 time 671362645883 state 0x0 ref 1
00000100:00100000:2.0:1789760699.732678:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671362906299 time 671362645883 state 0x1 ref 1
00000100:00100000:2.0:1789760699.732881:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671362906299 time 671419561777 state 0x0 ref 1
00000100:00100000:2.0:1789760699.732894:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520837504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.732941:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18710528, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:2.0:1789760699.732950:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.732966:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760699.732970:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.732977:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.732990:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760699.768225:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971888 is committed
00002000:00010000:2.0:1789760699.768385:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18710528 -> 18714624
00010000:00010000:2.0:1789760699.768400:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.768413:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.768428:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.768435:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.768441:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.768450:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.768469:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.768477:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18710528->18714623] (req 18710528->18714623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.768586:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520837504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35680us (36305us total) trans 4294971888 rc 0/0
00000100:00100000:2.0:1789760699.769524:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4601
00000100:00100000:2.0:1789760699.769543:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671362906299 time 671419561777 state 0x2 ref 0
00000100:00100000:1.0:1789760699.774574:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760699.826405:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971889 is committed
00000100:00100000:1.0:1789760699.838491:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:2.0:1789760699.910660:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18718720 -> 18722816
00010000:00010000:2.0:1789760699.910679:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60afd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18718720->18722815] (req 18718720->18722815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.910698:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60afd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18718720->18722815] (req 18718720->18722815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.910708:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60afd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18718720->18722815] (req 18718720->18722815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.910715:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760699.910720:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60afd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18718720->18722815] (req 18718720->18722815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.910729:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60afd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18718720->18722815] (req 18718720->18722815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.910748:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60afd7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18718720->18722815] (req 18718720->18722815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.910755:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60afd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18718720->18722815] (req 18718720->18722815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760699.910852:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520837760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 71959us (72369us total) trans 4294971890 rc 0/0
00000100:00100000:2.0:1789760699.910862:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4603
00000100:00100000:2.0:1789760699.910872:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671461831700 time 671525557553 state 0x2 ref 0
00000001:00080000:1.0:1789760699.912575:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971890 is committed
00000100:00100000:1.0:1789760699.916399:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.916442:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520837888
00000100:00100000:2.0:1789760699.916454:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520837888
00000100:00100000:2.0:1789760699.916510:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671461831700 time 671525557553 state 0x0 ref 1
00000100:00100000:2.0:1789760699.916525:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671525817969 time 671525557553 state 0x1 ref 1
00000100:00100000:2.0:1789760699.916635:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671525817969 time 671603316026 state 0x0 ref 1
00000100:00100000:2.0:1789760699.916649:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520837888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.916694:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18722816, mtime: 0x6aad94bc, atime: 0x0, ctime: 0x6aad94bc, blocks: 0x9007
00010000:00010000:2.0:1789760699.916703:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.916718:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760699.916723:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.916730:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.916746:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760699.991193:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18722816 -> 18726912
00002000:00010000:1.0:1789760699.991199:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760700 -> 1789760701
00002000:00010000:1.0:1789760699.991202:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760700 -> 1789760701
00010000:00010000:1.0:1789760699.991215:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.991228:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.991237:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.991245:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760699.991250:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.991260:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.991281:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760699.991289:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60afde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18722816->18726911] (req 18722816->18726911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760699.991461:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520837888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 74810us (75071us total) trans 4294971891 rc 0/0
00000100:00100000:1.0:1789760699.991473:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4604
00000100:00100000:1.0:1789760699.991483:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671525817969 time 671603316026 state 0x2 ref 0
00000100:00100000:0.0:1789760699.999003:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760699.999090:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520838016
00000100:00100000:2.0:1789760699.999101:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520838016
00000100:00100000:2.0:1789760699.999154:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671525817969 time 671603316026 state 0x0 ref 1
00000100:00100000:2.0:1789760699.999168:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671603576442 time 671603316026 state 0x1 ref 1
00000100:00100000:2.0:1789760699.999200:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671603576442 time 671685882275 state 0x0 ref 1
00000100:00100000:2.0:1789760699.999214:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520838016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760699.999260:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18726912, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:2.0:1789760699.999269:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.999283:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760699.999287:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760699.999293:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760699.999305:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.026508:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548734080:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760700.026608:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760700.027082:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548734080:0@lo:41:osp-pre-1-0.0
00002000:00010000:0.0:1789760700.030444:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18726912 -> 18731008
00010000:00010000:0.0:1789760700.030466:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.030481:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.030490:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.030498:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.030503:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.030512:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.030532:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.030540:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60afe5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18726912->18731007] (req 18726912->18731007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.030647:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520838016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31429us (31647us total) trans 4294971892 rc 0/0
00000100:00100000:0.0:1789760700.030659:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4605
00000100:00100000:0.0:1789760700.030668:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671603576442 time 671685882275 state 0x2 ref 0
00000001:00080000:1.0:1789760700.031183:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971892 is committed
00000100:00100000:2.0:1789760700.034092:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520838144
00000100:00100000:2.0:1789760700.034102:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520838144
00000100:00100000:2.0:1789760700.034172:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671603576442 time 671685882275 state 0x0 ref 1
00000100:00100000:2.0:1789760700.034185:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671686142691 time 671685882275 state 0x1 ref 1
00000100:00100000:2.0:1789760700.034265:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671686142691 time 671720947234 state 0x0 ref 1
00000100:00100000:2.0:1789760700.034279:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520838144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760700.034363:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18731008, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:2.0:1789760700.034372:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.034393:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760700.034397:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760700.034403:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.034416:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760700.079293:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971893 is committed
00002000:00010000:0.0:1789760700.079463:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18731008 -> 18735104
00010000:00010000:0.0:1789760700.079479:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.079494:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.079503:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.079510:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.079515:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.079524:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.079542:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.079549:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60afec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18731008->18735103] (req 18731008->18735103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.079872:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520838144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45591us (46041us total) trans 4294971893 rc 0/0
00000100:00100000:0.0:1789760700.079882:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4606
00000100:00100000:0.0:1789760700.079891:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671686142691 time 671720947234 state 0x2 ref 0
00000100:00100000:2.0:1789760700.090119:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520838272
00000100:00100000:2.0:1789760700.090132:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520838272
00000100:00100000:2.0:1789760700.090205:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671686142691 time 671720947234 state 0x0 ref 1
00000100:00100000:2.0:1789760700.090222:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671721207650 time 671720947234 state 0x1 ref 1
00000100:00100000:2.0:1789760700.090249:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671721207650 time 671776931025 state 0x0 ref 1
00000100:00100000:2.0:1789760700.090262:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520838272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760700.090336:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18735104, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:2.0:1789760700.090346:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.090362:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760700.090366:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760700.090373:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.090394:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760700.139880:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18735104 -> 18739200
00010000:00010000:1.0:1789760700.139896:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.139910:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.139918:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.139925:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760700.139929:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.139937:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.139957:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.139964:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60aff3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18735104->18739199] (req 18735104->18739199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760700.140070:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520838272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49807us (57508us total) trans 4294971894 rc 0/0
00000100:00100000:1.0:1789760700.140082:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4607
00000100:00100000:1.0:1789760700.140091:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671721207650 time 671776931025 state 0x2 ref 0
00000100:00100000:1.0:1789760700.147031:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760700.147102:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520838400
00000100:00100000:2.0:1789760700.147183:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520838400
00000100:00100000:2.0:1789760700.147238:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671721207650 time 671776931025 state 0x0 ref 1
00000100:00100000:2.0:1789760700.147253:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671777191441 time 671776931025 state 0x1 ref 1
00000100:00100000:2.0:1789760700.147356:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671777191441 time 671834037090 state 0x0 ref 1
00000100:00100000:2.0:1789760700.147369:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520838400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760700.147418:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18739200, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:2.0:1789760700.147427:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.147442:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:2.0:1789760700.147446:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760700.147452:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.147466:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760700.211036:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18739200 -> 18743296
00010000:00010000:1.0:1789760700.211067:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.211080:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.211089:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.211097:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760700.211102:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.211121:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.211142:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.211154:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60affa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18739200->18743295] (req 18739200->18743295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760700.211248:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520838400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63877us (64221us total) trans 4294971895 rc 0/0
00000100:00100000:1.0:1789760700.211260:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4608
00000100:00100000:1.0:1789760700.211270:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671777191441 time 671834037090 state 0x2 ref 0
00000100:00100000:0.0:1789760700.222666:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520838528
00000100:00100000:0.0:1789760700.222677:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520838528
00000100:00100000:0.0:1789760700.222734:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671777191441 time 671834037090 state 0x0 ref 1
00000100:00100000:0.0:1789760700.222749:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671834297506 time 671834037090 state 0x1 ref 1
00000100:00100000:0.0:1789760700.222782:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671834297506 time 671909464511 state 0x0 ref 1
00000100:00100000:0.0:1789760700.222795:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520838528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760700.222841:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18743296, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:0.0:1789760700.222849:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.222864:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=671s v=(0 0)
00010000:00010000:0.0:1789760700.222868:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760700.222874:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.222886:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760700.253438:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760700.253474:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760700.253500:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760700.253522:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760700.253600:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760700.253628:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520838784
00000100:00100000:1.0:1789760700.253637:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520838784
00000100:00100000:1.0:1789760700.253686:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520839040
00000100:00100000:1.0:1789760700.253689:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520839040
00000100:00100000:1.0:1789760700.253704:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520838912
00000100:00100000:1.0:1789760700.253707:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520838912
00000100:00100000:1.0:1789760700.253718:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520839168
00000100:00100000:1.0:1789760700.253720:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520839168
00000100:00100000:1.0:1789760700.253736:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 793
00000100:00100000:1.0:1789760700.253745:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520838784:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760700.253817:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520838784:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 73us (388us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760700.253825:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 793
00000100:00100000:1.0:1789760700.253843:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 794
00000100:00100000:1.0:1789760700.253849:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520839040:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760700.253873:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520839040:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760700.253879:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 794
00000100:00100000:1.0:1789760700.253890:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 795
00000100:00100000:1.0:1789760700.253895:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520838912:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760700.253918:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520838912:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (395us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760700.253924:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 795
00000100:00100000:1.0:1789760700.253935:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 796
00000100:00100000:1.0:1789760700.253941:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520839168:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760700.253963:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520839168:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760700.253969:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 796
00000100:00100000:1.0:1789760700.253986:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520838656
00000100:00100000:1.0:1789760700.253990:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520838656
00000100:00100000:1.0:1789760700.254015:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 454
00000100:00100000:1.0:1789760700.254021:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda005a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520838656:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760700.254044:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda005a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520838656:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (543us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760700.254060:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 454
00000100:00080000:1.0:1789760700.254089:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1789760700.254093:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000001:00080000:0.0:1789760700.317728:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971896 is committed
00002000:00010000:1.0:1789760700.318016:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18743296 -> 18747392
00010000:00010000:1.0:1789760700.318034:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.318058:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.318068:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.318076:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760700.318080:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.318089:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.318123:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.318132:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b001 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18743296->18747391] (req 18743296->18747391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760700.318224:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520838528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 95427us (96259us total) trans 4294971896 rc 0/0
00000100:00100000:1.0:1789760700.318235:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4609
00000100:00100000:1.0:1789760700.318246:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671834297506 time 671909464511 state 0x2 ref 0
00000100:00100000:1.0:1789760700.333126:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760700.333182:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520839296
00000100:00100000:0.0:1789760700.333193:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520839296
00000100:00100000:0.0:1789760700.333249:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671834297506 time 671909464511 state 0x0 ref 1
00000100:00100000:0.0:1789760700.333264:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671909724927 time 671909464511 state 0x1 ref 1
00000100:00100000:0.0:1789760700.333295:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671909724927 time 672019977976 state 0x0 ref 1
00000100:00100000:0.0:1789760700.333308:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520839296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760700.333383:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18747392, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:0.0:1789760700.333392:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.333407:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:0.0:1789760700.333412:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760700.333418:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.333431:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760700.387535:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18747392 -> 18751488
00010000:00010000:0.0:1789760700.387555:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.387568:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.387589:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.387597:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.387602:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.387612:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.387631:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.387639:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b008 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18747392->18751487] (req 18747392->18751487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.387747:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520839296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54436us (54626us total) trans 4294971897 rc 0/0
00000100:00100000:0.0:1789760700.387758:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4610
00000100:00100000:0.0:1789760700.387767:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671909724927 time 672019977976 state 0x2 ref 0
00000001:00080000:0.0:1789760700.387804:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971897 is committed
00000100:00100000:1.0:1789760700.413125:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520839424
00000100:00100000:1.0:1789760700.413136:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520839424
00000100:00100000:1.0:1789760700.413202:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 671909724927 time 672019977976 state 0x0 ref 1
00000100:00100000:1.0:1789760700.413220:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672020238392 time 672019977976 state 0x1 ref 1
00000100:00100000:1.0:1789760700.413308:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672020238392 time 672099990768 state 0x0 ref 1
00000100:00100000:1.0:1789760700.413368:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520839424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760700.413419:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18751488, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:1.0:1789760700.413428:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.413445:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:1.0:1789760700.413450:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760700.413457:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.413471:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760700.450959:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971898 is committed
00002000:00010000:0.0:1789760700.451107:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18751488 -> 18755584
00010000:00010000:0.0:1789760700.451123:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.451147:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.451268:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.451285:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.451291:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.451301:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.451345:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.451354:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b00f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18751488->18755583] (req 18751488->18755583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.451441:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520839424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38070us (38682us total) trans 4294971898 rc 0/0
00000100:00100000:0.0:1789760700.451451:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4611
00000100:00100000:0.0:1789760700.451474:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672020238392 time 672099990768 state 0x2 ref 0
00000100:00100000:1.0:1789760700.454759:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760700.454881:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520839552
00000100:00100000:2.0:1789760700.454891:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520839552
00000100:00100000:2.0:1789760700.454944:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672020238392 time 672099990768 state 0x0 ref 1
00000100:00100000:2.0:1789760700.454962:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672100251184 time 672099990768 state 0x1 ref 1
00000100:00100000:2.0:1789760700.455022:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672100251184 time 672141703079 state 0x0 ref 1
00000100:00100000:2.0:1789760700.455035:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520839552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760700.455093:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18755584, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:2.0:1789760700.455102:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.455119:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:2.0:1789760700.455123:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760700.455129:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.455835:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760700.489719:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971899 is committed
00002000:00010000:1.0:1789760700.489877:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18755584 -> 18759680
00010000:00010000:1.0:1789760700.489892:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.489905:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.489913:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.489920:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760700.489924:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.489933:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.489952:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.489959:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b016 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18755584->18759679] (req 18755584->18759679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760700.490062:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520839552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35024us (35309us total) trans 4294971899 rc 0/0
00000100:00100000:1.0:1789760700.490072:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4612
00000100:00100000:1.0:1789760700.490081:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672100251184 time 672141703079 state 0x2 ref 0
00000100:00100000:1.0:1789760700.496480:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760700.496657:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520839680
00000100:00100000:0.0:1789760700.496667:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520839680
00000100:00100000:0.0:1789760700.496725:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672100251184 time 672141703079 state 0x0 ref 1
00000100:00100000:0.0:1789760700.496741:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672141963495 time 672141703079 state 0x1 ref 1
00000100:00100000:0.0:1789760700.496772:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672141963495 time 672183455247 state 0x0 ref 1
00000100:00100000:0.0:1789760700.496788:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520839680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760700.496839:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18759680, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:0.0:1789760700.496849:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.496864:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:0.0:1789760700.496869:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760700.496877:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.496891:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760700.531225:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971900 is committed
00002000:00010000:0.0:1789760700.531297:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18759680 -> 18763776
00010000:00010000:0.0:1789760700.531337:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.531352:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.531361:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.531369:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.531374:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.531384:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.531404:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.531411:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b01d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18759680->18763775] (req 18759680->18763775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.531500:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520839680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34709us (35026us total) trans 4294971900 rc 0/0
00000100:00100000:0.0:1789760700.531510:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4613
00000100:00100000:0.0:1789760700.531519:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672141963495 time 672183455247 state 0x2 ref 0
00000100:00100000:0.0:1789760700.537557:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1789760700.537590:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548734208:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1789760700.537656:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1789760700.538266:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760700.538341:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548734208:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1789760700.542790:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760700.542912:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520839808
00000100:00100000:1.0:1789760700.542922:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520839808
00000100:00100000:1.0:1789760700.542978:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672141963495 time 672183455247 state 0x0 ref 1
00000100:00100000:1.0:1789760700.542994:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672183715663 time 672183455247 state 0x1 ref 1
00000100:00100000:1.0:1789760700.543026:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672183715663 time 672229708671 state 0x0 ref 1
00000100:00100000:1.0:1789760700.543039:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520839808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760700.543097:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18763776, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:1.0:1789760700.543107:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.543124:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:1.0:1789760700.543129:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760700.543136:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.543150:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.545688:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548734336
00000100:00100000:0.0:1789760700.545699:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548734336
00000100:00100000:0.0:1789760700.545758:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327
00000100:00100000:0.0:1789760700.545767:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548734336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1789760700.545789:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527892480 pending 1703936 free 3839885312 avail 3816816640
00000100:00100000:0.0:1789760700.545859:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548734336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (1583us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760700.545866:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327
00000100:00100000:0.0:1789760700.546345:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548734336:0@lo:13:osp-pre-0-1.0
00000100:00080000:2.0:1789760700.548330:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:2.0:1789760700.606846:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971901 is committed
00002000:00010000:0.0:1789760700.607090:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18763776 -> 18767872
00010000:00010000:0.0:1789760700.607105:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.607117:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.607126:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.607144:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.607148:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.607157:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.607176:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.607183:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b024 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18763776->18767871] (req 18763776->18767871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.607273:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520839808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64231us (64487us total) trans 4294971901 rc 0/0
00000100:00100000:0.0:1789760700.607285:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4614
00000100:00100000:0.0:1789760700.607294:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672183715663 time 672229708671 state 0x2 ref 0
00000100:00100000:0.0:1789760700.610336:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760700.611080:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520839936
00000100:00100000:1.0:1789760700.611091:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520839936
00000100:00100000:1.0:1789760700.612442:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672183715663 time 672229708671 state 0x0 ref 1
00000100:00100000:1.0:1789760700.612460:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672229969087 time 672229708671 state 0x1 ref 1
00000100:00100000:0.0:1789760700.615466:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672229969087 time 672302135607 state 0x0 ref 1
00000100:00100000:0.0:1789760700.615497:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520839936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760700.615557:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18767872, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:0.0:1789760700.615567:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.615582:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:0.0:1789760700.615587:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760700.615593:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.615607:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760700.691179:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18767872 -> 18771968
00010000:00010000:0.0:1789760700.691195:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.691207:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.691220:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.691227:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.691232:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.691240:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.691260:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.691267:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b02b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18767872->18771967] (req 18767872->18771967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760700.701512:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760700.701665:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520840064
00000100:00100000:2.0:1789760700.701674:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520840064
00000100:00100000:2.0:1789760700.701727:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672229969087 time 672302135607 state 0x0 ref 1
00000100:00100000:2.0:1789760700.701745:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672302396023 time 672302135607 state 0x1 ref 1
00000100:00100000:2.0:1789760700.701775:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672302396023 time 672388457856 state 0x0 ref 1
00000100:00100000:2.0:1789760700.701787:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520840064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760700.701829:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18771968, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:2.0:1789760700.701839:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.701855:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:2.0:1789760700.701860:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760700.701866:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.701879:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760700.802637:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18771968 -> 18776064
00010000:00010000:0.0:1789760700.802658:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.802673:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.802700:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.802714:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.802719:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.802730:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.802753:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.802762:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b032 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18771968->18776063] (req 18771968->18776063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.802889:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520840064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 101096us (101380us total) trans 4294971903 rc 0/0
00000100:00100000:0.0:1789760700.802901:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4616
00000100:00100000:0.0:1789760700.802914:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672302396023 time 672388457856 state 0x2 ref 0
00000100:00100000:0.0:1789760700.810375:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760700.810529:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520840192
00000100:00100000:2.0:1789760700.810537:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520840192
00000100:00100000:2.0:1789760700.810581:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672302396023 time 672388457856 state 0x0 ref 1
00000100:00100000:2.0:1789760700.810591:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672388718272 time 672388457856 state 0x1 ref 1
00000100:00100000:2.0:1789760700.810614:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672388718272 time 672497297843 state 0x0 ref 1
00000100:00100000:2.0:1789760700.810621:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520840192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760700.810657:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18776064, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:2.0:1789760700.810664:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.810677:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:2.0:1789760700.810680:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760700.810684:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.810693:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760700.845938:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18776064 -> 18780160
00010000:00010000:2.0:1789760700.845959:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.845972:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.845982:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.845989:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760700.845994:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.846002:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.846021:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.846030:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b039 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18776064->18780159] (req 18776064->18780159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760700.847226:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520840192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36596us (36850us total) trans 4294971904 rc 0/0
00000100:00100000:2.0:1789760700.847241:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4617
00000100:00100000:2.0:1789760700.847251:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672388718272 time 672497297843 state 0x2 ref 0
00000100:00100000:1.0:1789760700.853977:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760700.854117:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520840320
00000100:00100000:2.0:1789760700.854130:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520840320
00000100:00100000:2.0:1789760700.854208:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672388718272 time 672497297843 state 0x0 ref 1
00000100:00100000:2.0:1789760700.854230:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672497558259 time 672497297843 state 0x1 ref 1
00000100:00100000:2.0:1789760700.854307:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672497558259 time 672540989341 state 0x0 ref 1
00000100:00100000:2.0:1789760700.854362:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520840320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760700.854429:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18780160, mtime: 0x6aad94bd, atime: 0x0, ctime: 0x6aad94bd, blocks: 0x9007
00010000:00010000:2.0:1789760700.854441:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.854460:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:2.0:1789760700.854466:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760700.854474:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.854492:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760700.909516:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18780160 -> 18784256
00002000:00010000:2.0:1789760700.909522:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760701 -> 1789760702
00002000:00010000:2.0:1789760700.909525:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760701 -> 1789760702
00010000:00010000:2.0:1789760700.909545:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.909562:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.909582:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.909592:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760700.909597:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.909608:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.909633:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760700.909642:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b040 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18780160->18784255] (req 18780160->18784255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760700.909778:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520840320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55411us (55809us total) trans 4294971905 rc 0/0
00000100:00100000:2.0:1789760700.909792:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4618
00000100:00100000:2.0:1789760700.909807:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672497558259 time 672540989341 state 0x2 ref 0
00000100:00100000:1.0:1789760700.913739:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760700.954133:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971906 is committed
00002000:00010000:0.0:1789760700.954477:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18784256 -> 18788352
00010000:00010000:0.0:1789760700.954501:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b047 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18784256->18788351] (req 18784256->18788351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.954517:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b047 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18784256->18788351] (req 18784256->18788351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.954533:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b047 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18784256->18788351] (req 18784256->18788351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.954541:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760700.954548:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b047 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18784256->18788351] (req 18784256->18788351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.954557:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b047 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18784256->18788351] (req 18784256->18788351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.954649:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b047 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18784256->18788351] (req 18784256->18788351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.954660:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b047 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18784256->18788351] (req 18784256->18788351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760700.954791:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520840448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40761us (41122us total) trans 4294971906 rc 0/0
00000100:00100000:0.0:1789760700.954803:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4619
00000100:00100000:0.0:1789760700.954816:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672541249757 time 672600692211 state 0x2 ref 0
00000100:00100000:0.0:1789760700.960972:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760700.961153:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520840576
00000100:00100000:1.0:1789760700.961167:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520840576
00000100:00100000:1.0:1789760700.961249:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672541249757 time 672600692211 state 0x0 ref 1
00000100:00100000:1.0:1789760700.961269:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672600952627 time 672600692211 state 0x1 ref 1
00000100:00100000:1.0:1789760700.961311:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672600952627 time 672647993115 state 0x0 ref 1
00000100:00100000:1.0:1789760700.961370:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520840576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760700.961439:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18788352, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:1.0:1789760700.961452:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.961473:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:1.0:1789760700.961479:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760700.961488:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760700.961506:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760700.988108:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1789760701.004302:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18788352 -> 18792448
00010000:00010000:0.0:1789760701.004404:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.004422:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.004432:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.004440:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760701.004446:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.004456:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.004480:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.004488:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b04e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18788352->18792447] (req 18788352->18792447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760701.004850:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520840576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43474us (43888us total) trans 4294971907 rc 0/0
00000100:00100000:1.0:1789760701.004864:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4620
00000100:00100000:1.0:1789760701.004878:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672600952627 time 672647993115 state 0x2 ref 0
00000100:00100000:1.0:1789760701.007902:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760701.008010:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520840704
00000100:00100000:2.0:1789760701.008023:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520840704
00000100:00100000:2.0:1789760701.008107:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672600952627 time 672647993115 state 0x0 ref 1
00000100:00100000:2.0:1789760701.008126:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672648253531 time 672647993115 state 0x1 ref 1
00000100:00100000:2.0:1789760701.008155:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672648253531 time 672694837781 state 0x0 ref 1
00000100:00100000:2.0:1789760701.008168:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520840704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760701.008233:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18792448, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:2.0:1789760701.008243:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.008264:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:2.0:1789760701.008269:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760701.008277:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.008297:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760701.038949:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18792448 -> 18796544
00010000:00010000:0.0:1789760701.038969:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.038981:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.038993:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.038999:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760701.039002:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.039009:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.039028:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.039034:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b055 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18792448->18796543] (req 18792448->18796543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760701.039191:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520840704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31019us (31299us total) trans 4294971908 rc 0/0
00000100:00100000:0.0:1789760701.039201:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4621
00000100:00100000:0.0:1789760701.039211:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672648253531 time 672694837781 state 0x2 ref 0
00000100:00100000:0.0:1789760701.042411:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760701.042953:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520840832
00000100:00100000:2.0:1789760701.042967:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520840832
00000100:00100000:2.0:1789760701.043055:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672648253531 time 672694837781 state 0x0 ref 1
00000100:00100000:2.0:1789760701.043074:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672695098197 time 672694837781 state 0x1 ref 1
00000100:00100000:2.0:1789760701.043108:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672695098197 time 672729790460 state 0x0 ref 1
00000100:00100000:2.0:1789760701.043123:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520840832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760701.043185:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18796544, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:2.0:1789760701.043196:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b05c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.043217:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:2.0:1789760701.043223:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760701.043230:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b05c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18796544->18800639] (req 18796544->18800639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.043247:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b05c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18796544->18800639] (req 18796544->18800639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760701.075154:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971909 is committed
00000100:00100000:2.0:1789760701.078916:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760701.079025:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520840960
00000100:00100000:0.0:1789760701.079037:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520840960
00000100:00100000:0.0:1789760701.079119:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672695098197 time 672729790460 state 0x0 ref 1
00000100:00100000:0.0:1789760701.079138:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672730050876 time 672729790460 state 0x1 ref 1
00000100:00100000:0.0:1789760701.079207:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672730050876 time 672765888934 state 0x0 ref 1
00000100:00100000:0.0:1789760701.079222:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520840960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760701.079292:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18800640, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:0.0:1789760701.079303:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.079367:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:0.0:1789760701.079373:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760701.079381:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.079399:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760701.108421:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971910 is committed
00002000:00010000:2.0:1789760701.108558:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18800640 -> 18804736
00010000:00010000:2.0:1789760701.108590:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.108607:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.108617:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.108624:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760701.108629:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.108638:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.108663:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.108680:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b063 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18800640->18804735] (req 18800640->18804735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760701.108802:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520840960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29576us (29893us total) trans 4294971910 rc 0/0
00000100:00100000:2.0:1789760701.108816:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4623
00000100:00100000:2.0:1789760701.108829:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672730050876 time 672765888934 state 0x2 ref 0
00000100:00100000:0.0:1789760701.112525:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760701.112750:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520841088
00000100:00100000:1.0:1789760701.112764:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520841088
00000100:00100000:1.0:1789760701.112836:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672730050876 time 672765888934 state 0x0 ref 1
00000100:00100000:1.0:1789760701.112856:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672766149350 time 672765888934 state 0x1 ref 1
00000100:00100000:1.0:1789760701.112934:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672766149350 time 672799615363 state 0x0 ref 1
00000100:00100000:1.0:1789760701.112949:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760701.113017:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18804736, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:1.0:1789760701.113029:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.113062:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:1.0:1789760701.113067:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760701.113076:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.113093:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760701.143393:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971911 is committed
00002000:00010000:2.0:1789760701.143448:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18804736 -> 18808832
00010000:00010000:2.0:1789760701.143471:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.143487:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.143496:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.143505:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760701.143510:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.143520:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.143545:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.143556:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b06a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18804736->18808831] (req 18804736->18808831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760701.143817:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30860us (31298us total) trans 4294971911 rc 0/0
00000100:00100000:2.0:1789760701.143831:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4624
00000100:00100000:2.0:1789760701.143882:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672766149350 time 672799615363 state 0x2 ref 0
00000100:00100000:0.0:1789760701.146642:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760701.146756:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520841216
00000100:00100000:2.0:1789760701.146769:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520841216
00000100:00100000:2.0:1789760701.146840:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672766149350 time 672799615363 state 0x0 ref 1
00000100:00100000:2.0:1789760701.146858:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672799875779 time 672799615363 state 0x1 ref 1
00000100:00100000:2.0:1789760701.146895:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672799875779 time 672833577118 state 0x0 ref 1
00000100:00100000:2.0:1789760701.146909:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520841216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760701.146971:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18808832, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:2.0:1789760701.146981:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.147000:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=672s v=(0 0)
00010000:00010000:2.0:1789760701.147006:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760701.147013:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.147030:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760701.167533:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971912 is committed
00002000:00010000:0.0:1789760701.167661:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18808832 -> 18812928
00010000:00010000:0.0:1789760701.167682:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.167705:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.167716:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.167725:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760701.167730:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.167741:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.167765:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.167774:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b071 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18808832->18812927] (req 18808832->18812927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760701.167893:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520841216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 20979us (21317us total) trans 4294971912 rc 0/0
00000100:00100000:0.0:1789760701.167907:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4625
00000100:00100000:0.0:1789760701.167920:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672799875779 time 672833577118 state 0x2 ref 0
00000100:00100000:0.0:1789760701.171416:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:0.0:1789760701.285791:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971913 is committed
00002000:00010000:1.0:1789760701.285916:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18812928 -> 18817024
00010000:00010000:1.0:1789760701.285935:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b078 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18812928->18817023] (req 18812928->18817023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.285951:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b078 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18812928->18817023] (req 18812928->18817023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.285961:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b078 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18812928->18817023] (req 18812928->18817023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.285970:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760701.285975:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b078 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18812928->18817023] (req 18812928->18817023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.285985:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b078 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18812928->18817023] (req 18812928->18817023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.286014:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b078 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18812928->18817023] (req 18812928->18817023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.286023:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b078 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18812928->18817023] (req 18812928->18817023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760701.286161:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 114378us (114754us total) trans 4294971913 rc 0/0
00000100:00100000:1.0:1789760701.286175:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4626
00000100:00100000:1.0:1789760701.286187:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672833837534 time 672858446441 state 0x2 ref 0
00000100:00100000:1.0:1789760701.299011:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:0.0:1789760701.399766:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971914 is committed
00000100:00100000:2.0:1789760701.400904:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 101519us (101901us total) trans 4294971914 rc 0/0
00000100:00100000:2.0:1789760701.400919:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4627
00000100:00100000:2.0:1789760701.400931:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672858706857 time 672986046189 state 0x2 ref 0
00000100:00100000:0.0:1789760701.408601:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760701.408769:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520841600
00000100:00100000:2.0:1789760701.408784:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520841600
00000100:00100000:2.0:1789760701.408860:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672858706857 time 672986046189 state 0x0 ref 1
00000100:00100000:2.0:1789760701.408880:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672986306605 time 672986046189 state 0x1 ref 1
00000100:00100000:2.0:1789760701.408916:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672986306605 time 673095598318 state 0x0 ref 1
00000100:00100000:2.0:1789760701.408931:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760701.409006:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18821120, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:2.0:1789760701.409017:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.409054:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=673s v=(0 0)
00010000:00010000:2.0:1789760701.409061:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760701.409069:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.409087:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760701.513937:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971915 is committed
00002000:00010000:1.0:1789760701.519975:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18821120 -> 18825216
00010000:00010000:1.0:1789760701.520004:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.520018:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.520028:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.520053:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760701.520059:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.520070:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.520097:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.520106:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b086 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18821120->18825215] (req 18821120->18825215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760701.520249:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 111313us (111656us total) trans 4294971915 rc 0/0
00000100:00100000:1.0:1789760701.520262:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4628
00000100:00100000:1.0:1789760701.521062:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672986306605 time 673095598318 state 0x2 ref 0
00000100:00100000:0.0:1789760701.527684:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760701.527804:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520841728
00000100:00100000:2.0:1789760701.527816:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520841728
00000100:00100000:2.0:1789760701.527885:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 672986306605 time 673095598318 state 0x0 ref 1
00000100:00100000:2.0:1789760701.527904:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673095858734 time 673095598318 state 0x1 ref 1
00000100:00100000:2.0:1789760701.527945:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673095858734 time 673214627771 state 0x0 ref 1
00000100:00100000:2.0:1789760701.527959:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520841728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760701.528024:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18825216, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:2.0:1789760701.528051:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.528070:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=673s v=(0 0)
00010000:00010000:2.0:1789760701.528075:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760701.528083:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.528100:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760701.561613:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548734464:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760701.561712:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760701.561808:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548734464
00000100:00100000:0.0:1789760701.561818:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548734464
00000100:00100000:0.0:1789760701.561891:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328
00000100:00100000:0.0:1789760701.561903:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548734464:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1789760701.561951:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760701.562001:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548734464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (290us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760701.562009:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328
00000100:00080000:2.0:1789760701.562063:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1789760701.562074:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548734464:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1789760701.562108:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548734592:0@lo:13:osp-pre-1-0.0
00000100:00100000:2.0:1789760701.562140:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760701.562190:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1789760701.562197:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548734720:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.562229:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760701.562253:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548735104:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.562289:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760701.562310:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548735616:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.562350:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760701.562370:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:2.0:1789760701.562375:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548735232:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.562395:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760701.562412:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548735744:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.562429:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760701.562459:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548734720
00000100:00100000:2.0:1789760701.562463:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548734720
00000100:00100000:2.0:1789760701.562492:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455
00000100:00100000:1.0:1789760701.562622:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548735104
00000100:00100000:1.0:1789760701.562626:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548735104
00000100:00100000:1.0:1789760701.562647:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548735488
00000100:00100000:1.0:1789760701.562650:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548735488
00000100:00100000:1.0:1789760701.562682:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548736000
00000100:00100000:1.0:1789760701.562684:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548736000
00000100:00100000:1.0:1789760701.562697:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548735360
00000100:00100000:1.0:1789760701.562698:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548735360
00000100:00100000:1.0:1789760701.562711:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797
00000100:00100000:1.0:1789760701.562717:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548735104:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760701.562953:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548734592
00000100:00100000:0.0:1789760701.562958:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548734592
00000100:00100000:2.0:1789760701.562969:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda005a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548734720:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760701.562987:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329
00000100:00100000:0.0:1789760701.562998:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548734592:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:0.0:1789760701.563011:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760701.565777:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548735104:12345-0@lo:400:kworker.0 Request processed in 3049us (3475us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760701.565791:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797
00000100:00080000:1.0:1789760701.565874:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1789760701.565882:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:1.0:1789760701.565886:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1789760701.565975:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548735616
00000100:00100000:1.0:1789760701.565986:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548735616
00000100:00100000:1.0:1789760701.566047:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548735744
00000100:00100000:1.0:1789760701.566051:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548735744
00000100:00100000:1.0:1789760701.566073:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259
00000100:00100000:1.0:1789760701.566081:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548735616:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760701.566152:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548735616:12345-0@lo:400:kworker.0 Request processed in 72us (3800us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760701.566158:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259
00000100:00100000:1.0:1789760701.566170:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260
00000100:00100000:1.0:1789760701.566176:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548735744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760701.566206:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548735744:12345-0@lo:400:kworker.0 Request processed in 30us (3775us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760701.566213:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260
00000100:00100000:2.0:1789760701.566353:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda005a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548734720:12345-0@lo:400:kworker.0 Request processed in 3383us (4120us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760701.566364:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455
00000100:00100000:2.0:1789760701.566630:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548735232:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.566651:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548735744:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.566666:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548735104:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.566750:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548735616:0@lo:400:kworker.0
00000100:00100000:2.0:1789760701.566762:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548734720:0@lo:400:kworker.0
00000100:00100000:0.0:1789760701.566981:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548734592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3986us (4838us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760701.566992:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329
00002000:00010000:0.0:1789760701.609374:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18825216 -> 18829312
00010000:00010000:0.0:1789760701.609404:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.609422:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.609433:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.609442:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760701.609449:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.609461:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760701.609497:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971916 is committed
00010000:00010000:0.0:1789760701.609503:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.609516:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b08d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18825216->18829311] (req 18825216->18829311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760701.609653:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520841728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 81689us (81977us total) trans 4294971916 rc 0/0
00000100:00100000:0.0:1789760701.609678:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4629
00000100:00100000:0.0:1789760701.609691:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673095858734 time 673214627771 state 0x2 ref 0
00000100:00100000:1.0:1789760701.613245:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520841856
00000100:00100000:1.0:1789760701.613255:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520841856
00000100:00100000:1.0:1789760701.613310:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673095858734 time 673214627771 state 0x0 ref 1
00000100:00100000:1.0:1789760701.613365:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673214888187 time 673214627771 state 0x1 ref 1
00000100:00100000:1.0:1789760701.613390:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673214888187 time 673300073008 state 0x0 ref 1
00000100:00100000:1.0:1789760701.613403:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760701.613452:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18829312, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:1.0:1789760701.613463:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.613481:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=673s v=(0 0)
00010000:00010000:1.0:1789760701.613486:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760701.613493:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.613508:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760701.667065:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971917 is committed
00002000:00010000:1.0:1789760701.669900:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18829312 -> 18833408
00010000:00010000:1.0:1789760701.670706:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.670728:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.670737:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.670744:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760701.670748:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.670757:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.670778:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.670787:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b094 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18829312->18833407] (req 18829312->18833407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760701.670904:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57496us (57764us total) trans 4294971917 rc 0/0
00000100:00100000:1.0:1789760701.671006:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4630
00000100:00100000:1.0:1789760701.671015:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673214888187 time 673300073008 state 0x2 ref 0
00000100:00100000:1.0:1789760701.674724:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760701.674815:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520841984
00000100:00100000:0.0:1789760701.674826:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520841984
00000100:00100000:0.0:1789760701.674885:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673214888187 time 673300073008 state 0x0 ref 1
00000100:00100000:0.0:1789760701.674902:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673300333424 time 673300073008 state 0x1 ref 1
00000100:00100000:0.0:1789760701.674944:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673300333424 time 673361625806 state 0x0 ref 1
00000100:00100000:0.0:1789760701.674957:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520841984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760701.675008:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18833408, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:0.0:1789760701.675017:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.675033:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=673s v=(0 0)
00010000:00010000:0.0:1789760701.675048:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760701.675055:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.675069:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760701.724394:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18833408 -> 18837504
00010000:00010000:2.0:1789760701.724414:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.724427:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.724440:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.724447:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760701.724451:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.724459:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.724480:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.724489:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b09b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18833408->18837503] (req 18833408->18837503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760701.724594:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520841984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49635us (49875us total) trans 4294971918 rc 0/0
00000100:00100000:2.0:1789760701.724605:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4631
00000100:00100000:2.0:1789760701.724614:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673300333424 time 673361625806 state 0x2 ref 0
00000001:00080000:2.0:1789760701.724655:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971918 is committed
00000100:00100000:0.0:1789760701.734460:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760701.734972:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520842112
00000100:00100000:2.0:1789760701.734982:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520842112
00000100:00100000:2.0:1789760701.735044:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673300333424 time 673361625806 state 0x0 ref 1
00000100:00100000:2.0:1789760701.735063:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673361886222 time 673361625806 state 0x1 ref 1
00000100:00100000:1.0:1789760701.735192:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673361886222 time 673421871891 state 0x0 ref 1
00000100:00100000:1.0:1789760701.735208:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520842112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760701.735256:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18837504, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:1.0:1789760701.735265:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.735280:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=673s v=(0 0)
00010000:00010000:1.0:1789760701.735285:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760701.735291:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.735305:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760701.793701:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971919 is committed
00002000:00010000:0.0:1789760701.797392:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18837504 -> 18841600
00010000:00010000:0.0:1789760701.797412:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.797426:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.797442:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.797450:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760701.797455:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.797464:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.797484:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.797492:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b0a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18837504->18841599] (req 18837504->18841599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760701.797617:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520842112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62400us (63154us total) trans 4294971919 rc 0/0
00000100:00100000:0.0:1789760701.797629:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4632
00000100:00100000:0.0:1789760701.797639:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673361886222 time 673421871891 state 0x2 ref 0
00000100:00100000:0.0:1789760701.803385:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760701.803939:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520842240
00000100:00100000:2.0:1789760701.803949:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520842240
00000100:00100000:2.0:1789760701.804000:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673361886222 time 673421871891 state 0x0 ref 1
00000100:00100000:2.0:1789760701.804015:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673422132307 time 673421871891 state 0x1 ref 1
00000100:00100000:2.0:1789760701.804150:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673422132307 time 673490739139 state 0x0 ref 1
00000100:00100000:2.0:1789760701.804166:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520842240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760701.804214:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18841600, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:2.0:1789760701.804224:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.804240:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=673s v=(0 0)
00010000:00010000:2.0:1789760701.804245:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760701.804250:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760701.804265:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760701.984527:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971920 is committed
00002000:00010000:0.0:1789760701.984686:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18841600 -> 18845696
00010000:00010000:0.0:1789760701.984706:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.984728:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.984738:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.984746:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760701.984752:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.984763:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.984790:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760701.984798:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b0a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18841600->18845695] (req 18841600->18845695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760701.984938:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520842240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 180767us (181553us total) trans 4294971920 rc 0/0
00000100:00100000:0.0:1789760701.984950:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4633
00000100:00100000:0.0:1789760701.985392:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673422132307 time 673490739139 state 0x2 ref 0
00000100:00100000:2.0:1789760701.992836:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760701.993024:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520842368
00000100:00100000:1.0:1789760701.993048:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520842368
00000100:00100000:1.0:1789760701.993185:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673422132307 time 673490739139 state 0x0 ref 1
00000100:00100000:1.0:1789760701.993205:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673490999555 time 673490739139 state 0x1 ref 1
00000100:00100000:1.0:1789760701.993242:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673490999555 time 673679923651 state 0x0 ref 1
00000100:00100000:1.0:1789760701.993256:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520842368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760701.993363:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18845696, mtime: 0x6aad94be, atime: 0x0, ctime: 0x6aad94be, blocks: 0x9007
00010000:00010000:1.0:1789760701.993373:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.993401:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=673s v=(0 0)
00010000:00010000:1.0:1789760701.993407:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760701.993415:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760701.993432:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760702.128896:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18845696 -> 18849792
00002000:00010000:2.0:1789760702.128905:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760702 -> 1789760703
00002000:00010000:2.0:1789760702.128908:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760702 -> 1789760703
00010000:00010000:2.0:1789760702.128922:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.128935:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.128944:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.128952:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760702.128956:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.128965:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.128985:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.128994:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b0b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18845696->18849791] (req 18845696->18849791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760702.129120:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520842368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 135854us (136288us total) trans 4294971921 rc 0/0
00000100:00100000:2.0:1789760702.129134:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4634
00000100:00100000:2.0:1789760702.129143:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673490999555 time 673679923651 state 0x2 ref 0
00000100:00100000:0.0:1789760702.154840:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520842496
00000100:00100000:0.0:1789760702.154855:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520842496
00000100:00080000:1.0:1789760702.154936:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760702.154938:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673490999555 time 673679923651 state 0x0 ref 1
00000100:00100000:0.0:1789760702.154958:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673680184067 time 673679923651 state 0x1 ref 1
00000100:00100000:0.0:1789760702.155069:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673680184067 time 673841750863 state 0x0 ref 1
00000100:00100000:0.0:1789760702.155084:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520842496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760702.155167:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18849792, mtime: 0x6aad94bf, atime: 0x0, ctime: 0x6aad94bf, blocks: 0x9007
00010000:00010000:0.0:1789760702.155178:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.155194:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=673s v=(0 0)
00010000:00010000:0.0:1789760702.155198:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760702.155204:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.155219:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760702.349762:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971922 is committed
00002000:00010000:0.0:1789760702.350883:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18849792 -> 18853888
00010000:00010000:0.0:1789760702.350918:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.350935:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.350951:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.350960:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760702.350965:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.350975:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.351003:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.351013:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b0b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18849792->18853887] (req 18849792->18853887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760702.351392:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520842496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 196296us (200397us total) trans 4294971922 rc 0/0
00000100:00100000:0.0:1789760702.351405:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4635
00000100:00100000:0.0:1789760702.351417:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673680184067 time 673841750863 state 0x2 ref 0
00000100:00100000:0.0:1789760702.365182:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760702.365568:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520842624
00000100:00100000:1.0:1789760702.365583:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520842624
00000100:00100000:1.0:1789760702.365663:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673680184067 time 673841750863 state 0x0 ref 1
00000100:00100000:1.0:1789760702.365683:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673842011279 time 673841750863 state 0x1 ref 1
00000100:00100000:1.0:1789760702.365721:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673842011279 time 674052403019 state 0x0 ref 1
00000100:00100000:1.0:1789760702.365736:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520842624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760702.365806:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18853888, mtime: 0x6aad94bf, atime: 0x0, ctime: 0x6aad94bf, blocks: 0x9007
00010000:00010000:1.0:1789760702.365818:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.365839:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:1.0:1789760702.365844:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760702.365852:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.365871:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760702.472832:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18853888 -> 18857984
00010000:00010000:2.0:1789760702.472849:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.472861:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.472871:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.472879:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760702.472884:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.472893:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.472911:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.472919:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b0be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18853888->18857983] (req 18853888->18857983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760702.473762:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520842624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 108023us (108590us total) trans 4294971923 rc 0/0
00000100:00100000:2.0:1789760702.473775:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4636
00000100:00100000:2.0:1789760702.473785:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673842011279 time 674052403019 state 0x2 ref 0
00000100:00100000:2.0:1789760702.477813:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760702.477936:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520842752
00000100:00100000:0.0:1789760702.477946:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520842752
00000100:00100000:0.0:1789760702.478009:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 673842011279 time 674052403019 state 0x0 ref 1
00000100:00100000:0.0:1789760702.478028:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674052663435 time 674052403019 state 0x1 ref 1
00000100:00100000:0.0:1789760702.478069:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674052663435 time 674164751410 state 0x0 ref 1
00000100:00100000:0.0:1789760702.478083:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520842752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760702.478131:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18857984, mtime: 0x6aad94bf, atime: 0x0, ctime: 0x6aad94bf, blocks: 0x9007
00010000:00010000:0.0:1789760702.478140:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.478161:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:0.0:1789760702.478166:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760702.478173:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.478187:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760702.510578:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18857984 -> 18862080
00010000:00010000:0.0:1789760702.510593:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.510606:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.510733:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.510748:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760702.510753:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.510763:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.510782:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.510790:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b0c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18857984->18862079] (req 18857984->18862079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760702.510886:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520842752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32800us (33078us total) trans 4294971924 rc 0/0
00000100:00100000:0.0:1789760702.510898:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4637
00000100:00100000:0.0:1789760702.510906:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674052663435 time 674164751410 state 0x2 ref 0
00000100:00100000:0.0:1789760702.518717:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760702.520100:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520842880
00000100:00100000:2.0:1789760702.520112:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520842880
00000100:00100000:2.0:1789760702.520169:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674052663435 time 674164751410 state 0x0 ref 1
00000100:00100000:2.0:1789760702.520184:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674165011826 time 674164751410 state 0x1 ref 1
00000100:00100000:2.0:1789760702.520580:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674165011826 time 674206892337 state 0x0 ref 1
00000100:00100000:2.0:1789760702.520599:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520842880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760702.520654:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18862080, mtime: 0x6aad94bf, atime: 0x0, ctime: 0x6aad94bf, blocks: 0x9007
00010000:00010000:2.0:1789760702.520664:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.520679:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:2.0:1789760702.520683:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760702.520689:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.520702:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760702.597503:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971925 is committed
00002000:00010000:1.0:1789760702.597631:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18862080 -> 18866176
00010000:00010000:1.0:1789760702.597647:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.597660:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.597670:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.597678:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760702.597684:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.597693:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.597713:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.597722:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b0cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18862080->18866175] (req 18862080->18866175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760702.597832:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520842880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 77233us (79120us total) trans 4294971925 rc 0/0
00000100:00100000:1.0:1789760702.597842:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4638
00000100:00100000:1.0:1789760702.597852:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674165011826 time 674206892337 state 0x2 ref 0
00000100:00100000:0.0:1789760702.615405:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760702.615712:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520843008
00000100:00100000:2.0:1789760702.615721:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520843008
00000100:00100000:2.0:1789760702.615778:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674165011826 time 674206892337 state 0x0 ref 1
00000100:00100000:2.0:1789760702.615794:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674207152753 time 674206892337 state 0x1 ref 1
00000100:00100000:2.0:1789760702.615827:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674207152753 time 674302509299 state 0x0 ref 1
00000100:00100000:2.0:1789760702.615840:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520843008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760702.615891:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18866176, mtime: 0x6aad94bf, atime: 0x0, ctime: 0x6aad94bf, blocks: 0x9007
00010000:00010000:2.0:1789760702.615900:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b0d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.615916:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:2.0:1789760702.615920:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760702.615927:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b0d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18866176->18870271] (req 18866176->18870271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760702.615939:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b0d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18866176->18870271] (req 18866176->18870271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760702.707731:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971926 is committed
00000100:00100000:2.0:1789760702.716936:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760702.717055:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520843136
00000100:00100000:0.0:1789760702.717065:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520843136
00000100:00100000:0.0:1789760702.717126:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674207152753 time 674302509299 state 0x0 ref 1
00000100:00100000:0.0:1789760702.717142:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674302769715 time 674302509299 state 0x1 ref 1
00000100:00100000:0.0:1789760702.717176:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674302769715 time 674403858632 state 0x0 ref 1
00000100:00100000:0.0:1789760702.717189:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520843136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760702.717239:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18870272, mtime: 0x6aad94bf, atime: 0x0, ctime: 0x6aad94bf, blocks: 0x9007
00010000:00010000:0.0:1789760702.717248:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.717265:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:0.0:1789760702.717270:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760702.717277:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.717291:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760702.788042:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971927 is committed
00002000:00010000:0.0:1789760702.793061:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18870272 -> 18874368
00010000:00010000:0.0:1789760702.793098:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.793113:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.793122:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.793130:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760702.793136:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.793145:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.793163:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.793172:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18870272->18874367] (req 18870272->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760702.793295:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520843136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76102us (76363us total) trans 4294971927 rc 0/0
00000100:00100000:0.0:1789760702.793307:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4640
00000100:00100000:0.0:1789760702.793350:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674302769715 time 674403858632 state 0x2 ref 0
00000100:00100000:2.0:1789760702.803958:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760702.804214:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520843264
00000100:00100000:0.0:1789760702.804225:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520843264
00000100:00100000:0.0:1789760702.804285:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674302769715 time 674403858632 state 0x0 ref 1
00000100:00100000:0.0:1789760702.804302:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674404119048 time 674403858632 state 0x1 ref 1
00000001:00080000:2.0:1789760702.869745:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971928 is committed
00000100:00100000:1.0:1789760702.880932:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520843392
00000100:00100000:1.0:1789760702.880945:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520843392
00000100:00100000:1.0:1789760702.881020:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674404119048 time 674491166146 state 0x0 ref 1
00000100:00100000:1.0:1789760702.881049:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674491426562 time 674491166146 state 0x1 ref 1
00000100:00100000:1.0:1789760702.881083:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674491426562 time 674567765358 state 0x0 ref 1
00000100:00100000:1.0:1789760702.881097:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520843392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760702.881161:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18878464, mtime: 0x6aad94bf, atime: 0x0, ctime: 0x6aad94bf, blocks: 0x9807
00010000:00010000:1.0:1789760702.881173:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.881193:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:1.0:1789760702.881198:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760702.881206:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.881222:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760702.918674:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18878464 -> 18882560
00002000:00010000:1.0:1789760702.918679:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760703 -> 1789760704
00002000:00010000:1.0:1789760702.918681:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760703 -> 1789760704
00010000:00010000:1.0:1789760702.918693:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.918706:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.918714:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.918722:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760702.918726:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.918734:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.918754:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760702.918761:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b0e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18878464->18882559] (req 18878464->18882559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760702.918896:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520843392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37796us (38687us total) trans 4294971929 rc 0/0
00000100:00100000:1.0:1789760702.918907:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4642
00000100:00100000:1.0:1789760702.918916:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674491426562 time 674567765358 state 0x2 ref 0
00000100:00100000:2.0:1789760702.929938:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760702.930074:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520843520
00000100:00100000:0.0:1789760702.930087:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520843520
00000100:00100000:0.0:1789760702.930161:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674491426562 time 674567765358 state 0x0 ref 1
00000100:00100000:0.0:1789760702.930181:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674568025774 time 674567765358 state 0x1 ref 1
00000100:00100000:0.0:1789760702.930224:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674568025774 time 674616897969 state 0x0 ref 1
00000100:00100000:0.0:1789760702.930240:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520843520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760702.930307:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18882560, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:0.0:1789760702.930361:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.930385:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:0.0:1789760702.930391:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760702.930399:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760702.930417:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760703.007448:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18882560 -> 18886656
00010000:00010000:1.0:1789760703.007470:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.007484:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.007493:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.007501:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760703.007505:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.007514:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.007534:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.007546:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b0ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18882560->18886655] (req 18882560->18886655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760703.007824:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520843520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 77583us (77896us total) trans 4294971930 rc 0/0
00000100:00100000:1.0:1789760703.007835:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4643
00000100:00100000:1.0:1789760703.007846:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674568025774 time 674616897969 state 0x2 ref 0
00000100:00100000:2.0:1789760703.012604:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760703.012707:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520843648
00000100:00100000:0.0:1789760703.012717:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520843648
00000100:00100000:0.0:1789760703.012775:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674568025774 time 674616897969 state 0x0 ref 1
00000100:00100000:0.0:1789760703.012789:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674617158385 time 674616897969 state 0x1 ref 1
00000100:00100000:0.0:1789760703.012822:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674617158385 time 674699504488 state 0x0 ref 1
00000100:00100000:0.0:1789760703.012835:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520843648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760703.012884:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18886656, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:0.0:1789760703.012898:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.012915:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:0.0:1789760703.012920:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760703.012927:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.012940:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.038283:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:2.0:1789760703.057163:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18886656 -> 18890752
00010000:00010000:2.0:1789760703.057178:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.057191:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.057199:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.057207:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760703.057212:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.057221:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.057241:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.057747:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b0f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18886656->18890751] (req 18886656->18890751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760703.069479:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:1.0:1789760703.107199:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971932 is committed
00000100:00100000:2.0:1789760703.115274:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760703.115433:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520843904
00000100:00100000:1.0:1789760703.115443:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520843904
00000100:00100000:1.0:1789760703.115496:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674699764904 time 674756496364 state 0x0 ref 1
00000100:00100000:1.0:1789760703.115512:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674756756780 time 674756496364 state 0x1 ref 1
00000100:00100000:1.0:1789760703.115662:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674756756780 time 674802343393 state 0x0 ref 1
00000100:00100000:1.0:1789760703.115676:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc825b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520843904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760703.115727:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18894848, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:1.0:1789760703.115736:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.115752:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:1.0:1789760703.115756:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760703.115762:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.115776:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760703.169193:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18894848 -> 18898944
00010000:00010000:2.0:1789760703.169216:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.169230:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.169240:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.169247:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760703.169251:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.169260:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.169278:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.169286:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b104 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18894848->18898943] (req 18894848->18898943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760703.169442:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc825b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520843904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53763us (54174us total) trans 4294971933 rc 0/0
00000100:00100000:2.0:1789760703.169455:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4646
00000100:00100000:2.0:1789760703.169464:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674756756780 time 674802343393 state 0x2 ref 0
00000100:00100000:2.0:1789760703.180963:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760703.181253:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520844032
00000100:00100000:1.0:1789760703.181271:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520844032
00000100:00100000:1.0:1789760703.181434:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674756756780 time 674802343393 state 0x0 ref 1
00000100:00100000:1.0:1789760703.181451:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674802603809 time 674802343393 state 0x1 ref 1
00000100:00100000:1.0:1789760703.181498:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674802603809 time 674868180106 state 0x0 ref 1
00000100:00100000:1.0:1789760703.181523:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520844032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760703.181600:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18898944, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:1.0:1789760703.181610:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b10b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.181628:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=674s v=(0 0)
00010000:00010000:1.0:1789760703.181633:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760703.181640:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b10b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18898944->18903039] (req 18898944->18903039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.181667:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b10b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18898944->18903039] (req 18898944->18903039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760703.256467:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971934 is committed
00000100:00100000:2.0:1789760703.262559:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:2.0:1789760703.336496:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18903040 -> 18907136
00010000:00010000:2.0:1789760703.336512:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b112 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18903040->18907135] (req 18903040->18907135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.336524:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b112 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18903040->18907135] (req 18903040->18907135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.336533:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b112 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18903040->18907135] (req 18903040->18907135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.336540:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760703.336545:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b112 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18903040->18907135] (req 18903040->18907135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.336620:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b112 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18903040->18907135] (req 18903040->18907135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.336642:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b112 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18903040->18907135] (req 18903040->18907135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.336650:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b112 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18903040->18907135] (req 18903040->18907135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760703.336785:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520844160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 74028us (74233us total) trans 4294971935 rc 0/0
00000100:00100000:2.0:1789760703.336796:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4648
00000100:00100000:2.0:1789760703.336804:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674868440522 time 674949425564 state 0x2 ref 0
00000100:00100000:0.0:1789760703.344730:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520844288
00000100:00100000:0.0:1789760703.344745:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520844288
00000100:00100000:1.0:1789760703.346841:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674868440522 time 674949425564 state 0x0 ref 1
00000100:00100000:1.0:1789760703.346859:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674949685980 time 674949425564 state 0x1 ref 1
00000100:00100000:1.0:1789760703.346959:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674949685980 time 675033639717 state 0x0 ref 1
00000100:00100000:1.0:1789760703.346985:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520844288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760703.347045:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18907136, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:1.0:1789760703.347054:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.347079:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:1.0:1789760703.347083:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760703.347089:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.347103:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760703.400342:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971936 is committed
00002000:00010000:1.0:1789760703.400460:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18907136 -> 18911232
00010000:00010000:1.0:1789760703.400478:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.400491:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.400500:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.400512:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760703.400517:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.400525:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.400551:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.400635:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b119 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18907136->18911231] (req 18907136->18911231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760703.400870:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520844288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53884us (58332us total) trans 4294971936 rc 0/0
00000100:00100000:1.0:1789760703.400882:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4649
00000100:00100000:1.0:1789760703.400892:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674949685980 time 675033639717 state 0x2 ref 0
00000100:00100000:2.0:1789760703.415192:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520844416
00000100:00100000:2.0:1789760703.415203:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520844416
00000100:00100000:2.0:1789760703.415254:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 674949685980 time 675033639717 state 0x0 ref 1
00000100:00100000:2.0:1789760703.415269:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675033900133 time 675033639717 state 0x1 ref 1
00000100:00100000:2.0:1789760703.415305:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675033900133 time 675101987617 state 0x0 ref 1
00000100:00100000:2.0:1789760703.415357:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520844416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760703.415417:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18911232, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:2.0:1789760703.415428:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b120 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.415446:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:2.0:1789760703.415452:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760703.415458:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18911232->18915327] (req 18911232->18915327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.415474:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b120 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18911232->18915327] (req 18911232->18915327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760703.454267:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971937 is committed
00000100:00100000:2.0:1789760703.460188:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:0.0:1789760703.525381:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18915328 -> 18919424
00010000:00010000:0.0:1789760703.525397:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b127 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18915328->18919423] (req 18915328->18919423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.525410:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b127 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18915328->18919423] (req 18915328->18919423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.525419:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18915328->18919423] (req 18915328->18919423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.525427:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760703.525432:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18915328->18919423] (req 18915328->18919423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.525445:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b127 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18915328->18919423] (req 18915328->18919423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.525462:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b127 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18915328->18919423] (req 18915328->18919423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.525469:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b127 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18915328->18919423] (req 18915328->18919423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760703.525578:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520844544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64774us (65395us total) trans 4294971938 rc 0/0
00000100:00100000:0.0:1789760703.525590:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4651
00000100:00100000:0.0:1789760703.525599:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675102248033 time 675147466257 state 0x2 ref 0
00000100:00100000:1.0:1789760703.529963:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760703.530072:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520844672
00000100:00100000:0.0:1789760703.530081:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520844672
00000100:00100000:0.0:1789760703.530132:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675102248033 time 675147466257 state 0x0 ref 1
00000100:00100000:0.0:1789760703.530147:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675147726673 time 675147466257 state 0x1 ref 1
00000100:00100000:0.0:1789760703.530175:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675147726673 time 675216857289 state 0x0 ref 1
00000100:00100000:0.0:1789760703.530187:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520844672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760703.530234:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18919424, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:0.0:1789760703.530243:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b12e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.530259:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:0.0:1789760703.530264:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760703.530270:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b12e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18919424->18923519] (req 18919424->18923519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.530283:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b12e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18919424->18923519] (req 18919424->18923519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760703.586233:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520844800
00000100:00100000:1.0:1789760703.586243:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520844800
00000100:00100000:1.0:1789760703.586295:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675147726673 time 675216857289 state 0x0 ref 1
00000100:00100000:1.0:1789760703.586310:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675217117705 time 675216857289 state 0x1 ref 1
00000100:00100000:1.0:1789760703.586360:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675217117705 time 675273043214 state 0x0 ref 1
00000100:00100000:1.0:1789760703.586373:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520844800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760703.586421:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18923520, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:1.0:1789760703.586430:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.586446:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:1.0:1789760703.586451:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760703.586458:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.586471:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760703.645907:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18923520 -> 18927616
00010000:00010000:1.0:1789760703.645929:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.645941:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.645950:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.646098:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760703.646104:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.646182:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.646203:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.646211:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b135 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18923520->18927615] (req 18923520->18927615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760703.646413:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520844800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60037us (60267us total) trans 4294971940 rc 0/0
00000100:00100000:1.0:1789760703.646424:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4653
00000100:00100000:1.0:1789760703.646434:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675217117705 time 675273043214 state 0x2 ref 0
00000100:00100000:0.0:1789760703.655586:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520844928
00000100:00100000:0.0:1789760703.655602:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520844928
00000100:00100000:1.0:1789760703.655739:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675217117705 time 675273043214 state 0x0 ref 1
00000100:00100000:1.0:1789760703.655754:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675273303630 time 675273043214 state 0x1 ref 1
00000100:00100000:1.0:1789760703.655784:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675273303630 time 675342466608 state 0x0 ref 1
00000100:00100000:1.0:1789760703.655797:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520844928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760703.655846:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18927616, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:1.0:1789760703.655854:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.655884:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:1.0:1789760703.655888:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760703.655894:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760703.655907:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760703.732386:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971941 is committed
00002000:00010000:2.0:1789760703.732580:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18927616 -> 18931712
00010000:00010000:2.0:1789760703.732597:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.732610:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.732620:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.732628:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760703.732632:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.732641:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.732661:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.732692:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b13c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18927616->18931711] (req 18927616->18931711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760703.732780:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520844928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76982us (82474us total) trans 4294971941 rc 0/0
00000100:00100000:2.0:1789760703.732790:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4654
00000100:00100000:2.0:1789760703.732800:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675273303630 time 675342466608 state 0x2 ref 0
00000100:00100000:2.0:1789760703.741826:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760703.741943:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520845056
00000100:00100000:0.0:1789760703.741954:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520845056
00000100:00100000:0.0:1789760703.742007:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675273303630 time 675342466608 state 0x0 ref 1
00000100:00100000:0.0:1789760703.742037:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675342727024 time 675342466608 state 0x1 ref 1
00000100:00100000:0.0:1789760703.742065:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675342727024 time 675428747546 state 0x0 ref 1
00000100:00100000:0.0:1789760703.742077:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520845056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760703.742126:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18931712, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:0.0:1789760703.742135:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.742152:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:0.0:1789760703.742156:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760703.742163:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.742176:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760703.796979:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18931712 -> 18935808
00010000:00010000:2.0:1789760703.797001:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.797015:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.797036:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.797043:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760703.797048:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.797057:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.797075:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.797082:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b143 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18931712->18935807] (req 18931712->18935807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760703.797223:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520845056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55143us (55401us total) trans 4294971942 rc 0/0
00000100:00100000:2.0:1789760703.797233:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4655
00000100:00100000:2.0:1789760703.797243:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675342727024 time 675428747546 state 0x2 ref 0
00000001:00080000:0.0:1789760703.799186:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971942 is committed
00000100:00100000:1.0:1789760703.810752:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760703.810853:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520845184
00000100:00100000:0.0:1789760703.810864:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520845184
00000100:00100000:0.0:1789760703.810922:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675342727024 time 675428747546 state 0x0 ref 1
00000100:00100000:0.0:1789760703.810937:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675429007962 time 675428747546 state 0x1 ref 1
00000100:00100000:0.0:1789760703.810969:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675429007962 time 675497651045 state 0x0 ref 1
00000100:00100000:0.0:1789760703.810980:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520845184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760703.811038:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18935808, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:0.0:1789760703.811048:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.811064:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:0.0:1789760703.811068:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760703.811073:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760703.811095:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760703.863680:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18935808 -> 18939904
00010000:00010000:2.0:1789760703.863703:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.863717:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.863727:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.863735:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760703.863740:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.863749:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.863769:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.863784:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b14a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18935808->18939903] (req 18935808->18939903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760703.863879:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520845184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52895us (53131us total) trans 4294971943 rc 0/0
00000100:00100000:2.0:1789760703.863891:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4656
00000100:00100000:2.0:1789760703.863901:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675429007962 time 675497651045 state 0x2 ref 0
00000100:00100000:1.0:1789760703.869663:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760703.869743:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520845312
00000100:00100000:2.0:1789760703.869753:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520845312
00000100:00100000:2.0:1789760703.869810:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675429007962 time 675497651045 state 0x0 ref 1
00000100:00100000:2.0:1789760703.869827:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675497911461 time 675497651045 state 0x1 ref 1
00000100:00100000:2.0:1789760703.869861:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675497911461 time 675556543253 state 0x0 ref 1
00000100:00100000:2.0:1789760703.869873:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520845312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760703.869922:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18939904, mtime: 0x6aad94c0, atime: 0x0, ctime: 0x6aad94c0, blocks: 0x9807
00010000:00010000:2.0:1789760703.869932:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.869949:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:2.0:1789760703.869953:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760703.869960:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.869980:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760703.918145:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18939904 -> 18944000
00002000:00010000:2.0:1789760703.918201:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760704 -> 1789760705
00002000:00010000:2.0:1789760703.918204:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760704 -> 1789760705
00010000:00010000:2.0:1789760703.918219:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.918232:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.918242:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.918249:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760703.918254:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.918263:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.918281:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.918296:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b151 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18939904->18943999] (req 18939904->18943999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760703.918488:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520845312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48611us (48894us total) trans 4294971944 rc 0/0
00000100:00100000:2.0:1789760703.918502:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4657
00000100:00100000:2.0:1789760703.918514:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675497911461 time 675556543253 state 0x2 ref 0
00000100:00100000:1.0:1789760703.921086:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760703.921175:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520845440
00000100:00100000:2.0:1789760703.921185:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520845440
00000100:00100000:2.0:1789760703.921246:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675497911461 time 675556543253 state 0x0 ref 1
00000100:00100000:2.0:1789760703.921263:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675556803669 time 675556543253 state 0x1 ref 1
00000100:00100000:2.0:1789760703.921300:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675556803669 time 675607982748 state 0x0 ref 1
00000100:00100000:2.0:1789760703.921342:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520845440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760703.921390:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18944000, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:2.0:1789760703.921399:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.921415:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:2.0:1789760703.921419:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760703.921426:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.921451:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760703.988272:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971945 is committed
00002000:00010000:2.0:1789760703.988589:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18944000 -> 18948096
00010000:00010000:2.0:1789760703.988606:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.988619:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.988629:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.988636:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760703.988641:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.988649:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.988669:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760703.988676:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b158 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18944000->18948095] (req 18944000->18948095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760703.988934:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520845440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67616us (67852us total) trans 4294971945 rc 0/0
00000100:00100000:2.0:1789760703.988944:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4658
00000100:00100000:2.0:1789760703.988954:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675556803669 time 675607982748 state 0x2 ref 0
00000100:00100000:1.0:1789760704.003682:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760704.003787:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520845568
00000100:00100000:0.0:1789760704.003797:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520845568
00000100:00100000:0.0:1789760704.003869:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675556803669 time 675607982748 state 0x0 ref 1
00000100:00100000:0.0:1789760704.003885:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675608243164 time 675607982748 state 0x1 ref 1
00000100:00100000:0.0:1789760704.003916:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675608243164 time 675690598293 state 0x0 ref 1
00000100:00100000:0.0:1789760704.003929:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520845568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.003977:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18948096, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.003987:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.004005:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:0.0:1789760704.004009:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.004015:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.004041:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760704.004809:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:2.0:1789760704.040487:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18948096 -> 18952192
00010000:00010000:2.0:1789760704.040510:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.040524:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.040534:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.040541:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760704.040546:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.040567:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.040588:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.040601:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b15f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18948096->18952191] (req 18948096->18952191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760704.040711:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520845568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36780us (37035us total) trans 4294971946 rc 0/0
00000100:00100000:2.0:1789760704.040722:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4659
00000100:00100000:2.0:1789760704.040732:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675608243164 time 675690598293 state 0x2 ref 0
00000001:00080000:1.0:1789760704.043957:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971946 is committed
00000100:00100000:0.0:1789760704.046487:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.046567:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520845696
00000100:00100000:2.0:1789760704.046576:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520845696
00000100:00100000:2.0:1789760704.046628:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675608243164 time 675690598293 state 0x0 ref 1
00000100:00100000:2.0:1789760704.046643:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675690858709 time 675690598293 state 0x1 ref 1
00000100:00100000:2.0:1789760704.046692:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675690858709 time 675733374359 state 0x0 ref 1
00000100:00100000:2.0:1789760704.046704:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520845696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.046747:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18952192, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:2.0:1789760704.046757:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.046772:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:2.0:1789760704.046776:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.046782:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.046801:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.077059:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971947 is committed
00002000:00010000:2.0:1789760704.077156:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18952192 -> 18956288
00010000:00010000:2.0:1789760704.077173:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.077187:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.077196:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.077205:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760704.077211:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.077221:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.077240:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.077249:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b166 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18952192->18956287] (req 18952192->18956287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760704.077385:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520845696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30676us (30902us total) trans 4294971947 rc 0/0
00000100:00100000:2.0:1789760704.077394:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4660
00000100:00100000:2.0:1789760704.077403:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675690858709 time 675733374359 state 0x2 ref 0
00000100:00100000:0.0:1789760704.081043:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.081137:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520845824
00000100:00100000:2.0:1789760704.081148:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520845824
00000100:00100000:2.0:1789760704.081201:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675690858709 time 675733374359 state 0x0 ref 1
00000100:00100000:2.0:1789760704.081215:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675733634775 time 675733374359 state 0x1 ref 1
00000100:00100000:2.0:1789760704.081285:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675733634775 time 675767966305 state 0x0 ref 1
00000100:00100000:2.0:1789760704.081297:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520845824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.081383:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18956288, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:2.0:1789760704.081392:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.081408:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:2.0:1789760704.081413:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.081418:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.081432:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760704.109015:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18956288 -> 18960384
00010000:00010000:2.0:1789760704.109044:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.109056:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.109064:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.109071:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760704.109075:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.109083:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.109103:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.109110:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b16d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18956288->18960383] (req 18956288->18960383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760704.109204:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520845824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27904us (28166us total) trans 4294971948 rc 0/0
00000100:00100000:2.0:1789760704.109218:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4661
00000100:00100000:2.0:1789760704.109227:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675733634775 time 675767966305 state 0x2 ref 0
00000001:00080000:1.0:1789760704.109782:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971948 is committed
00000100:00100000:1.0:1789760704.112256:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.112368:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520845952
00000100:00100000:2.0:1789760704.112377:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520845952
00000100:00100000:2.0:1789760704.112429:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675733634775 time 675767966305 state 0x0 ref 1
00000100:00100000:2.0:1789760704.112444:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675768226721 time 675767966305 state 0x1 ref 1
00000100:00100000:2.0:1789760704.112467:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675768226721 time 675799149158 state 0x0 ref 1
00000100:00100000:2.0:1789760704.112479:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520845952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.112524:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18960384, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:2.0:1789760704.112534:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.112550:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:2.0:1789760704.112554:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.112560:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.112572:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.166369:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971949 is committed
00002000:00010000:0.0:1789760704.166572:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18960384 -> 18964480
00010000:00010000:0.0:1789760704.166589:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.166602:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.166610:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.166618:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760704.166623:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.166632:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.166652:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.166660:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b174 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18960384->18964479] (req 18960384->18964479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760704.166766:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520845952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54284us (54512us total) trans 4294971949 rc 0/0
00000100:00100000:0.0:1789760704.166777:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4662
00000100:00100000:0.0:1789760704.166786:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675768226721 time 675799149158 state 0x2 ref 0
00000100:00100000:0.0:1789760704.171986:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520846080
00000100:00100000:0.0:1789760704.171997:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520846080
00000100:00100000:0.0:1789760704.172054:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675768226721 time 675799149158 state 0x0 ref 1
00000100:00100000:0.0:1789760704.172068:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675799409574 time 675799149158 state 0x1 ref 1
00000100:00100000:0.0:1789760704.172101:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675799409574 time 675858782933 state 0x0 ref 1
00000100:00100000:0.0:1789760704.172114:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520846080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.172163:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18964480, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.172172:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.172188:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:0.0:1789760704.172193:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.172199:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.172214:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.234436:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971950 is committed
00002000:00010000:0.0:1789760704.234543:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18964480 -> 18968576
00010000:00010000:0.0:1789760704.234567:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.234581:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.234590:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.234598:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760704.234603:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.234611:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.234630:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.234637:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b17b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18964480->18968575] (req 18964480->18968575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760704.234729:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520846080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62613us (62818us total) trans 4294971950 rc 0/0
00000100:00100000:0.0:1789760704.234739:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4663
00000100:00100000:0.0:1789760704.234748:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675799409574 time 675858782933 state 0x2 ref 0
00000100:00100000:1.0:1789760704.242388:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760704.242475:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520846208
00000100:00100000:0.0:1789760704.242485:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520846208
00000100:00100000:0.0:1789760704.242537:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675799409574 time 675858782933 state 0x0 ref 1
00000100:00100000:0.0:1789760704.242564:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675859043349 time 675858782933 state 0x1 ref 1
00000100:00100000:0.0:1789760704.242588:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675859043349 time 675929271095 state 0x0 ref 1
00000100:00100000:0.0:1789760704.242602:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520846208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.242660:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18968576, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.242669:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.242685:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:0.0:1789760704.242690:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.242696:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.242710:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760704.292995:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18968576 -> 18972672
00010000:00010000:1.0:1789760704.293014:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.293038:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.293053:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.293061:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760704.293066:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.293075:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.293094:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.293102:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b182 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18968576->18972671] (req 18968576->18972671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760704.293193:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520846208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50589us (50811us total) trans 4294971951 rc 0/0
00000100:00100000:1.0:1789760704.293203:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4664
00000100:00100000:1.0:1789760704.293212:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675859043349 time 675929271095 state 0x2 ref 0
00000001:00080000:1.0:1789760704.293249:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971951 is committed
00000100:00100000:1.0:1789760704.304995:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.305107:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520846336
00000100:00100000:2.0:1789760704.305118:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520846336
00000100:00100000:2.0:1789760704.305172:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675859043349 time 675929271095 state 0x0 ref 1
00000100:00100000:2.0:1789760704.305187:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675929531511 time 675929271095 state 0x1 ref 1
00000100:00100000:2.0:1789760704.305219:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675929531511 time 675991901561 state 0x0 ref 1
00000100:00100000:2.0:1789760704.305232:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520846336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.305284:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18972672, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:2.0:1789760704.305294:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.305308:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=675s v=(0 0)
00010000:00010000:2.0:1789760704.305348:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.305356:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.305371:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.341755:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971952 is committed
00002000:00010000:2.0:1789760704.341831:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18972672 -> 18976768
00010000:00010000:2.0:1789760704.341906:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.341920:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.341930:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.341938:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760704.341943:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.341953:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.341974:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.341982:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b189 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18972672->18976767] (req 18972672->18976767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760704.342118:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520846336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36883us (37129us total) trans 4294971952 rc 0/0
00000100:00100000:2.0:1789760704.342128:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4665
00000100:00100000:2.0:1789760704.342137:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675929531511 time 675991901561 state 0x2 ref 0
00000100:00100000:0.0:1789760704.357242:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760704.357393:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520846464
00000100:00100000:1.0:1789760704.357403:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520846464
00000100:00100000:1.0:1789760704.357456:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675929531511 time 675991901561 state 0x0 ref 1
00000100:00100000:1.0:1789760704.357472:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675992161977 time 675991901561 state 0x1 ref 1
00000100:00100000:1.0:1789760704.357544:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675992161977 time 676044225583 state 0x0 ref 1
00000100:00100000:1.0:1789760704.357567:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520846464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760704.357616:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18976768, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:1.0:1789760704.357625:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.357643:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:1.0:1789760704.357647:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760704.357664:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.357679:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760704.437055:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971953 is committed
00002000:00010000:1.0:1789760704.437240:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18976768 -> 18980864
00010000:00010000:1.0:1789760704.437257:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.437270:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.437285:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.437294:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760704.437300:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.437310:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.438064:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.438072:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b190 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18976768->18980863] (req 18976768->18980863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760704.438275:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520846464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 80716us (81037us total) trans 4294971953 rc 0/0
00000100:00100000:1.0:1789760704.438286:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4666
00000100:00100000:1.0:1789760704.438296:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675992161977 time 676044225583 state 0x2 ref 0
00000100:00100000:1.0:1789760704.448226:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760704.448350:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520846592
00000100:00100000:0.0:1789760704.448360:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520846592
00000100:00100000:0.0:1789760704.448421:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 675992161977 time 676044225583 state 0x0 ref 1
00000100:00100000:0.0:1789760704.448436:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676044485999 time 676044225583 state 0x1 ref 1
00000100:00100000:0.0:1789760704.448467:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676044485999 time 676135148998 state 0x0 ref 1
00000100:00100000:0.0:1789760704.448479:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520846592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.448529:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18980864, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.448539:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.448565:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760704.448570:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.448576:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.448590:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.485868:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971954 is committed
00002000:00010000:2.0:1789760704.486186:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18980864 -> 18984960
00010000:00010000:2.0:1789760704.486202:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.486215:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.486230:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.486236:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760704.486241:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.486250:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.486269:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.486276:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b197 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18980864->18984959] (req 18980864->18984959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760704.486640:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520846592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38156us (38417us total) trans 4294971954 rc 0/0
00000100:00100000:2.0:1789760704.486652:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4667
00000100:00100000:2.0:1789760704.486661:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676044485999 time 676135148998 state 0x2 ref 0
00000100:00100000:1.0:1789760704.491738:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760704.491834:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520846720
00000100:00100000:0.0:1789760704.491844:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520846720
00000100:00100000:0.0:1789760704.491896:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676044485999 time 676135148998 state 0x0 ref 1
00000100:00100000:0.0:1789760704.491910:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676135409414 time 676135148998 state 0x1 ref 1
00000100:00100000:0.0:1789760704.491970:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676135409414 time 676178652242 state 0x0 ref 1
00000100:00100000:0.0:1789760704.491983:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520846720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.492039:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18984960, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.492048:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.492064:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760704.492069:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.492076:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.492186:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760704.548840:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18984960 -> 18989056
00010000:00010000:1.0:1789760704.548862:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.548874:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.548884:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.548893:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760704.548899:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.548909:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.548928:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.548937:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b19e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18984960->18989055] (req 18984960->18989055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760704.549035:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520846720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57050us (57300us total) trans 4294971955 rc 0/0
00000100:00100000:1.0:1789760704.549046:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4668
00000100:00100000:1.0:1789760704.549055:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676135409414 time 676178652242 state 0x2 ref 0
00000100:00100000:2.0:1789760704.554561:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520846848
00000100:00100000:2.0:1789760704.554571:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520846848
00000100:00100000:2.0:1789760704.554619:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676135409414 time 676178652242 state 0x0 ref 1
00000100:00100000:2.0:1789760704.554633:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676178912658 time 676178652242 state 0x1 ref 1
00000100:00100000:2.0:1789760704.554706:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676178912658 time 676241387577 state 0x0 ref 1
00000100:00100000:2.0:1789760704.554718:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520846848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.554764:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18989056, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:2.0:1789760704.554774:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.554789:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:2.0:1789760704.554793:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.554800:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.554814:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760704.592104:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18989056 -> 18993152
00010000:00010000:0.0:1789760704.592120:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.592133:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.592142:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.592158:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760704.592163:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.592173:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.592193:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.592202:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b1a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18989056->18993151] (req 18989056->18993151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760704.592284:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520846848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37563us (38387us total) trans 4294971956 rc 0/0
00000100:00100000:0.0:1789760704.592296:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4669
00000100:00100000:0.0:1789760704.592305:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676178912658 time 676241387577 state 0x2 ref 0
00000100:00100000:0.0:1789760704.598368:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760704.599623:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520846976
00000100:00100000:1.0:1789760704.599635:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520846976
00000100:00100000:1.0:1789760704.599709:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676178912658 time 676241387577 state 0x0 ref 1
00000100:00100000:1.0:1789760704.599724:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676241647993 time 676241387577 state 0x1 ref 1
00000100:00100000:1.0:1789760704.599759:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676241647993 time 676286441072 state 0x0 ref 1
00000100:00100000:1.0:1789760704.599770:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520846976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760704.599818:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18993152, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:1.0:1789760704.599827:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.599842:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:1.0:1789760704.599846:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760704.599853:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.599866:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.655117:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971957 is committed
00002000:00010000:0.0:1789760704.655227:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18993152 -> 18997248
00010000:00010000:0.0:1789760704.655243:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.655255:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.655264:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.655271:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760704.655275:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.655283:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.655301:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.655338:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b1ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18993152->18997247] (req 18993152->18997247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760704.655444:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520846976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55671us (57080us total) trans 4294971957 rc 0/0
00000100:00100000:0.0:1789760704.655457:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4670
00000100:00100000:0.0:1789760704.655468:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676241647993 time 676286441072 state 0x2 ref 0
00000100:00100000:1.0:1789760704.658961:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760704.659059:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520847104
00000100:00100000:0.0:1789760704.659071:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520847104
00000100:00100000:0.0:1789760704.659124:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676241647993 time 676286441072 state 0x0 ref 1
00000100:00100000:0.0:1789760704.659139:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676286701488 time 676286441072 state 0x1 ref 1
00000100:00100000:0.0:1789760704.659207:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676286701488 time 676345888639 state 0x0 ref 1
00000100:00100000:0.0:1789760704.659221:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520847104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.659268:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 18997248, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.659278:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.659294:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760704.659299:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.659305:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.659348:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.685920:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971958 is committed
00002000:00010000:0.0:1789760704.686177:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 18997248 -> 19001344
00010000:00010000:0.0:1789760704.686193:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.686343:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.686355:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.686362:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760704.686367:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.686375:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.686396:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.686404:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [18997248->19001343] (req 18997248->19001343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760704.686495:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520847104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27273us (27539us total) trans 4294971958 rc 0/0
00000100:00100000:0.0:1789760704.686506:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4671
00000100:00100000:0.0:1789760704.686516:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676286701488 time 676345888639 state 0x2 ref 0
00000100:00100000:1.0:1789760704.691197:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.691342:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520847232
00000100:00100000:2.0:1789760704.691352:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520847232
00000100:00100000:2.0:1789760704.691410:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676286701488 time 676345888639 state 0x0 ref 1
00000100:00100000:2.0:1789760704.691426:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676346149055 time 676345888639 state 0x1 ref 1
00002000:00010000:1.0:1789760704.718469:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19001344 -> 19005440
00010000:00010000:1.0:1789760704.718491:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b1ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19001344->19005439] (req 19001344->19005439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.718504:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b1ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19001344->19005439] (req 19001344->19005439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.718514:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b1ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19001344->19005439] (req 19001344->19005439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.718521:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760704.718526:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b1ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19001344->19005439] (req 19001344->19005439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.718535:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b1ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19001344->19005439] (req 19001344->19005439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.718567:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b1ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19001344->19005439] (req 19001344->19005439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760704.718659:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971959 is committed
00010000:00010000:1.0:1789760704.718714:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b1ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19001344->19005439] (req 19001344->19005439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760704.718900:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520847232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26962us (27708us total) trans 4294971959 rc 0/0
00000100:00100000:1.0:1789760704.718909:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4672
00000100:00100000:1.0:1789760704.718916:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676346149055 time 676378601044 state 0x2 ref 0
00000100:00100000:1.0:1789760704.722409:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.722785:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520847360
00000100:00100000:2.0:1789760704.722797:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520847360
00000100:00100000:2.0:1789760704.722853:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676346149055 time 676378601044 state 0x0 ref 1
00000100:00100000:2.0:1789760704.722868:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676378861460 time 676378601044 state 0x1 ref 1
00000100:00100000:2.0:1789760704.722909:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676378861460 time 676409590495 state 0x0 ref 1
00000100:00100000:2.0:1789760704.722927:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520847360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.722986:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19005440, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:2.0:1789760704.723000:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b1c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.723029:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:2.0:1789760704.723034:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.723042:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19005440->19009535] (req 19005440->19009535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.723057:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b1c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19005440->19009535] (req 19005440->19009535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.749062:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971960 is committed
00000100:00100000:0.0:1789760704.756126:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520847488
00000100:00100000:0.0:1789760704.756137:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520847488
00000100:00100000:0.0:1789760704.756192:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676378861460 time 676409590495 state 0x0 ref 1
00000100:00100000:0.0:1789760704.756207:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676409850911 time 676409590495 state 0x1 ref 1
00000100:00100000:0.0:1789760704.756237:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676409850911 time 676442920098 state 0x0 ref 1
00000100:00100000:0.0:1789760704.756249:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520847488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.756296:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19009536, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.756305:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.756353:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760704.756357:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.756364:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19009536->19013631] (req 19009536->19013631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.756379:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b1c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19009536->19013631] (req 19009536->19013631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.790931:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971961 is committed
00000100:00100000:1.0:1789760704.797572:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760704.797699:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520847616
00000100:00100000:0.0:1789760704.797709:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520847616
00000100:00100000:0.0:1789760704.797764:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676409850911 time 676442920098 state 0x0 ref 1
00000100:00100000:0.0:1789760704.797780:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676443180514 time 676442920098 state 0x1 ref 1
00000100:00100000:0.0:1789760704.797845:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676443180514 time 676484527294 state 0x0 ref 1
00000100:00100000:0.0:1789760704.797858:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520847616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.797907:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19013632, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.797915:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.797930:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760704.797934:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.797940:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.797953:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760704.819800:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971962 is committed
00002000:00010000:2.0:1789760704.820497:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19013632 -> 19017728
00010000:00010000:2.0:1789760704.820514:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.820527:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.820536:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.820544:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760704.820550:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.820560:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.820636:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.820701:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b1cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19013632->19017727] (req 19013632->19017727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760704.820793:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520847616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 22933us (23230us total) trans 4294971962 rc 0/0
00000100:00100000:2.0:1789760704.820804:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4675
00000100:00100000:2.0:1789760704.820813:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676443180514 time 676484527294 state 0x2 ref 0
00000100:00100000:1.0:1789760704.825159:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.825602:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676484787710 time 676512281155 state 0x0 ref 1
00000100:00100000:2.0:1789760704.825619:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520847744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.825667:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19017728, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:2.0:1789760704.825677:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.825912:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:2.0:1789760704.825917:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.825925:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.825938:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760704.862811:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971963 is committed
00002000:00010000:2.0:1789760704.863066:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19017728 -> 19021824
00010000:00010000:2.0:1789760704.863082:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.863096:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.863106:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.863114:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760704.863119:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.863128:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.863147:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.863156:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19017728->19021823] (req 19017728->19021823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760704.863292:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520847744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37672us (38136us total) trans 4294971963 rc 0/0
00000100:00100000:2.0:1789760704.863303:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4676
00000100:00100000:2.0:1789760704.863353:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676484787710 time 676512281155 state 0x2 ref 0
00000100:00100000:0.0:1789760704.869841:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520847872
00000100:00100000:0.0:1789760704.869851:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520847872
00000100:00100000:0.0:1789760704.869903:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676484787710 time 676512281155 state 0x0 ref 1
00000100:00100000:0.0:1789760704.869994:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676512541571 time 676512281155 state 0x1 ref 1
00000100:00100000:0.0:1789760704.870093:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676512541571 time 676556775563 state 0x0 ref 1
00000100:00100000:0.0:1789760704.870108:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520847872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.870159:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19021824, mtime: 0x6aad94c1, atime: 0x0, ctime: 0x6aad94c1, blocks: 0x9807
00010000:00010000:0.0:1789760704.870168:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.870184:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760704.870189:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.870196:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.870210:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760704.906124:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971964 is committed
00002000:00010000:1.0:1789760704.906276:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19021824 -> 19025920
00002000:00010000:1.0:1789760704.906280:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760705 -> 1789760706
00002000:00010000:1.0:1789760704.906283:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760705 -> 1789760706
00010000:00010000:1.0:1789760704.906295:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.906308:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.906413:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.906422:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760704.906426:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.906436:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.906457:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760704.906469:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b1dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19021824->19025919] (req 19021824->19025919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760704.906710:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520847872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36600us (37029us total) trans 4294971964 rc 0/0
00000100:00100000:1.0:1789760704.906721:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4677
00000100:00100000:1.0:1789760704.906732:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676512541571 time 676556775563 state 0x2 ref 0
00000100:00100000:1.0:1789760704.913738:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.913995:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520848000
00000100:00100000:2.0:1789760704.914004:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520848000
00000100:00100000:2.0:1789760704.914068:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676512541571 time 676556775563 state 0x0 ref 1
00000100:00100000:2.0:1789760704.914084:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676557035979 time 676556775563 state 0x1 ref 1
00000100:00100000:2.0:1789760704.914119:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676557035979 time 676600802040 state 0x0 ref 1
00000100:00100000:2.0:1789760704.914132:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520848000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.914175:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19025920, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760704.914184:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.914200:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:2.0:1789760704.914205:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.914211:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19025920->19030015] (req 19025920->19030015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.914225:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b1e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19025920->19030015] (req 19025920->19030015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760704.934808:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971965 is committed
00000100:00100000:0.0:1789760704.938113:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760704.938254:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520848128
00000100:00100000:2.0:1789760704.938263:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520848128
00000100:00100000:2.0:1789760704.938338:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676557035979 time 676600802040 state 0x0 ref 1
00000100:00100000:2.0:1789760704.938355:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676601062456 time 676600802040 state 0x1 ref 1
00000100:00100000:2.0:1789760704.938385:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676601062456 time 676625067897 state 0x0 ref 1
00000100:00100000:2.0:1789760704.938398:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520848128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760704.938446:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19030016, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760704.938456:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b1eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.938471:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:2.0:1789760704.938475:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760704.938481:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b1eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19030016->19034111] (req 19030016->19034111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760704.938496:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b1eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19030016->19034111] (req 19030016->19034111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760704.977517:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971966 is committed
00000100:00100000:2.0:1789760704.984574:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760704.984630:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520848256
00000100:00100000:0.0:1789760704.984640:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520848256
00000100:00100000:0.0:1789760704.984688:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676601062456 time 676625067897 state 0x0 ref 1
00000100:00100000:0.0:1789760704.984702:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676625328313 time 676625067897 state 0x1 ref 1
00000100:00100000:0.0:1789760704.984738:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676625328313 time 676671420459 state 0x0 ref 1
00000100:00100000:0.0:1789760704.984754:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520848256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760704.984799:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19034112, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:0.0:1789760704.984808:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.984824:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760704.984828:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760704.984834:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760704.984847:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760705.037940:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19034112 -> 19038208
00010000:00010000:0.0:1789760705.037958:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.037972:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.037982:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.037989:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760705.037994:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.038073:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.038093:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.038101:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19034112->19038207] (req 19034112->19038207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760705.038192:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520848256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53435us (53622us total) trans 4294971967 rc 0/0
00000100:00100000:0.0:1789760705.038203:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4680
00000100:00100000:0.0:1789760705.038213:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676625328313 time 676671420459 state 0x2 ref 0
00000100:00100000:1.0:1789760705.045657:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760705.045783:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520848384
00000100:00100000:0.0:1789760705.045792:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520848384
00000100:00100000:0.0:1789760705.045840:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676625328313 time 676671420459 state 0x0 ref 1
00000100:00100000:0.0:1789760705.045854:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676671680875 time 676671420459 state 0x1 ref 1
00000100:00100000:0.0:1789760705.045883:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676671680875 time 676732566082 state 0x0 ref 1
00000100:00100000:0.0:1789760705.045893:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520848384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760705.045938:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19038208, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:0.0:1789760705.045947:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.045962:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760705.045967:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760705.045973:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19038208->19042303] (req 19038208->19042303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.045986:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b1f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19038208->19042303] (req 19038208->19042303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760705.079261:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.079931:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676671680875 time 676732566082 state 0x0 ref 1
00000100:00100000:2.0:1789760705.079947:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676732826498 time 676732566082 state 0x1 ref 1
00000100:00100000:2.0:1789760705.080008:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676732826498 time 676766690213 state 0x0 ref 1
00000100:00100000:2.0:1789760705.080031:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520848512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760705.080082:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19042304, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760705.080090:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b200 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.080105:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:2.0:1789760705.080109:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760705.080115:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19042304->19046399] (req 19042304->19046399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.080128:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19042304->19046399] (req 19042304->19046399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760705.118693:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971969 is committed
00000100:00100000:2.0:1789760705.125923:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760705.126618:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676766950629 time 676813297813 state 0x0 ref 1
00000100:00100000:0.0:1789760705.126633:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520848640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760705.126677:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19046400, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:0.0:1789760705.126686:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b207 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.126701:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760705.126705:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760705.126711:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b207 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19046400->19050495] (req 19046400->19050495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.126725:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b207 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19046400->19050495] (req 19046400->19050495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760705.145464:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1789760705.145497:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548736256:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760705.145567:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760705.145747:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548736256
00000100:00100000:1.0:1789760705.145754:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548736256
00000100:00100000:1.0:1789760705.145852:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398
00000100:00100000:1.0:1789760705.145861:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548736256:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1789760705.145899:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:1.0:1789760705.145974:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548736256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (407us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760705.145982:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398
00000001:00080000:0.0:1789760705.167473:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971970 is committed
00000100:00100000:0.0:1789760705.171527:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.173596:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520848768
00000100:00100000:2.0:1789760705.173612:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520848768
00000100:00100000:2.0:1789760705.173752:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676766950629 time 676813297813 state 0x0 ref 1
00000100:00100000:2.0:1789760705.173769:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676813558229 time 676813297813 state 0x1 ref 1
00000100:00100000:2.0:1789760705.173802:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676813558229 time 676860484288 state 0x0 ref 1
00000100:00100000:2.0:1789760705.173816:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520848768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760705.173868:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19050496, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760705.173878:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.173894:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:2.0:1789760705.173899:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760705.173905:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.173918:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760705.199762:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971971 is committed
00002000:00010000:2.0:1789760705.199925:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19050496 -> 19054592
00010000:00010000:2.0:1789760705.199941:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.199954:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.199964:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.199971:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760705.199976:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.199986:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.200006:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.200052:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b20e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19050496->19054591] (req 19050496->19054591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760705.200176:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520848768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26359us (28654us total) trans 4294971971 rc 0/0
00000100:00100000:2.0:1789760705.200187:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4684
00000100:00100000:2.0:1789760705.200197:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676813558229 time 676860484288 state 0x2 ref 0
00000100:00100000:1.0:1789760705.205235:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760705.205359:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520848896
00000100:00100000:0.0:1789760705.205369:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520848896
00000100:00100000:0.0:1789760705.205420:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676813558229 time 676860484288 state 0x0 ref 1
00000100:00100000:0.0:1789760705.205435:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676860744704 time 676860484288 state 0x1 ref 1
00000100:00100000:0.0:1789760705.205464:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676860744704 time 676892146486 state 0x0 ref 1
00000100:00100000:0.0:1789760705.205477:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520848896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760705.205526:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19054592, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:0.0:1789760705.205536:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.205756:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:0.0:1789760705.205760:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760705.205767:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.205782:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760705.251810:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971972 is committed
00002000:00010000:0.0:1789760705.252740:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19054592 -> 19058688
00010000:00010000:0.0:1789760705.252756:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.252774:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.252783:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.252790:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760705.252794:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.252801:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.252821:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.252828:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b215 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19054592->19058687] (req 19054592->19058687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760705.252926:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520848896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47446us (47695us total) trans 4294971972 rc 0/0
00000100:00100000:0.0:1789760705.252936:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4685
00000100:00100000:0.0:1789760705.252945:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676860744704 time 676892146486 state 0x2 ref 0
00000100:00100000:2.0:1789760705.256284:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520849024
00000100:00100000:2.0:1789760705.256293:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520849024
00000100:00100000:2.0:1789760705.256362:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676860744704 time 676892146486 state 0x0 ref 1
00000100:00100000:2.0:1789760705.256377:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676892406902 time 676892146486 state 0x1 ref 1
00000100:00100000:2.0:1789760705.256407:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676892406902 time 676943087148 state 0x0 ref 1
00000100:00100000:1.0:1789760705.256684:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520849024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760705.256732:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19058688, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:1.0:1789760705.256743:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.256757:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=676s v=(0 0)
00010000:00010000:1.0:1789760705.256761:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760705.256767:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.256780:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760705.287270:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971973 is committed
00002000:00010000:2.0:1789760705.287358:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19058688 -> 19062784
00010000:00010000:2.0:1789760705.287374:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.287393:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.287403:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.287410:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760705.287415:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.287424:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.287443:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.287451:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b21c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19058688->19062783] (req 19058688->19062783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760705.287552:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520849024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31123us (31374us total) trans 4294971973 rc 0/0
00000100:00100000:2.0:1789760705.287563:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4686
00000100:00100000:2.0:1789760705.287572:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676892406902 time 676943087148 state 0x2 ref 0
00000100:00100000:1.0:1789760705.294951:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:1.0:1789760705.335973:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19062784 -> 19066880
00010000:00010000:1.0:1789760705.335993:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b223 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19062784->19066879] (req 19062784->19066879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.336018:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19062784->19066879] (req 19062784->19066879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.336028:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b223 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19062784->19066879] (req 19062784->19066879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.336036:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760705.336040:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b223 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19062784->19066879] (req 19062784->19066879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.336050:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b223 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19062784->19066879] (req 19062784->19066879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.336083:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b223 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19062784->19066879] (req 19062784->19066879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.336091:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b223 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19062784->19066879] (req 19062784->19066879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760705.336185:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520849152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40730us (41237us total) trans 4294971974 rc 0/0
00000100:00100000:1.0:1789760705.336195:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4687
00000100:00100000:1.0:1789760705.336205:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676943347564 time 676982120650 state 0x2 ref 0
00000001:00080000:2.0:1789760705.336349:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971974 is committed
00000100:00100000:1.0:1789760705.340892:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760705.340996:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520849280
00000100:00100000:0.0:1789760705.341005:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520849280
00000100:00100000:0.0:1789760705.341066:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676943347564 time 676982120650 state 0x0 ref 1
00000100:00100000:0.0:1789760705.341146:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676982381066 time 676982120650 state 0x1 ref 1
00000100:00100000:0.0:1789760705.341172:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676982381066 time 677027855678 state 0x0 ref 1
00000100:00100000:0.0:1789760705.341186:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520849280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760705.341236:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19066880, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:0.0:1789760705.341245:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.341261:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:0.0:1789760705.341265:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760705.341271:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.341286:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760705.374277:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760705.374342:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760705.374370:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760705.374387:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760705.374405:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760705.374431:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520849408
00000100:00100000:1.0:1789760705.374439:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520849408
00000100:00100000:1.0:1789760705.374481:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 456
00000100:00100000:1.0:1789760705.374503:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda005b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520849408:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760705.374582:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda005b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520849408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 90us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760705.374589:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 456
00000100:00100000:1.0:1789760705.374620:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520849536
00000100:00100000:1.0:1789760705.374624:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520849536
00000100:00100000:1.0:1789760705.374652:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520849792
00000100:00100000:1.0:1789760705.374655:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520849792
00000100:00100000:1.0:1789760705.374670:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520849664
00000100:00100000:1.0:1789760705.374672:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520849664
00000100:00100000:1.0:1789760705.374683:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520849920
00000100:00100000:1.0:1789760705.374685:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520849920
00000100:00100000:1.0:1789760705.374697:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 803
00000100:00100000:1.0:1789760705.374703:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520849536:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760705.374733:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520849536:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (465us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760705.374739:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 803
00000100:00100000:1.0:1789760705.374752:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 804
00000100:00100000:1.0:1789760705.374758:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520849792:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760705.374797:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520849792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (479us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760705.374804:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 804
00000100:00100000:1.0:1789760705.374817:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 805
00000100:00100000:1.0:1789760705.374823:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520849664:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760705.374846:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520849664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760705.374852:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 805
00000100:00100000:1.0:1789760705.374863:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 806
00000100:00100000:1.0:1789760705.374868:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520849920:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760705.374891:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520849920:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (484us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760705.374898:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 806
00000100:00080000:1.0:1789760705.374916:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1789760705.374919:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000001:00080000:0.0:1789760705.376296:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971975 is committed
00002000:00010000:2.0:1789760705.376416:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19066880 -> 19070976
00010000:00010000:2.0:1789760705.376431:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.376443:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.376452:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.376460:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760705.376464:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.376473:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.376504:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.376513:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b22a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19066880->19070975] (req 19066880->19070975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760705.376592:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520849280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35406us (35706us total) trans 4294971975 rc 0/0
00000100:00100000:2.0:1789760705.376602:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4688
00000100:00100000:2.0:1789760705.376611:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676982381066 time 677027855678 state 0x2 ref 0
00000100:00100000:0.0:1789760705.381676:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.381765:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520850048
00000100:00100000:2.0:1789760705.381882:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520850048
00000100:00100000:2.0:1789760705.381934:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 676982381066 time 677027855678 state 0x0 ref 1
00000100:00100000:2.0:1789760705.381950:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677028116094 time 677027855678 state 0x1 ref 1
00000100:00100000:2.0:1789760705.382024:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677028116094 time 677068705810 state 0x0 ref 1
00000100:00100000:2.0:1789760705.382038:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520850048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760705.382154:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19070976, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760705.382164:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.382178:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:2.0:1789760705.382183:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760705.382190:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.382203:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760705.430409:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19070976 -> 19075072
00010000:00010000:2.0:1789760705.430428:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.430440:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.430450:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.430458:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760705.430462:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.430472:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.430500:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.430509:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b231 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19070976->19075071] (req 19070976->19075071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760705.430731:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520850048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48690us (49058us total) trans 4294971976 rc 0/0
00000100:00100000:2.0:1789760705.430741:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4689
00000100:00100000:2.0:1789760705.430751:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677028116094 time 677068705810 state 0x2 ref 0
00000001:00080000:0.0:1789760705.431253:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971976 is committed
00000100:00100000:0.0:1789760705.438158:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.438486:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520850176
00000100:00100000:2.0:1789760705.438496:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520850176
00000100:00100000:2.0:1789760705.438608:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677028116094 time 677068705810 state 0x0 ref 1
00000100:00100000:2.0:1789760705.438624:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677068966226 time 677068705810 state 0x1 ref 1
00000100:00100000:2.0:1789760705.438778:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677068966226 time 677125459311 state 0x0 ref 1
00000100:00100000:2.0:1789760705.438793:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520850176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760705.438845:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19075072, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760705.438855:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.438872:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:2.0:1789760705.438876:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760705.438883:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.438898:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760705.483268:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971977 is committed
00002000:00010000:1.0:1789760705.483367:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19075072 -> 19079168
00010000:00010000:1.0:1789760705.483381:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.483394:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.483404:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.483412:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760705.483417:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.483426:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.483443:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.483451:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b238 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19075072->19079167] (req 19075072->19079167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760705.483554:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520850176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44759us (45401us total) trans 4294971977 rc 0/0
00000100:00100000:1.0:1789760705.483565:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4690
00000100:00100000:1.0:1789760705.483575:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677068966226 time 677125459311 state 0x2 ref 0
00000100:00100000:1.0:1789760705.487060:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760705.522374:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971978 is committed
00002000:00010000:0.0:1789760705.522683:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19079168 -> 19083264
00010000:00010000:0.0:1789760705.522698:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b23f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19079168->19083263] (req 19079168->19083263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.522711:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b23f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19079168->19083263] (req 19079168->19083263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.522721:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b23f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19079168->19083263] (req 19079168->19083263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.522728:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760705.522733:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b23f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19079168->19083263] (req 19079168->19083263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.522743:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b23f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19079168->19083263] (req 19079168->19083263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.522760:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b23f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19079168->19083263] (req 19079168->19083263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.522768:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b23f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19079168->19083263] (req 19079168->19083263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760705.522858:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520850304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35584us (35801us total) trans 4294971978 rc 0/0
00000100:00100000:0.0:1789760705.522868:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4691
00000100:00100000:0.0:1789760705.522877:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677125719727 time 677173942276 state 0x2 ref 0
00000100:00100000:1.0:1789760705.527276:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.527361:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520850432
00000100:00100000:2.0:1789760705.527371:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520850432
00000100:00100000:2.0:1789760705.527419:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677125719727 time 677173942276 state 0x0 ref 1
00000100:00100000:2.0:1789760705.527433:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677174202692 time 677173942276 state 0x1 ref 1
00000100:00100000:2.0:1789760705.527459:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677174202692 time 677214142452 state 0x0 ref 1
00000100:00100000:2.0:1789760705.528249:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520850432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760705.528300:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19083264, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760705.528310:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b246 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.528364:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:2.0:1789760705.528369:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760705.528375:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b246 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19083264->19087359] (req 19083264->19087359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.528390:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b246 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19083264->19087359] (req 19083264->19087359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760705.562345:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971979 is committed
00000100:00100000:2.0:1789760705.566032:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00002000:00010000:2.0:1789760705.601372:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19087360 -> 19091456
00010000:00010000:2.0:1789760705.601391:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b24d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19087360->19091455] (req 19087360->19091455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.601405:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b24d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19087360->19091455] (req 19087360->19091455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.601415:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b24d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19087360->19091455] (req 19087360->19091455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.601424:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760705.601428:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b24d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19087360->19091455] (req 19087360->19091455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.601438:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b24d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19087360->19091455] (req 19087360->19091455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.601456:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b24d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19087360->19091455] (req 19087360->19091455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.601464:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b24d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19087360->19091455] (req 19087360->19091455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760705.601563:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520850560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35203us (35534us total) trans 4294971980 rc 0/0
00000100:00100000:2.0:1789760705.601574:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4693
00000100:00100000:2.0:1789760705.601583:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677214402868 time 677253026826 state 0x2 ref 0
00000001:00080000:1.0:1789760705.602219:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971980 is committed
00000100:00100000:1.0:1789760705.605136:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.605196:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520850688
00000100:00100000:2.0:1789760705.605206:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520850688
00000100:00100000:2.0:1789760705.605271:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677214402868 time 677253026826 state 0x0 ref 1
00000100:00100000:2.0:1789760705.605286:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677253287242 time 677253026826 state 0x1 ref 1
00000100:00100000:2.0:1789760705.605311:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677253287242 time 677291993822 state 0x0 ref 1
00000100:00100000:2.0:1789760705.605398:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520850688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760705.605444:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19091456, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760705.605453:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.605469:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:2.0:1789760705.605474:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760705.605480:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.605494:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760705.648993:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971981 is committed
00002000:00010000:0.0:1789760705.649624:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19091456 -> 19095552
00010000:00010000:0.0:1789760705.649713:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.649727:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.649736:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.649743:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760705.649748:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.649757:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.649777:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.649785:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b254 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19091456->19095551] (req 19091456->19095551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760705.649922:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520850688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44522us (44790us total) trans 4294971981 rc 0/0
00000100:00100000:0.0:1789760705.649934:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4694
00000100:00100000:0.0:1789760705.649943:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677253287242 time 677291993822 state 0x2 ref 0
00000100:00100000:0.0:1789760705.653190:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760705.653265:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520850816
00000100:00100000:1.0:1789760705.653274:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520850816
00000100:00100000:1.0:1789760705.653367:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677253287242 time 677291993822 state 0x0 ref 1
00000100:00100000:1.0:1789760705.653382:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677292254238 time 677291993822 state 0x1 ref 1
00000100:00100000:1.0:1789760705.653402:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677292254238 time 677340085005 state 0x0 ref 1
00000100:00100000:1.0:1789760705.653413:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520850816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760705.653460:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19095552, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:1.0:1789760705.653469:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.653487:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:1.0:1789760705.653492:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760705.653498:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760705.653518:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760705.657579:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548736384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1789760705.657657:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760705.657725:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548736384
00000100:00100000:1.0:1789760705.657732:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548736384
00000100:00100000:1.0:1789760705.657776:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330
00000100:00100000:1.0:1789760705.657786:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548736384:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1789760705.657845:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528285696 pending 1703936 free 3838836736 avail 3829399552
00000100:00100000:1.0:1789760705.657884:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548736384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (227us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760705.657892:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330
00000100:00080000:1.0:1789760705.657913:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1789760705.657945:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548736384:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1789760705.658460:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789760705.658470:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548736512:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1789760705.658498:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760705.658564:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548736512
00000100:00100000:0.0:1789760705.658569:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548736512
00000100:00100000:0.0:1789760705.658611:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331
00000100:00100000:0.0:1789760705.658618:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548736512:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1789760705.658631:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528285696 pending 1703936 free 3838836736 avail 3829399552
00000100:00100000:0.0:1789760705.658676:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548736512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (177us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760705.658684:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331
00000100:00100000:2.0:1789760705.658716:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548736512:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1789760705.658803:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:2.0:1789760705.677870:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971982 is committed
00002000:00010000:0.0:1789760705.678977:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19095552 -> 19099648
00010000:00010000:0.0:1789760705.678999:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.679023:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.679033:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.679041:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760705.679046:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.679055:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.679079:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.679088:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b25b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19095552->19099647] (req 19095552->19099647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760705.679174:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520850816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25757us (25989us total) trans 4294971982 rc 0/0
00000100:00100000:0.0:1789760705.679185:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4695
00000100:00100000:0.0:1789760705.679195:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677292254238 time 677340085005 state 0x2 ref 0
00000100:00100000:2.0:1789760705.682972:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.684691:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677292254238 time 677340085005 state 0x0 ref 1
00000100:00100000:2.0:1789760705.684707:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677340345421 time 677340085005 state 0x1 ref 1
00000100:00100000:2.0:1789760705.684735:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677340345421 time 677371418291 state 0x0 ref 1
00000100:00100000:2.0:1789760705.684747:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520850944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760705.684795:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19099648, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760705.684804:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.684819:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:2.0:1789760705.684823:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760705.684839:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.684860:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760705.722142:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971983 is committed
00002000:00010000:2.0:1789760705.722245:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19099648 -> 19103744
00010000:00010000:2.0:1789760705.722263:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.722277:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.722286:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.722294:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760705.722300:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.722309:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.722398:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.722407:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b262 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19099648->19103743] (req 19099648->19103743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760705.735510:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.735556:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520851072
00000100:00100000:2.0:1789760705.735564:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520851072
00000100:00100000:2.0:1789760705.735612:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677340345421 time 677371418291 state 0x0 ref 1
00000100:00100000:2.0:1789760705.735626:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677371678707 time 677371418291 state 0x1 ref 1
00000100:00100000:2.0:1789760705.735880:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677371678707 time 677422561082 state 0x0 ref 1
00000100:00100000:2.0:1789760705.735895:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760705.735947:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19103744, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:2.0:1789760705.735957:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.735974:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:2.0:1789760705.735979:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760705.735985:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.735999:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760705.790308:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971984 is committed
00002000:00010000:2.0:1789760705.790458:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19103744 -> 19107840
00010000:00010000:2.0:1789760705.790483:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.790502:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.790512:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.790519:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760705.790524:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.790533:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.790707:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760705.790716:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b269 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19103744->19107839] (req 19103744->19107839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760705.790818:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54922us (55314us total) trans 4294971984 rc 0/0
00000100:00100000:2.0:1789760705.790828:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4697
00000100:00100000:2.0:1789760705.790837:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677371678707 time 677422561082 state 0x2 ref 0
00000100:00100000:2.0:1789760705.795859:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760705.795933:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520851200
00000100:00100000:0.0:1789760705.795949:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520851200
00000100:00100000:0.0:1789760705.795999:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677371678707 time 677422561082 state 0x0 ref 1
00000100:00100000:0.0:1789760705.796024:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677422821498 time 677422561082 state 0x1 ref 1
00000100:00100000:0.0:1789760705.796050:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677422821498 time 677482733191 state 0x0 ref 1
00000100:00100000:0.0:1789760705.796062:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760705.796108:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19107840, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:0.0:1789760705.796117:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.796138:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:0.0:1789760705.796142:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760705.796148:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.796161:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760705.837015:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19107840 -> 19111936
00010000:00010000:0.0:1789760705.837036:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.837050:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.837060:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.837068:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760705.837073:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.837082:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.837100:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.837109:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b270 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19107840->19111935] (req 19107840->19111935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760705.837286:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41221us (41432us total) trans 4294971985 rc 0/0
00000100:00100000:0.0:1789760705.837296:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4698
00000100:00100000:0.0:1789760705.837305:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677422821498 time 677482733191 state 0x2 ref 0
00000100:00100000:0.0:1789760705.849271:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760705.849367:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520851328
00000100:00100000:2.0:1789760705.849375:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520851328
00000100:00100000:2.0:1789760705.849426:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677422821498 time 677482733191 state 0x0 ref 1
00000100:00100000:2.0:1789760705.849441:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677482993607 time 677482733191 state 0x1 ref 1
00000100:00100000:0.0:1789760705.849566:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677482993607 time 677536246375 state 0x0 ref 1
00000100:00100000:0.0:1789760705.849580:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760705.849624:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19111936, mtime: 0x6aad94c2, atime: 0x0, ctime: 0x6aad94c2, blocks: 0x9807
00010000:00010000:0.0:1789760705.849633:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.849659:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:0.0:1789760705.849664:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760705.849671:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.849684:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760705.909866:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19111936 -> 19116032
00002000:00010000:0.0:1789760705.909875:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760706 -> 1789760707
00002000:00010000:0.0:1789760705.909877:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760706 -> 1789760707
00010000:00010000:0.0:1789760705.909890:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.909903:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.909912:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.909920:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760705.909925:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.909933:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.909953:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760705.909960:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b277 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19111936->19116031] (req 19111936->19116031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760705.910064:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520851328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60481us (60795us total) trans 4294971986 rc 0/0
00000100:00100000:0.0:1789760705.910075:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4699
00000100:00100000:0.0:1789760705.910084:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677482993607 time 677536246375 state 0x2 ref 0
00000100:00100000:1.0:1789760705.918426:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760706.004596:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971987 is committed
00002000:00010000:1.0:1789760706.011882:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19116032 -> 19120128
00010000:00010000:1.0:1789760706.011903:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b27e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19116032->19120127] (req 19116032->19120127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.011923:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b27e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19116032->19120127] (req 19116032->19120127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.011932:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b27e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19116032->19120127] (req 19116032->19120127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.011940:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760706.011944:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b27e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19116032->19120127] (req 19116032->19120127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.011954:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b27e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19116032->19120127] (req 19116032->19120127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.011973:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b27e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19116032->19120127] (req 19116032->19120127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.011981:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b27e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19116032->19120127] (req 19116032->19120127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760706.012111:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 93419us (93795us total) trans 4294971987 rc 0/0
00000100:00100000:1.0:1789760706.012122:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4700
00000100:00100000:1.0:1789760706.012131:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677536506791 time 677605356993 state 0x2 ref 0
00000100:00100000:2.0:1789760706.039231:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.039454:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520851584
00000100:00100000:0.0:1789760706.039463:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520851584
00000100:00100000:0.0:1789760706.039543:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677536506791 time 677605356993 state 0x0 ref 1
00000100:00100000:0.0:1789760706.039558:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677605617409 time 677605356993 state 0x1 ref 1
00000100:00080000:1.0:1789760706.039674:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760706.039955:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677605617409 time 677726636931 state 0x0 ref 1
00000100:00100000:0.0:1789760706.039970:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520851584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.040145:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19120128, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.040154:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.040170:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:0.0:1789760706.040174:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.040180:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.040193:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760706.159263:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971988 is committed
00002000:00010000:2.0:1789760706.159593:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19120128 -> 19124224
00010000:00010000:2.0:1789760706.159609:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.159621:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.159630:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.159653:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760706.159659:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.159667:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.159687:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.159701:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b285 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19120128->19124223] (req 19120128->19124223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760706.159795:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520851584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 119824us (120570us total) trans 4294971988 rc 0/0
00000100:00100000:2.0:1789760706.159806:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4701
00000100:00100000:2.0:1789760706.159815:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677605617409 time 677726636931 state 0x2 ref 0
00000100:00100000:2.0:1789760706.175783:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.176347:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520851712
00000100:00100000:0.0:1789760706.176358:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520851712
00000100:00100000:0.0:1789760706.176409:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677605617409 time 677726636931 state 0x0 ref 1
00000100:00100000:0.0:1789760706.176425:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677726897347 time 677726636931 state 0x1 ref 1
00000100:00100000:0.0:1789760706.176451:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677726897347 time 677863132968 state 0x0 ref 1
00000100:00100000:0.0:1789760706.176463:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.176509:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19124224, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.176518:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.176543:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:0.0:1789760706.176549:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.176555:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.176569:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760706.223458:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19124224 -> 19128320
00010000:00010000:0.0:1789760706.223478:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.223491:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.223500:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.223508:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760706.223513:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.223521:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.223549:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.223557:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b28c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19124224->19128319] (req 19124224->19128319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.223652:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520851712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47174us (47861us total) trans 4294971989 rc 0/0
00000100:00100000:0.0:1789760706.223663:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4702
00000100:00100000:0.0:1789760706.223672:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677726897347 time 677863132968 state 0x2 ref 0
00000100:00100000:1.0:1789760706.227290:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760706.227435:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520851840
00000100:00100000:2.0:1789760706.227444:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520851840
00000100:00100000:2.0:1789760706.227495:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677726897347 time 677863132968 state 0x0 ref 1
00000100:00100000:2.0:1789760706.227510:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677863393384 time 677863132968 state 0x1 ref 1
00000100:00100000:2.0:1789760706.227630:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677863393384 time 677914311127 state 0x0 ref 1
00000100:00100000:2.0:1789760706.227652:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760706.227697:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19128320, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:2.0:1789760706.227707:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.227722:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:2.0:1789760706.227726:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760706.227732:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.227747:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760706.256515:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971990 is committed
00002000:00010000:0.0:1789760706.256677:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19128320 -> 19132416
00010000:00010000:0.0:1789760706.256693:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.256707:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.256717:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.256730:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760706.256736:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.256745:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.256763:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.256771:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b293 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19128320->19132415] (req 19128320->19132415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.256899:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520851840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29246us (29609us total) trans 4294971990 rc 0/0
00000100:00100000:0.0:1789760706.256910:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4703
00000100:00100000:0.0:1789760706.256918:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677863393384 time 677914311127 state 0x2 ref 0
00000100:00100000:0.0:1789760706.261281:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760706.261810:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520851968
00000100:00100000:1.0:1789760706.261819:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520851968
00000100:00100000:1.0:1789760706.261869:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677863393384 time 677914311127 state 0x0 ref 1
00000100:00100000:1.0:1789760706.261884:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677914571543 time 677914311127 state 0x1 ref 1
00000100:00100000:1.0:1789760706.261912:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677914571543 time 677948595411 state 0x0 ref 1
00000100:00100000:1.0:1789760706.261923:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520851968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760706.261965:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19132416, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:1.0:1789760706.261975:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.261990:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=677s v=(0 0)
00010000:00010000:1.0:1789760706.261994:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760706.262000:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.262024:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760706.310963:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971991 is committed
00002000:00010000:1.0:1789760706.311045:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19132416 -> 19136512
00010000:00010000:1.0:1789760706.311061:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.311079:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.311089:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.311097:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760706.311102:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.311111:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.311130:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760706.311137:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b29a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19132416->19136511] (req 19132416->19136511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760706.311221:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520851968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49294us (49946us total) trans 4294971991 rc 0/0
00000100:00100000:1.0:1789760706.311232:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4704
00000100:00100000:1.0:1789760706.311241:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677914571543 time 677948595411 state 0x2 ref 0
00000100:00100000:1.0:1789760706.315245:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.315434:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520852096
00000100:00100000:0.0:1789760706.315445:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520852096
00000100:00100000:0.0:1789760706.315500:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677914571543 time 677948595411 state 0x0 ref 1
00000100:00100000:0.0:1789760706.315514:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677948855827 time 677948595411 state 0x1 ref 1
00000100:00100000:0.0:1789760706.315556:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677948855827 time 678002238195 state 0x0 ref 1
00000100:00100000:0.0:1789760706.315569:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520852096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.315616:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19136512, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.315625:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.315754:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760706.315758:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.315765:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.315781:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760706.365214:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19136512 -> 19140608
00010000:00010000:0.0:1789760706.365228:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.365242:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.365252:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.365259:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760706.365264:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.365274:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.365292:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.365299:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b2a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19136512->19140607] (req 19136512->19140607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.365403:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520852096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49832us (50163us total) trans 4294971992 rc 0/0
00000100:00100000:0.0:1789760706.365414:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4705
00000100:00100000:0.0:1789760706.365423:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677948855827 time 678002238195 state 0x2 ref 0
00000100:00100000:0.0:1789760706.368977:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520852224
00000100:00100000:0.0:1789760706.368987:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520852224
00000100:00100000:0.0:1789760706.369052:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 677948855827 time 678002238195 state 0x0 ref 1
00000100:00100000:0.0:1789760706.369068:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678002498611 time 678002238195 state 0x1 ref 1
00000100:00100000:0.0:1789760706.369091:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678002498611 time 678055773443 state 0x0 ref 1
00000100:00100000:0.0:1789760706.369103:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520852224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.369150:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19140608, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.369159:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.369176:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760706.369179:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.369185:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.369198:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760706.396195:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19140608 -> 19144704
00010000:00010000:0.0:1789760706.396215:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.396229:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.396237:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.396245:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760706.396249:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.396259:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.396276:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.396285:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19140608->19144703] (req 19140608->19144703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.396398:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520852224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27292us (27608us total) trans 4294971993 rc 0/0
00000100:00100000:0.0:1789760706.396408:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4706
00000100:00100000:0.0:1789760706.396417:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678002498611 time 678055773443 state 0x2 ref 0
00000100:00100000:2.0:1789760706.399915:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.399975:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520852352
00000100:00100000:0.0:1789760706.399984:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520852352
00000100:00100000:0.0:1789760706.400045:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678002498611 time 678055773443 state 0x0 ref 1
00000100:00100000:0.0:1789760706.400059:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678056033859 time 678055773443 state 0x1 ref 1
00000100:00100000:0.0:1789760706.400088:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678056033859 time 678086771219 state 0x0 ref 1
00000100:00100000:0.0:1789760706.400100:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520852352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.400145:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19144704, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.400155:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.400171:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760706.400175:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.400181:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.400202:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760706.424419:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19144704 -> 19148800
00010000:00010000:0.0:1789760706.424435:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.424446:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.424455:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.424461:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760706.424466:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.424476:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.424496:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.424503:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19144704->19148799] (req 19144704->19148799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.424609:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520852352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24506us (24694us total) trans 4294971994 rc 0/0
00000100:00100000:0.0:1789760706.424620:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4707
00000100:00100000:0.0:1789760706.425208:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678056033859 time 678086771219 state 0x2 ref 0
00000100:00100000:0.0:1789760706.427113:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760706.427271:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520852480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760706.427343:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19148800, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:3.0:1789760706.427353:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.427369:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:3.0:1789760706.427373:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760706.427379:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.427389:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760706.472337:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971995 is committed
00002000:00010000:2.0:1789760706.472501:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19148800 -> 19152896
00010000:00010000:2.0:1789760706.472518:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.472588:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.472599:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.472607:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760706.472613:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.472622:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.472709:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.472718:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19148800->19152895] (req 19148800->19152895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760706.472897:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520852480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45623us (45788us total) trans 4294971995 rc 0/0
00000100:00100000:2.0:1789760706.472908:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4708
00000100:00100000:2.0:1789760706.472918:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678087031635 time 678113941462 state 0x2 ref 0
00000100:00100000:2.0:1789760706.484225:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.484406:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520852608
00000100:00100000:0.0:1789760706.484415:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520852608
00000100:00100000:0.0:1789760706.484471:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678087031635 time 678113941462 state 0x0 ref 1
00000100:00100000:0.0:1789760706.484487:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678114201878 time 678113941462 state 0x1 ref 1
00000100:00100000:0.0:1789760706.484606:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678114201878 time 678171287838 state 0x0 ref 1
00000100:00100000:0.0:1789760706.484620:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520852608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.484677:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19152896, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.484686:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.484701:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760706.484705:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.484711:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.484725:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760706.521879:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971996 is committed
00002000:00010000:0.0:1789760706.522045:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19152896 -> 19156992
00010000:00010000:0.0:1789760706.522061:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.522075:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.522085:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.522093:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760706.522098:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.522108:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.522127:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.522135:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19152896->19156991] (req 19152896->19156991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.522234:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520852608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37611us (38014us total) trans 4294971996 rc 0/0
00000100:00100000:0.0:1789760706.522249:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4709
00000100:00100000:0.0:1789760706.522259:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678114201878 time 678171287838 state 0x2 ref 0
00000100:00100000:2.0:1789760706.529523:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.529674:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520852736
00000100:00100000:0.0:1789760706.529685:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520852736
00000100:00100000:0.0:1789760706.529740:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678114201878 time 678171287838 state 0x0 ref 1
00000100:00100000:0.0:1789760706.529755:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678171548254 time 678171287838 state 0x1 ref 1
00000100:00100000:0.0:1789760706.529888:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678171548254 time 678216569297 state 0x0 ref 1
00000100:00100000:0.0:1789760706.529901:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520852736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.529947:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19156992, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.529956:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.529972:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760706.529976:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.529983:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.529997:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760706.569258:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971997 is committed
00002000:00010000:0.0:1789760706.569379:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19156992 -> 19161088
00010000:00010000:0.0:1789760706.569395:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.569408:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.569417:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.569425:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760706.569430:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.569440:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.569458:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.569466:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19156992->19161087] (req 19156992->19161087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.570143:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520852736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39860us (40245us total) trans 4294971997 rc 0/0
00000100:00100000:0.0:1789760706.570155:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4710
00000100:00100000:0.0:1789760706.570167:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678171548254 time 678216569297 state 0x2 ref 0
00000100:00100000:2.0:1789760706.573458:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.575494:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520852864
00000100:00100000:0.0:1789760706.575508:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520852864
00000100:00100000:2.0:1789760706.578197:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678171548254 time 678216569297 state 0x0 ref 1
00000100:00100000:2.0:1789760706.578215:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678216829713 time 678216569297 state 0x1 ref 1
00000100:00100000:2.0:1789760706.578307:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678216829713 time 678264988946 state 0x0 ref 1
00000100:00100000:2.0:1789760706.578337:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520852864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760706.578387:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19161088, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:2.0:1789760706.578396:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.578412:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:2.0:1789760706.578417:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760706.578423:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.578443:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760706.621158:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971998 is committed
00002000:00010000:3.0:1789760706.621255:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19161088 -> 19165184
00010000:00010000:3.0:1789760706.621271:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.621283:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.621291:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.621298:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760706.621302:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.621419:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.621439:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.621447:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b2cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19161088->19165183] (req 19161088->19165183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760706.621578:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520852864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43242us (48125us total) trans 4294971998 rc 0/0
00000100:00100000:3.0:1789760706.621589:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4711
00000100:00100000:3.0:1789760706.621597:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678216829713 time 678264988946 state 0x2 ref 0
00000100:00100000:2.0:1789760706.626570:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760706.626851:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520852992
00000100:00100000:3.0:1789760706.626862:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520852992
00000100:00100000:3.0:1789760706.626929:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678216829713 time 678264988946 state 0x0 ref 1
00000100:00100000:3.0:1789760706.626943:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678265249362 time 678264988946 state 0x1 ref 1
00000100:00100000:3.0:1789760706.626971:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678265249362 time 678313654078 state 0x0 ref 1
00000100:00100000:3.0:1789760706.626982:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520852992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760706.627369:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19165184, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:3.0:1789760706.627379:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.627396:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:3.0:1789760706.627401:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760706.627407:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.627421:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760706.675907:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294971999 is committed
00002000:00010000:3.0:1789760706.676099:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19165184 -> 19169280
00010000:00010000:3.0:1789760706.676116:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.676130:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.676139:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.676147:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760706.676152:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.676162:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.676183:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.676191:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19165184->19169279] (req 19165184->19169279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760706.676364:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520852992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49377us (50051us total) trans 4294971999 rc 0/0
00000100:00100000:3.0:1789760706.676375:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4712
00000100:00100000:3.0:1789760706.676384:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678265249362 time 678313654078 state 0x2 ref 0
00000100:00100000:1.0:1789760706.681817:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789760706.681841:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548736640:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760706.681912:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.682231:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548736640
00000100:00100000:0.0:1789760706.682240:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548736640
00000100:00100000:0.0:1789760706.682303:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332
00000100:00100000:0.0:1789760706.682335:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548736640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1789760706.682381:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00080000:1.0:1789760706.682745:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1789760706.683358:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548736640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1044us (1443us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.683368:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332
00000100:00100000:1.0:1789760706.685572:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548736640:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760706.687884:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.688255:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548737152:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.688304:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.688374:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548737664:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.688401:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.688420:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548738176:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.688438:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.688474:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:0.0:1789760706.688480:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548736768:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.688508:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.688539:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548737280:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.688864:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.688893:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548737792:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.688915:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.688941:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548736896:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.688995:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.689088:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548737408:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.689114:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.689134:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548737920:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.689155:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.689177:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:0.0:1789760706.689183:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548737024:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.689205:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.689221:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548737536:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.689242:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.689258:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548738048:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.689278:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760706.689305:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548737152
00000100:00100000:0.0:1789760706.689335:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548737152
00000100:00100000:3.0:1789760706.689433:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520853120
00000100:00100000:3.0:1789760706.689438:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520853120
00000100:00100000:3.0:1789760706.689490:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678265249362 time 678313654078 state 0x0 ref 1
00000100:00100000:3.0:1789760706.689506:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678313914494 time 678313654078 state 0x1 ref 1
00000100:00100000:3.0:1789760706.689539:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678313914494 time 678376211267 state 0x0 ref 1
00000100:00100000:3.0:1789760706.689552:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520853120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760706.689609:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19169280, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:3.0:1789760706.689619:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.689877:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:3.0:1789760706.689882:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760706.689889:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.689910:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.690105:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548736896
00000100:00100000:0.0:1789760706.690110:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548736896
00000100:00100000:0.0:1789760706.690125:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548737408
00000100:00100000:0.0:1789760706.690127:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548737408
00000100:00100000:0.0:1789760706.690155:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548737920
00000100:00100000:0.0:1789760706.690157:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548737920
00000100:00100000:0.0:1789760706.690170:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548737536
00000100:00100000:0.0:1789760706.690172:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548737536
00000100:00100000:0.0:1789760706.690187:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548738048
00000100:00100000:0.0:1789760706.690189:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548738048
00000100:00100000:0.0:1789760706.690202:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807
00000100:00100000:0.0:1789760706.690209:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548737152:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.690268:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548737152:12345-0@lo:400:kworker.0 Request processed in 58us (1963us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.690276:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807
00000100:00100000:0.0:1789760706.690292:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808
00000100:00100000:0.0:1789760706.690299:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548736896:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.690379:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548736896:12345-0@lo:400:kworker.0 Request processed in 80us (1382us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.690385:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808
00000100:00100000:0.0:1789760706.690398:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809
00000100:00100000:0.0:1789760706.690404:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548737408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.690432:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548737408:12345-0@lo:400:kworker.0 Request processed in 29us (1317us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.690438:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809
00000100:00100000:0.0:1789760706.690449:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810
00000100:00100000:0.0:1789760706.690456:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548737920:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.690483:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548737920:12345-0@lo:400:kworker.0 Request processed in 28us (1327us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.690489:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810
00000100:00100000:0.0:1789760706.690501:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811
00000100:00100000:0.0:1789760706.690506:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548737536:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.690546:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548737536:12345-0@lo:400:kworker.0 Request processed in 40us (1303us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.690552:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811
00000100:00100000:1.0:1789760706.691264:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548737280
00000100:00100000:1.0:1789760706.691273:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548737280
00000100:00100000:1.0:1789760706.691334:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548737024
00000100:00100000:1.0:1789760706.691337:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548737024
00000100:00100000:1.0:1789760706.691356:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399
00000100:00100000:1.0:1789760706.691363:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548737280:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760706.691414:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548737280:12345-0@lo:400:kworker.0 Request processed in 52us (2550us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760706.691421:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399
00000100:00100000:1.0:1789760706.691435:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400
00000100:00100000:1.0:1789760706.691441:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548737024:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760706.691470:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548737024:12345-0@lo:400:kworker.0 Request processed in 29us (2264us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760706.691476:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400
00000100:00100000:0.0:1789760706.691883:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812
00000100:00100000:0.0:1789760706.691893:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548738048:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.691927:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548738048:12345-0@lo:400:kworker.0 Request processed in 36us (2648us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.691933:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812
00000100:00100000:0.0:1789760706.691954:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548737664
00000100:00100000:0.0:1789760706.691958:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548737664
00000100:00100000:0.0:1789760706.691982:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548738176
00000100:00100000:0.0:1789760706.691985:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548738176
00000100:00100000:0.0:1789760706.692100:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548737792
00000100:00100000:0.0:1789760706.692104:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548737792
00000100:00100000:0.0:1789760706.692123:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261
00000100:00100000:0.0:1789760706.692129:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548737664:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.692163:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548737664:12345-0@lo:400:kworker.0 Request processed in 34us (3760us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.692169:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261
00000100:00100000:0.0:1789760706.692182:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262
00000100:00100000:0.0:1789760706.692188:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548738176:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.692219:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548738176:12345-0@lo:400:kworker.0 Request processed in 31us (3779us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.692225:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262
00000100:00100000:0.0:1789760706.692238:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263
00000100:00100000:0.0:1789760706.692244:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548737792:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.692271:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548737792:12345-0@lo:400:kworker.0 Request processed in 28us (3355us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.692277:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263
00000100:00100000:0.0:1789760706.692710:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548736768
00000100:00100000:0.0:1789760706.692716:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548736768
00000100:00100000:0.0:1789760706.692793:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457
00000100:00100000:0.0:1789760706.692802:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda0058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548736768:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.692837:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda0058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548736768:12345-0@lo:400:kworker.0 Request processed in 37us (4327us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760706.692843:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457
00000100:00100000:1.0:1789760706.694110:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548738304:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760706.694163:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760706.694259:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548738304
00000100:00100000:3.0:1789760706.694266:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548738304
00000100:00100000:3.0:1789760706.694330:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333
00000100:00100000:3.0:1789760706.694339:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548738304:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:3.0:1789760706.694370:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:3.0:1789760706.694419:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548738304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (256us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760706.694426:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333
00000100:00100000:1.0:1789760706.694553:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548738304:0@lo:13:osp-pre-1-0.0
00000100:00080000:0.0:1789760706.694962:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:0.0:1789760706.694968:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1789760706.694971:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:0.0:1789760706.695093:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548737024:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695106:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548737536:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695117:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548738048:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695129:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548736896:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695139:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548737408:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695150:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548737920:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695189:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548736768:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695200:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548737280:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695210:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548737792:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.695223:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548737152:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.696214:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548737664:0@lo:400:kworker.0
00000100:00100000:0.0:1789760706.696227:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548738176:0@lo:400:kworker.0
00000001:00080000:1.0:1789760706.733466:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972000 is committed
00002000:00010000:3.0:1789760706.733606:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19169280 -> 19173376
00010000:00010000:3.0:1789760706.733623:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.733700:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.733711:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.733719:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760706.733724:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.733737:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.733755:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.733764:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19169280->19173375] (req 19169280->19173375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760706.733900:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520853120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44343us (46016us total) trans 4294972000 rc 0/0
00000100:00100000:3.0:1789760706.733911:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4713
00000100:00100000:3.0:1789760706.733920:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678313914494 time 678376211267 state 0x2 ref 0
00000100:00100000:3.0:1789760706.737122:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.737256:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520853248
00000100:00100000:0.0:1789760706.737265:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520853248
00000100:00100000:0.0:1789760706.737380:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678313914494 time 678376211267 state 0x0 ref 1
00000100:00100000:0.0:1789760706.737396:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678376471683 time 678376211267 state 0x1 ref 1
00000100:00100000:0.0:1789760706.737449:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678376471683 time 678424132132 state 0x0 ref 1
00000100:00100000:0.0:1789760706.737462:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520853248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.737506:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19173376, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.737515:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.737530:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760706.737535:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.737550:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.737565:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760706.773373:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19173376 -> 19177472
00010000:00010000:0.0:1789760706.773394:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.773406:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.773414:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.773421:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760706.773426:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.773434:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.773452:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.773459:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19173376->19177471] (req 19173376->19177471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760706.773624:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520853248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36159us (36506us total) trans 4294972001 rc 0/0
00000100:00100000:0.0:1789760706.773705:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4714
00000100:00100000:0.0:1789760706.773714:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678376471683 time 678424132132 state 0x2 ref 0
00000100:00100000:3.0:1789760706.777751:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.778213:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520853376
00000100:00100000:0.0:1789760706.778223:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520853376
00000100:00100000:0.0:1789760706.778276:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678376471683 time 678424132132 state 0x0 ref 1
00000100:00100000:0.0:1789760706.778291:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678424392548 time 678424132132 state 0x1 ref 1
00000100:00100000:0.0:1789760706.778309:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678424392548 time 678464992783 state 0x0 ref 1
00000100:00100000:0.0:1789760706.778345:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520853376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.778394:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19177472, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:0.0:1789760706.778403:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.778420:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760706.778424:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.778430:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.778443:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760706.779174:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972001 is committed
00000001:00080000:1.0:1789760706.832619:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972002 is committed
00002000:00010000:3.0:1789760706.832856:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19177472 -> 19181568
00010000:00010000:3.0:1789760706.832871:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.832884:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.832893:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.832906:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760706.832911:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.832920:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.832937:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.832944:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b2e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19177472->19181567] (req 19177472->19181567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760706.833093:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520853376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54746us (55346us total) trans 4294972002 rc 0/0
00000100:00100000:3.0:1789760706.833104:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4715
00000100:00100000:3.0:1789760706.833113:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678424392548 time 678464992783 state 0x2 ref 0
00000100:00100000:1.0:1789760706.837721:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760706.837809:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520853504
00000100:00100000:3.0:1789760706.837820:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520853504
00000100:00100000:3.0:1789760706.837876:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678424392548 time 678464992783 state 0x0 ref 1
00000100:00100000:3.0:1789760706.837892:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678465253199 time 678464992783 state 0x1 ref 1
00000100:00100000:3.0:1789760706.837966:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678465253199 time 678524647535 state 0x0 ref 1
00000100:00100000:3.0:1789760706.837982:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520853504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760706.838099:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19181568, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:3.0:1789760706.838108:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.838124:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:3.0:1789760706.838129:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760706.838136:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.838150:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760706.888397:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19181568 -> 19185664
00010000:00010000:3.0:1789760706.888419:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.888433:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.888441:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.888449:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760706.888454:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.888464:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.888827:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.888837:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b2ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19181568->19185663] (req 19181568->19185663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760706.888972:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520853504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50987us (51255us total) trans 4294972003 rc 0/0
00000100:00100000:3.0:1789760706.888982:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4716
00000100:00100000:3.0:1789760706.888991:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678465253199 time 678524647535 state 0x2 ref 0
00000001:00080000:1.0:1789760706.889173:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972003 is committed
00000100:00100000:2.0:1789760706.894395:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760706.894702:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520853632
00000100:00100000:3.0:1789760706.894712:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520853632
00000100:00100000:3.0:1789760706.894766:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678465253199 time 678524647535 state 0x0 ref 1
00000100:00100000:3.0:1789760706.894780:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678524907951 time 678524647535 state 0x1 ref 1
00000100:00100000:3.0:1789760706.894894:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678524907951 time 678581575467 state 0x0 ref 1
00000100:00100000:3.0:1789760706.894906:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520853632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760706.894956:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19185664, mtime: 0x6aad94c3, atime: 0x0, ctime: 0x6aad94c3, blocks: 0x9807
00010000:00010000:3.0:1789760706.894964:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.894981:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:3.0:1789760706.894986:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760706.894992:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760706.895104:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760706.951929:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972004 is committed
00002000:00010000:2.0:1789760706.953665:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19185664 -> 19189760
00002000:00010000:2.0:1789760706.953673:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760707 -> 1789760708
00002000:00010000:2.0:1789760706.953675:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760707 -> 1789760708
00010000:00010000:2.0:1789760706.953689:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.953702:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.953711:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.953719:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760706.953723:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.953732:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.953762:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760706.953770:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b2f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19185664->19189759] (req 19185664->19189759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760706.953867:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520853632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58958us (59478us total) trans 4294972004 rc 0/0
00000100:00100000:2.0:1789760706.953877:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4717
00000100:00100000:2.0:1789760706.953887:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678524907951 time 678581575467 state 0x2 ref 0
00000100:00100000:1.0:1789760706.960946:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760706.961214:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520853760
00000100:00100000:0.0:1789760706.961224:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520853760
00000100:00100000:0.0:1789760706.961277:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678524907951 time 678581575467 state 0x0 ref 1
00000100:00100000:0.0:1789760706.961293:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678581835883 time 678581575467 state 0x1 ref 1
00000100:00100000:0.0:1789760706.961356:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678581835883 time 678648038765 state 0x0 ref 1
00000100:00100000:0.0:1789760706.961369:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520853760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760706.961416:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19189760, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:0.0:1789760706.961425:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.961441:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760706.961445:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760706.961451:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760706.961469:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760707.023406:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19189760 -> 19193856
00010000:00010000:3.0:1789760707.023424:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.023438:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.023447:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.023454:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760707.023459:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.023469:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.023497:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.023505:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b2fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19189760->19193855] (req 19189760->19193855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760707.023593:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520853760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62221us (62652us total) trans 4294972005 rc 0/0
00000100:00100000:3.0:1789760707.023604:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4718
00000100:00100000:3.0:1789760707.023613:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678581835883 time 678648038765 state 0x2 ref 0
00000001:00080000:2.0:1789760707.024990:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972005 is committed
00000100:00100000:1.0:1789760707.033135:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760707.034670:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520853888
00000100:00100000:0.0:1789760707.034684:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520853888
00000100:00100000:0.0:1789760707.034742:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678581835883 time 678648038765 state 0x0 ref 1
00000100:00100000:0.0:1789760707.034757:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678648299181 time 678648038765 state 0x1 ref 1
00000100:00100000:0.0:1789760707.034792:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678648299181 time 678721475476 state 0x0 ref 1
00000100:00100000:0.0:1789760707.034805:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520853888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760707.034853:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19193856, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:0.0:1789760707.034862:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.034878:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:0.0:1789760707.034882:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760707.034887:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.034900:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760707.107393:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19193856 -> 19197952
00010000:00010000:3.0:1789760707.107416:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.107429:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.107439:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.107447:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760707.107451:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.107460:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.107484:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.107492:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b303 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19193856->19197951] (req 19193856->19197951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760707.107678:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972006 is committed
00000100:00100000:3.0:1789760707.107875:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520853888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73066us (74743us total) trans 4294972006 rc 0/0
00000100:00100000:3.0:1789760707.107886:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4719
00000100:00100000:3.0:1789760707.107895:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678648299181 time 678721475476 state 0x2 ref 0
00000100:00100000:0.0:1789760707.120827:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760707.120926:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520854016
00000100:00100000:3.0:1789760707.120938:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520854016
00000100:00100000:3.0:1789760707.120993:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678648299181 time 678721475476 state 0x0 ref 1
00000100:00100000:3.0:1789760707.121018:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678721735892 time 678721475476 state 0x1 ref 1
00000100:00100000:3.0:1789760707.121176:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678721735892 time 678807856534 state 0x0 ref 1
00000100:00100000:3.0:1789760707.121190:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520854016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760707.121240:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19197952, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:3.0:1789760707.121248:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.121263:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:3.0:1789760707.121268:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760707.121274:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.121287:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.138731:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760707.230954:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972007 is committed
00002000:00010000:3.0:1789760707.231217:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19197952 -> 19202048
00010000:00010000:3.0:1789760707.231232:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.231246:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.231255:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.231262:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760707.231268:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.231277:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.231294:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.231301:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b30a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19197952->19202047] (req 19197952->19202047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760707.231434:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520854016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 110242us (110611us total) trans 4294972007 rc 0/0
00000100:00100000:3.0:1789760707.231443:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4720
00000100:00100000:3.0:1789760707.231452:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678721735892 time 678807856534 state 0x2 ref 0
00000100:00100000:0.0:1789760707.236184:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760707.236721:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520854144
00000100:00100000:1.0:1789760707.236733:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520854144
00000100:00100000:1.0:1789760707.236787:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678721735892 time 678807856534 state 0x0 ref 1
00000100:00100000:1.0:1789760707.236803:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678808116950 time 678807856534 state 0x1 ref 1
00000100:00100000:1.0:1789760707.236837:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678808116950 time 678923519317 state 0x0 ref 1
00000100:00100000:1.0:1789760707.236850:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520854144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760707.236900:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19202048, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:1.0:1789760707.236910:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.236925:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:1.0:1789760707.236930:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760707.236936:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.236952:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760707.279217:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972008 is committed
00002000:00010000:1.0:1789760707.279448:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19202048 -> 19206144
00010000:00010000:1.0:1789760707.279463:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.279477:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.279487:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.279494:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760707.279500:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.279509:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.279537:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.279545:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b311 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19202048->19206143] (req 19202048->19206143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760707.279845:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520854144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42780us (43454us total) trans 4294972008 rc 0/0
00000100:00100000:1.0:1789760707.279861:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4721
00000100:00100000:1.0:1789760707.279870:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678808116950 time 678923519317 state 0x2 ref 0
00000100:00100000:2.0:1789760707.291901:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760707.292131:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520854272
00000100:00100000:1.0:1789760707.292141:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520854272
00000100:00100000:1.0:1789760707.292196:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678808116950 time 678923519317 state 0x0 ref 1
00000100:00100000:1.0:1789760707.292212:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678923779733 time 678923519317 state 0x1 ref 1
00000100:00100000:1.0:1789760707.292294:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678923779733 time 678978975075 state 0x0 ref 1
00000100:00100000:1.0:1789760707.292307:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520854272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760707.292389:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19206144, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:1.0:1789760707.292399:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.292416:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=678s v=(0 0)
00010000:00010000:1.0:1789760707.292420:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760707.292426:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.292440:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760707.360405:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972009 is committed
00002000:00010000:2.0:1789760707.362254:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19206144 -> 19210240
00010000:00010000:2.0:1789760707.362272:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.362285:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.362295:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.362329:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760707.362334:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.362343:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.362365:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.362372:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b318 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19206144->19210239] (req 19206144->19210239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760707.362478:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520854272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70168us (70580us total) trans 4294972009 rc 0/0
00000100:00100000:2.0:1789760707.362490:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4722
00000100:00100000:2.0:1789760707.362499:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678923779733 time 678978975075 state 0x2 ref 0
00000100:00100000:2.0:1789760707.365442:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760707.365523:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520854400
00000100:00100000:3.0:1789760707.365542:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520854400
00000100:00100000:3.0:1789760707.365596:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678923779733 time 678978975075 state 0x0 ref 1
00000100:00100000:3.0:1789760707.365610:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678979235491 time 678978975075 state 0x1 ref 1
00000100:00100000:3.0:1789760707.365770:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678979235491 time 679052450779 state 0x0 ref 1
00000100:00100000:3.0:1789760707.365785:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520854400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760707.365830:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19210240, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:3.0:1789760707.365839:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.365855:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:3.0:1789760707.365859:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760707.365866:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.365880:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760707.423866:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19210240 -> 19214336
00010000:00010000:0.0:1789760707.423888:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.423902:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.423912:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.423919:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760707.423924:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.423933:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.423952:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.423961:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b31f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19210240->19214335] (req 19210240->19214335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760707.424078:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520854400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58291us (58640us total) trans 4294972010 rc 0/0
00000100:00100000:0.0:1789760707.424088:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4723
00000100:00100000:0.0:1789760707.424099:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678979235491 time 679052450779 state 0x2 ref 0
00000100:00100000:3.0:1789760707.427245:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760707.427289:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520854528
00000100:00100000:3.0:1789760707.427298:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520854528
00000100:00100000:3.0:1789760707.427372:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 678979235491 time 679052450779 state 0x0 ref 1
00000100:00100000:3.0:1789760707.427387:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679052711195 time 679052450779 state 0x1 ref 1
00000100:00100000:3.0:1789760707.427421:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679052711195 time 679114103371 state 0x0 ref 1
00000100:00100000:3.0:1789760707.427433:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520854528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760707.427483:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19214336, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:3.0:1789760707.427493:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.427511:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:3.0:1789760707.427516:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760707.427714:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.427734:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760707.428334:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972010 is committed
00002000:00010000:3.0:1789760707.463963:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19214336 -> 19218432
00010000:00010000:3.0:1789760707.463985:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.464017:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.464026:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.464033:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760707.464038:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.464047:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.464066:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.464074:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b326 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19214336->19218431] (req 19214336->19218431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760707.464172:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520854528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36736us (36932us total) trans 4294972011 rc 0/0
00000100:00100000:3.0:1789760707.464183:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4724
00000100:00100000:3.0:1789760707.464191:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679052711195 time 679114103371 state 0x2 ref 0
00000100:00100000:2.0:1789760707.468002:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760707.468083:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520854656
00000100:00100000:3.0:1789760707.468094:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520854656
00000100:00100000:3.0:1789760707.468147:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679052711195 time 679114103371 state 0x0 ref 1
00000100:00100000:3.0:1789760707.468163:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679114363787 time 679114103371 state 0x1 ref 1
00000100:00100000:3.0:1789760707.468195:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679114363787 time 679154877865 state 0x0 ref 1
00000100:00100000:3.0:1789760707.468208:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520854656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760707.468257:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19218432, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:3.0:1789760707.468278:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.468295:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:3.0:1789760707.468299:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760707.468306:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.468344:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760707.469286:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972011 is committed
00002000:00010000:3.0:1789760707.518460:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19218432 -> 19222528
00010000:00010000:3.0:1789760707.518489:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.518503:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.518518:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.518533:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760707.518538:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.518546:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.518566:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.518573:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b32d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19218432->19222527] (req 19218432->19222527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760707.518675:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520854656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50464us (50687us total) trans 4294972012 rc 0/0
00000100:00100000:3.0:1789760707.518685:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4725
00000100:00100000:3.0:1789760707.518694:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679114363787 time 679154877865 state 0x2 ref 0
00000001:00080000:0.0:1789760707.521431:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972012 is committed
00000100:00100000:2.0:1789760707.522842:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760707.523061:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520854784
00000100:00100000:0.0:1789760707.523071:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520854784
00000100:00100000:0.0:1789760707.523123:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679114363787 time 679154877865 state 0x0 ref 1
00000100:00100000:0.0:1789760707.523137:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679155138281 time 679154877865 state 0x1 ref 1
00000100:00100000:0.0:1789760707.523167:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679155138281 time 679209849189 state 0x0 ref 1
00000100:00100000:0.0:1789760707.523179:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520854784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760707.523227:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19222528, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:0.0:1789760707.523235:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.523251:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:0.0:1789760707.523256:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760707.523262:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.523277:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760707.570721:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972013 is committed
00002000:00010000:0.0:1789760707.570950:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19222528 -> 19226624
00010000:00010000:0.0:1789760707.570966:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.570980:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.571001:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.571011:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760707.571016:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.571024:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.571042:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.571051:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b334 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19222528->19226623] (req 19222528->19226623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760707.571144:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520854784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47962us (48303us total) trans 4294972013 rc 0/0
00000100:00100000:0.0:1789760707.571155:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4726
00000100:00100000:0.0:1789760707.571165:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679155138281 time 679209849189 state 0x2 ref 0
00000100:00100000:2.0:1789760707.576012:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760707.576145:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520854912
00000100:00100000:0.0:1789760707.576155:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520854912
00000100:00100000:0.0:1789760707.576209:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679155138281 time 679209849189 state 0x0 ref 1
00000100:00100000:0.0:1789760707.576225:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679210109605 time 679209849189 state 0x1 ref 1
00000100:00100000:0.0:1789760707.576255:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679210109605 time 679262937736 state 0x0 ref 1
00000100:00100000:0.0:1789760707.576269:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520854912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760707.576352:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19226624, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:0.0:1789760707.576362:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.576377:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:0.0:1789760707.576382:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760707.576388:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.576402:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760707.620359:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972014 is committed
00002000:00010000:0.0:1789760707.620452:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19226624 -> 19230720
00010000:00010000:0.0:1789760707.620478:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.620491:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.620505:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.620513:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760707.620517:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.620534:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.620552:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.620560:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b33b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19226624->19230719] (req 19226624->19230719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760707.620804:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520854912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44531us (44806us total) trans 4294972014 rc 0/0
00000100:00100000:0.0:1789760707.620815:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4727
00000100:00100000:0.0:1789760707.620824:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679210109605 time 679262937736 state 0x2 ref 0
00000100:00100000:2.0:1789760707.625443:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760707.625668:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520855040
00000100:00100000:0.0:1789760707.625678:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520855040
00000100:00100000:0.0:1789760707.625732:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679210109605 time 679262937736 state 0x0 ref 1
00000100:00100000:0.0:1789760707.625748:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679263198152 time 679262937736 state 0x1 ref 1
00000100:00100000:0.0:1789760707.625777:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679263198152 time 679312459029 state 0x0 ref 1
00000100:00100000:0.0:1789760707.625790:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520855040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760707.625836:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19230720, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:0.0:1789760707.625845:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.625860:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:0.0:1789760707.625865:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760707.625872:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.625885:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760707.652299:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972015 is committed
00002000:00010000:1.0:1789760707.652372:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19230720 -> 19234816
00010000:00010000:1.0:1789760707.652390:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.652402:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.652410:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.652417:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760707.652422:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.652432:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.652451:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.652459:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b342 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19230720->19234815] (req 19230720->19234815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760707.652668:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520855040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26874us (27228us total) trans 4294972015 rc 0/0
00000100:00100000:1.0:1789760707.652679:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4728
00000100:00100000:1.0:1789760707.652689:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679263198152 time 679312459029 state 0x2 ref 0
00000100:00100000:2.0:1789760707.664185:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760707.664274:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520855168
00000100:00100000:3.0:1789760707.664285:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520855168
00000100:00100000:3.0:1789760707.664359:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679263198152 time 679312459029 state 0x0 ref 1
00000100:00100000:3.0:1789760707.664379:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679312719445 time 679312459029 state 0x1 ref 1
00000100:00100000:3.0:1789760707.664410:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679312719445 time 679351092790 state 0x0 ref 1
00000100:00100000:3.0:1789760707.664422:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760707.664480:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19234816, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:3.0:1789760707.664491:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.664507:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:3.0:1789760707.664511:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760707.664518:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.664541:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760707.748418:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19234816 -> 19238912
00010000:00010000:3.0:1789760707.748439:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.748451:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.748460:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.748594:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760707.748600:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.748610:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.748698:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.748706:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b349 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19234816->19238911] (req 19234816->19238911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760707.748806:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520855168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 84382us (84629us total) trans 4294972016 rc 0/0
00000100:00100000:3.0:1789760707.748816:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4729
00000100:00100000:3.0:1789760707.748826:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679312719445 time 679351092790 state 0x2 ref 0
00000001:00080000:1.0:1789760707.748910:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972016 is committed
00000100:00100000:3.0:1789760707.755746:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760707.755819:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520855296
00000100:00100000:1.0:1789760707.755829:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520855296
00000100:00100000:1.0:1789760707.755884:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679312719445 time 679351092790 state 0x0 ref 1
00000100:00100000:1.0:1789760707.755898:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679351353206 time 679351092790 state 0x1 ref 1
00000100:00100000:1.0:1789760707.755933:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679351353206 time 679442615826 state 0x0 ref 1
00000100:00100000:1.0:1789760707.755948:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760707.756004:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19238912, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:1.0:1789760707.756013:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.756028:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:1.0:1789760707.756032:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760707.756037:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.756189:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760707.813730:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972017 is committed
00002000:00010000:1.0:1789760707.813811:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19238912 -> 19243008
00010000:00010000:1.0:1789760707.813827:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.813844:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.813853:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.813860:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760707.813865:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.813873:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.813891:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.813898:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b350 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19238912->19243007] (req 19238912->19243007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760707.814095:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58147us (58786us total) trans 4294972017 rc 0/0
00000100:00100000:1.0:1789760707.814106:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4730
00000100:00100000:1.0:1789760707.814116:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679351353206 time 679442615826 state 0x2 ref 0
00000100:00100000:1.0:1789760707.820121:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760707.820217:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520855424
00000100:00100000:0.0:1789760707.820227:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520855424
00000100:00100000:0.0:1789760707.820282:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679351353206 time 679442615826 state 0x0 ref 1
00000100:00100000:0.0:1789760707.820298:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679442876242 time 679442615826 state 0x1 ref 1
00000100:00100000:0.0:1789760707.820411:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679442876242 time 679507092073 state 0x0 ref 1
00000100:00100000:0.0:1789760707.820424:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760707.820479:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19243008, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:0.0:1789760707.820489:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.820504:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:0.0:1789760707.820508:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760707.820514:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760707.820536:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760707.861775:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972018 is committed
00002000:00010000:2.0:1789760707.861890:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19243008 -> 19247104
00010000:00010000:2.0:1789760707.861908:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.861921:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.861930:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.861938:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760707.861943:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.861952:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.861972:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.861981:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b357 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19243008->19247103] (req 19243008->19247103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760707.862089:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41662us (41972us total) trans 4294972018 rc 0/0
00000100:00100000:2.0:1789760707.862103:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4731
00000100:00100000:2.0:1789760707.862113:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679442876242 time 679507092073 state 0x2 ref 0
00000100:00100000:2.0:1789760707.866679:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760707.866806:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520855552
00000100:00100000:1.0:1789760707.866817:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520855552
00000100:00100000:1.0:1789760707.866869:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679442876242 time 679507092073 state 0x0 ref 1
00000100:00100000:1.0:1789760707.866882:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679507352489 time 679507092073 state 0x1 ref 1
00000100:00100000:1.0:1789760707.866910:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679507352489 time 679553593556 state 0x0 ref 1
00000100:00100000:1.0:1789760707.866921:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760707.866967:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19247104, mtime: 0x6aad94c4, atime: 0x0, ctime: 0x6aad94c4, blocks: 0x9807
00010000:00010000:1.0:1789760707.866975:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.867005:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:1.0:1789760707.867010:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760707.867016:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760707.867030:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760707.913100:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972019 is committed
00002000:00010000:2.0:1789760707.913273:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19247104 -> 19251200
00002000:00010000:2.0:1789760707.913278:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760708 -> 1789760709
00002000:00010000:2.0:1789760707.913281:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760708 -> 1789760709
00010000:00010000:2.0:1789760707.913293:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.913306:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.913353:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.913361:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760707.913366:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.913375:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.913396:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760707.913410:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b35e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19247104->19251199] (req 19247104->19251199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760707.913533:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46598us (46849us total) trans 4294972019 rc 0/0
00000100:00100000:2.0:1789760707.913543:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4732
00000100:00100000:2.0:1789760707.913553:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679507352489 time 679553593556 state 0x2 ref 0
00000100:00100000:0.0:1789760707.930413:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760707.931892:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520855680
00000100:00100000:3.0:1789760707.931905:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520855680
00000100:00100000:3.0:1789760707.931965:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679507352489 time 679553593556 state 0x0 ref 1
00000100:00100000:3.0:1789760707.931982:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679553853972 time 679553593556 state 0x1 ref 1
00000100:00100000:3.0:1789760707.932024:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679553853972 time 679618706797 state 0x0 ref 1
00000100:00100000:3.0:1789760707.932039:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760707.932088:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19251200, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:3.0:1789760707.932097:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.932113:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:3.0:1789760707.932117:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760707.932122:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760707.932136:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760708.008372:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19251200 -> 19255296
00010000:00010000:3.0:1789760708.008392:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.008406:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.008415:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.008423:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760708.008428:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.008438:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.008458:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.008466:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b365 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19251200->19255295] (req 19251200->19255295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760708.009623:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520855680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76586us (78219us total) trans 4294972020 rc 0/0
00000100:00100000:3.0:1789760708.009645:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4733
00000100:00100000:3.0:1789760708.009654:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679553853972 time 679618706797 state 0x2 ref 0
00000001:00080000:1.0:1789760708.010017:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972020 is committed
00000100:00100000:1.0:1789760708.012414:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760708.012611:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520855808
00000100:00100000:3.0:1789760708.012620:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520855808
00000100:00100000:3.0:1789760708.012905:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679553853972 time 679618706797 state 0x0 ref 1
00000100:00100000:3.0:1789760708.012920:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679618967213 time 679618706797 state 0x1 ref 1
00000100:00080000:1.0:1789760708.013001:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760708.013048:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679618967213 time 679699729786 state 0x0 ref 1
00000100:00100000:3.0:1789760708.013062:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520855808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760708.013109:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19255296, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:3.0:1789760708.013119:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.013135:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:3.0:1789760708.013140:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760708.013146:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.013161:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760708.048376:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19255296 -> 19259392
00010000:00010000:3.0:1789760708.048397:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.048410:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.048419:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.048425:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760708.048429:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.048436:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.048454:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.048462:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b36c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19255296->19259391] (req 19255296->19259391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760708.048580:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520855808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35517us (36170us total) trans 4294972021 rc 0/0
00000100:00100000:3.0:1789760708.048590:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4734
00000100:00100000:3.0:1789760708.048600:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679618967213 time 679699729786 state 0x2 ref 0
00000100:00100000:2.0:1789760708.054061:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760708.054096:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520855936
00000100:00100000:2.0:1789760708.054107:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520855936
00000100:00100000:2.0:1789760708.054161:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679618967213 time 679699729786 state 0x0 ref 1
00000100:00100000:2.0:1789760708.054177:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679699990202 time 679699729786 state 0x1 ref 1
00000100:00100000:2.0:1789760708.054203:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679699990202 time 679740886562 state 0x0 ref 1
00000100:00100000:2.0:1789760708.054216:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520855936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760708.054263:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19259392, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:2.0:1789760708.054272:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.054288:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:2.0:1789760708.054293:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760708.054298:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.054341:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760708.055284:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972021 is committed
00000001:00080000:1.0:1789760708.113434:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972022 is committed
00002000:00010000:2.0:1789760708.113557:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19259392 -> 19263488
00010000:00010000:2.0:1789760708.113573:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.113585:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.113593:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.113600:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760708.113605:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.113614:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.113749:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.113757:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b373 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19259392->19263487] (req 19259392->19263487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760708.113853:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520855936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59634us (59798us total) trans 4294972022 rc 0/0
00000100:00100000:2.0:1789760708.113864:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4735
00000100:00100000:2.0:1789760708.113873:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679699990202 time 679740886562 state 0x2 ref 0
00000100:00100000:0.0:1789760708.117914:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760708.118009:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520856064
00000100:00100000:2.0:1789760708.118018:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520856064
00000100:00100000:2.0:1789760708.118066:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679699990202 time 679740886562 state 0x0 ref 1
00000100:00100000:2.0:1789760708.118082:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679741146978 time 679740886562 state 0x1 ref 1
00000100:00100000:2.0:1789760708.118142:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679741146978 time 679804823826 state 0x0 ref 1
00000100:00100000:2.0:1789760708.118154:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520856064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760708.118196:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19263488, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:2.0:1789760708.118205:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.118220:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:2.0:1789760708.118225:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760708.118232:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.118245:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.153596:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760708.168273:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972023 is committed
00002000:00010000:1.0:1789760708.168386:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19263488 -> 19267584
00010000:00010000:1.0:1789760708.168401:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.168414:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.168424:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.168431:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760708.168435:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.168444:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.168464:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.168472:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b37a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19263488->19267583] (req 19263488->19267583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760708.168575:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520856064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50418us (50665us total) trans 4294972023 rc 0/0
00000100:00100000:1.0:1789760708.168585:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4736
00000100:00100000:1.0:1789760708.168595:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679741146978 time 679804823826 state 0x2 ref 0
00000100:00100000:1.0:1789760708.174945:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760708.175033:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520856192
00000100:00100000:2.0:1789760708.175042:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520856192
00000100:00100000:2.0:1789760708.175090:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679741146978 time 679804823826 state 0x0 ref 1
00000100:00100000:2.0:1789760708.175104:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679805084242 time 679804823826 state 0x1 ref 1
00000100:00100000:2.0:1789760708.175136:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679805084242 time 679861819182 state 0x0 ref 1
00000100:00100000:2.0:1789760708.175147:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520856192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760708.175193:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19267584, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:2.0:1789760708.175203:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.175218:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:2.0:1789760708.175222:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760708.175228:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.175242:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760708.228094:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972024 is committed
00002000:00010000:1.0:1789760708.228231:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19267584 -> 19271680
00010000:00010000:1.0:1789760708.228247:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.228261:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.228270:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.228278:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760708.228283:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.228293:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.228347:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.228356:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b381 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19267584->19271679] (req 19267584->19271679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760708.228443:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520856192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53293us (53502us total) trans 4294972024 rc 0/0
00000100:00100000:1.0:1789760708.228454:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4737
00000100:00100000:1.0:1789760708.228463:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679805084242 time 679861819182 state 0x2 ref 0
00000100:00100000:2.0:1789760708.237211:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760708.237398:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520856320
00000100:00100000:3.0:1789760708.237409:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520856320
00000100:00100000:3.0:1789760708.237468:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679805084242 time 679861819182 state 0x0 ref 1
00000100:00100000:3.0:1789760708.237485:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679862079598 time 679861819182 state 0x1 ref 1
00000100:00100000:3.0:1789760708.238717:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679862079598 time 679925392412 state 0x0 ref 1
00000100:00100000:3.0:1789760708.238740:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520856320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760708.238792:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19271680, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:3.0:1789760708.238801:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.238816:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:3.0:1789760708.238821:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760708.238827:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.238842:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760708.286361:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19271680 -> 19275776
00010000:00010000:3.0:1789760708.286382:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.286396:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.286404:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.286411:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760708.286415:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.286422:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.286442:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.286449:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b388 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19271680->19275775] (req 19271680->19275775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760708.287467:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520856320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48579us (50110us total) trans 4294972025 rc 0/0
00000100:00100000:3.0:1789760708.287480:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4738
00000100:00100000:3.0:1789760708.287490:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679862079598 time 679925392412 state 0x2 ref 0
00000001:00080000:0.0:1789760708.287795:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972025 is committed
00000100:00100000:2.0:1789760708.289791:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760708.289922:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520856448
00000100:00100000:0.0:1789760708.289931:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520856448
00000100:00100000:0.0:1789760708.289982:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679862079598 time 679925392412 state 0x0 ref 1
00000100:00100000:0.0:1789760708.290011:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679925652828 time 679925392412 state 0x1 ref 1
00000100:00100000:0.0:1789760708.290099:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679925652828 time 679976780020 state 0x0 ref 1
00000100:00100000:0.0:1789760708.290113:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520856448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760708.290170:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19275776, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:0.0:1789760708.290180:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760708.290196:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=679s v=(0 0)
00010000:00010000:0.0:1789760708.290200:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760708.290207:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760708.290222:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760708.336051:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972026 is committed
00002000:00010000:3.0:1789760708.336159:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19275776 -> 19279872
00010000:00010000:3.0:1789760708.336174:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.336187:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.336197:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.336205:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760708.336210:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.336219:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.336240:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.336252:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b38f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19275776->19279871] (req 19275776->19279871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760708.337025:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520856448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46908us (47235us total) trans 4294972026 rc 0/0
00000100:00100000:3.0:1789760708.337038:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4739
00000100:00100000:3.0:1789760708.337048:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679925652828 time 679976780020 state 0x2 ref 0
00000100:00100000:2.0:1789760708.342136:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760708.342226:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520856576
00000100:00100000:1.0:1789760708.342236:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520856576
00000100:00100000:1.0:1789760708.342289:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679925652828 time 679976780020 state 0x0 ref 1
00000100:00100000:1.0:1789760708.342303:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679977040436 time 679976780020 state 0x1 ref 1
00000100:00100000:1.0:1789760708.342725:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679977040436 time 680029196785 state 0x0 ref 1
00000100:00100000:1.0:1789760708.342745:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520856576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760708.342799:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19279872, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:1.0:1789760708.342807:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.342822:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:1.0:1789760708.342826:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760708.342833:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.342846:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760708.394117:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972027 is committed
00002000:00010000:1.0:1789760708.394205:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19279872 -> 19283968
00010000:00010000:1.0:1789760708.394220:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.394238:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.394247:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.394255:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760708.394259:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.394267:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.394285:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.394293:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b396 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19279872->19283967] (req 19279872->19283967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760708.394523:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520856576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51772us (52384us total) trans 4294972027 rc 0/0
00000100:00100000:1.0:1789760708.394533:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4740
00000100:00100000:1.0:1789760708.394550:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679977040436 time 680029196785 state 0x2 ref 0
00000100:00100000:1.0:1789760708.400128:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760708.400202:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520856704
00000100:00100000:3.0:1789760708.400212:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520856704
00000100:00100000:3.0:1789760708.400264:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 679977040436 time 680029196785 state 0x0 ref 1
00000100:00100000:3.0:1789760708.400280:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680029457201 time 680029196785 state 0x1 ref 1
00000100:00100000:3.0:1789760708.400339:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680029457201 time 680086994912 state 0x0 ref 1
00000100:00100000:3.0:1789760708.400354:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520856704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760708.400406:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19283968, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:3.0:1789760708.400417:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.400434:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:3.0:1789760708.400438:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760708.400445:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.400477:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760708.450272:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972028 is committed
00002000:00010000:3.0:1789760708.450379:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19283968 -> 19288064
00010000:00010000:3.0:1789760708.450394:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.450409:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.450418:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.450426:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760708.450431:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.450441:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.450463:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.450730:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b39d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19283968->19288063] (req 19283968->19288063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760708.450876:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520856704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50519us (50752us total) trans 4294972028 rc 0/0
00000100:00100000:3.0:1789760708.450886:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4741
00000100:00100000:3.0:1789760708.450895:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680029457201 time 680086994912 state 0x2 ref 0
00000100:00100000:2.0:1789760708.462506:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760708.462834:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520856832
00000100:00100000:1.0:1789760708.462843:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520856832
00000100:00100000:1.0:1789760708.462895:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680029457201 time 680086994912 state 0x0 ref 1
00000100:00100000:1.0:1789760708.462910:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680087255328 time 680086994912 state 0x1 ref 1
00000100:00100000:1.0:1789760708.462974:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680087255328 time 680149656693 state 0x0 ref 1
00000100:00100000:1.0:1789760708.462996:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520856832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760708.463054:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19288064, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:1.0:1789760708.463064:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.463080:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:1.0:1789760708.463085:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760708.463091:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.463104:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760708.510995:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19288064 -> 19292160
00010000:00010000:1.0:1789760708.511014:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.511027:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.511038:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.511045:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760708.511050:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.511059:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.511077:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.511084:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19288064->19292159] (req 19288064->19292159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760708.511166:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520856832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48176us (48666us total) trans 4294972029 rc 0/0
00000100:00100000:1.0:1789760708.511176:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4742
00000100:00100000:1.0:1789760708.511185:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680087255328 time 680149656693 state 0x2 ref 0
00000001:00080000:3.0:1789760708.511632:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972029 is committed
00000100:00100000:0.0:1789760708.515827:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760708.516017:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520856960
00000100:00100000:3.0:1789760708.516029:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520856960
00000100:00100000:3.0:1789760708.516106:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680087255328 time 680149656693 state 0x0 ref 1
00000100:00100000:3.0:1789760708.516124:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680149917109 time 680149656693 state 0x1 ref 1
00000100:00100000:3.0:1789760708.516158:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680149917109 time 680202840578 state 0x0 ref 1
00000100:00100000:3.0:1789760708.516171:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520856960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760708.516221:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19292160, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:3.0:1789760708.516231:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.516248:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:3.0:1789760708.516253:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760708.516260:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.516276:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760708.554299:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972030 is committed
00002000:00010000:2.0:1789760708.554437:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19292160 -> 19296256
00010000:00010000:2.0:1789760708.554453:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.554466:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.554475:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.554481:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760708.554486:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.554495:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.554525:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.554533:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b3ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19292160->19296255] (req 19292160->19296255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760708.554641:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520856960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38467us (38870us total) trans 4294972030 rc 0/0
00000100:00100000:2.0:1789760708.554656:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4743
00000100:00100000:2.0:1789760708.554666:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680149917109 time 680202840578 state 0x2 ref 0
00000100:00100000:0.0:1789760708.560753:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760708.560875:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520857088
00000100:00100000:2.0:1789760708.560886:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520857088
00000100:00100000:2.0:1789760708.560942:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680149917109 time 680202840578 state 0x0 ref 1
00000100:00100000:2.0:1789760708.560958:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680203100994 time 680202840578 state 0x1 ref 1
00000100:00100000:2.0:1789760708.561001:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680203100994 time 680247682694 state 0x0 ref 1
00000100:00100000:2.0:1789760708.561014:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520857088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760708.561064:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19296256, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:2.0:1789760708.561073:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.561088:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:2.0:1789760708.561092:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760708.561098:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.561111:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760708.621000:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972031 is committed
00002000:00010000:2.0:1789760708.621098:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19296256 -> 19300352
00010000:00010000:2.0:1789760708.621115:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.621130:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.621140:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.621148:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760708.621153:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.621162:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.621180:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.621188:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b3b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19296256->19300351] (req 19296256->19300351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760708.621280:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520857088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60265us (60737us total) trans 4294972031 rc 0/0
00000100:00100000:2.0:1789760708.621291:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4744
00000100:00100000:2.0:1789760708.621300:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680203100994 time 680247682694 state 0x2 ref 0
00000100:00100000:3.0:1789760708.626250:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760708.626406:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520857216
00000100:00100000:1.0:1789760708.626416:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520857216
00000100:00100000:1.0:1789760708.626488:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680203100994 time 680247682694 state 0x0 ref 1
00000100:00100000:1.0:1789760708.626505:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680247943110 time 680247682694 state 0x1 ref 1
00000100:00100000:1.0:1789760708.626580:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680247943110 time 680313262531 state 0x0 ref 1
00000100:00100000:1.0:1789760708.626594:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520857216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760708.626803:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19300352, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:1.0:1789760708.626813:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.626828:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:1.0:1789760708.626833:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760708.626839:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.626853:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760708.683413:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972032 is committed
00002000:00010000:1.0:1789760708.684010:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19300352 -> 19304448
00010000:00010000:1.0:1789760708.684029:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.684053:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.684062:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.684069:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760708.684075:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.684093:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.684112:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.684119:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19300352->19304447] (req 19300352->19304447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760708.684221:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520857216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57624us (57977us total) trans 4294972032 rc 0/0
00000100:00100000:1.0:1789760708.684231:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4745
00000100:00100000:1.0:1789760708.684241:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680247943110 time 680313262531 state 0x2 ref 0
00000100:00100000:2.0:1789760708.690027:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760708.692808:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520857344
00000100:00100000:1.0:1789760708.692826:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520857344
00000100:00100000:1.0:1789760708.692898:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680247943110 time 680313262531 state 0x0 ref 1
00000100:00100000:1.0:1789760708.692912:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680313522947 time 680313262531 state 0x1 ref 1
00000100:00100000:1.0:1789760708.692936:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680313522947 time 680379619719 state 0x0 ref 1
00000100:00100000:1.0:1789760708.692948:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520857344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760708.693366:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19304448, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:1.0:1789760708.693379:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.693397:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:1.0:1789760708.693402:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760708.693408:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.693421:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760708.783959:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972033 is committed
00002000:00010000:1.0:1789760708.784096:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19304448 -> 19308544
00010000:00010000:1.0:1789760708.784112:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.784125:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.784135:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.784143:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760708.784148:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.784157:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.784183:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760708.784191:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b3c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19304448->19308543] (req 19304448->19308543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760708.784288:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520857344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 91336us (94266us total) trans 4294972033 rc 0/0
00000100:00100000:1.0:1789760708.784300:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4746
00000100:00100000:1.0:1789760708.784310:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680313522947 time 680379619719 state 0x2 ref 0
00000100:00100000:2.0:1789760708.795258:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760708.795937:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520857472
00000100:00100000:3.0:1789760708.795948:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520857472
00000100:00100000:3.0:1789760708.796016:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680313522947 time 680379619719 state 0x0 ref 1
00000100:00100000:3.0:1789760708.796030:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680379880135 time 680379619719 state 0x1 ref 1
00000100:00100000:3.0:1789760708.796069:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680379880135 time 680482751189 state 0x0 ref 1
00000100:00100000:3.0:1789760708.796081:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520857472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760708.796125:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19308544, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:3.0:1789760708.796134:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.796149:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:3.0:1789760708.796153:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760708.796159:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.796172:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760708.877541:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972034 is committed
00002000:00010000:2.0:1789760708.877812:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19308544 -> 19312640
00010000:00010000:2.0:1789760708.877828:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.877841:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.877850:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.877857:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760708.877862:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.877871:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.877889:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760708.877896:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b3c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19308544->19312639] (req 19308544->19312639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760708.878568:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520857472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 81903us (82734us total) trans 4294972034 rc 0/0
00000100:00100000:2.0:1789760708.878580:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4747
00000100:00100000:2.0:1789760708.878591:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680379880135 time 680482751189 state 0x2 ref 0
00000100:00100000:0.0:1789760708.891884:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760708.892121:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520857600
00000100:00100000:3.0:1789760708.892131:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520857600
00000100:00100000:3.0:1789760708.892186:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680379880135 time 680482751189 state 0x0 ref 1
00000100:00100000:3.0:1789760708.892201:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680483011605 time 680482751189 state 0x1 ref 1
00000100:00100000:3.0:1789760708.892234:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680483011605 time 680578916583 state 0x0 ref 1
00000100:00100000:3.0:1789760708.892247:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520857600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760708.892293:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19312640, mtime: 0x6aad94c5, atime: 0x0, ctime: 0x6aad94c5, blocks: 0x9807
00010000:00010000:3.0:1789760708.892302:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.892354:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:3.0:1789760708.892359:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760708.892366:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760708.892380:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760708.999812:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972035 is committed
00002000:00010000:2.0:1789760709.003249:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19312640 -> 19316736
00002000:00010000:2.0:1789760709.003258:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760709 -> 1789760710
00002000:00010000:2.0:1789760709.003260:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760709 -> 1789760710
00010000:00010000:2.0:1789760709.003273:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.003286:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.003295:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.003303:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760709.003308:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.003335:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.003429:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.003439:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b3ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19312640->19316735] (req 19312640->19316735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760709.003714:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520857600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 111463us (111832us total) trans 4294972035 rc 0/0
00000100:00100000:2.0:1789760709.003725:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4748
00000100:00100000:2.0:1789760709.003735:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680483011605 time 680578916583 state 0x2 ref 0
00000100:00100000:0.0:1789760709.026259:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760709.026748:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520857728
00000100:00100000:1.0:1789760709.026758:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520857728
00000100:00100000:1.0:1789760709.026814:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680483011605 time 680578916583 state 0x0 ref 1
00000100:00100000:1.0:1789760709.026829:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680579176999 time 680578916583 state 0x1 ref 1
00000100:00100000:1.0:1789760709.026912:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680579176999 time 680713593620 state 0x0 ref 1
00000100:00100000:1.0:1789760709.026925:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520857728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760709.026974:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19316736, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:1.0:1789760709.026991:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.027012:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:1.0:1789760709.027017:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760709.027023:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.027037:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760709.091549:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972036 is committed
00002000:00010000:1.0:1789760709.091920:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19316736 -> 19320832
00010000:00010000:1.0:1789760709.091936:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.091950:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.091960:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.091968:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760709.091974:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.092000:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.092022:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.092031:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b3d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19316736->19320831] (req 19316736->19320831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760709.092131:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520857728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65200us (65875us total) trans 4294972036 rc 0/0
00000100:00100000:1.0:1789760709.092143:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4749
00000100:00100000:1.0:1789760709.092153:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680579176999 time 680713593620 state 0x2 ref 0
00000100:00100000:1.0:1789760709.097375:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760709.097719:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520857856
00000100:00100000:2.0:1789760709.097729:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520857856
00000100:00100000:2.0:1789760709.097784:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680579176999 time 680713593620 state 0x0 ref 1
00000100:00100000:2.0:1789760709.097800:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680713854036 time 680713593620 state 0x1 ref 1
00000100:00100000:2.0:1789760709.097834:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680713854036 time 680784516205 state 0x0 ref 1
00000100:00100000:2.0:1789760709.097846:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520857856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760709.097895:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19320832, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:2.0:1789760709.097905:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.097921:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:2.0:1789760709.097926:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760709.097932:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.097946:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760709.135100:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972037 is committed
00002000:00010000:3.0:1789760709.135186:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19320832 -> 19324928
00010000:00010000:3.0:1789760709.135201:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.135218:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.135227:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.135234:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760709.135239:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.135249:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.135267:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.135274:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b3dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19320832->19324927] (req 19320832->19324927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760709.135440:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520857856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37590us (38123us total) trans 4294972037 rc 0/0
00000100:00100000:3.0:1789760709.135450:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4750
00000100:00100000:3.0:1789760709.135459:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680713854036 time 680784516205 state 0x2 ref 0
00000100:00100000:2.0:1789760709.138472:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760709.138556:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520857984
00000100:00100000:3.0:1789760709.138569:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520857984
00000100:00100000:3.0:1789760709.138623:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680713854036 time 680784516205 state 0x0 ref 1
00000100:00100000:3.0:1789760709.138638:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680784776621 time 680784516205 state 0x1 ref 1
00000100:00100000:3.0:1789760709.138671:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680784776621 time 680825353044 state 0x0 ref 1
00000100:00100000:3.0:1789760709.138683:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520857984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760709.138728:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19324928, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:3.0:1789760709.138738:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.138754:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:3.0:1789760709.138758:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760709.138765:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.138779:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.178369:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760709.201265:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972038 is committed
00002000:00010000:0.0:1789760709.201546:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19324928 -> 19329024
00010000:00010000:0.0:1789760709.201561:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.201574:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.201583:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.201597:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760709.201602:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.201610:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.201627:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.201634:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b3e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19324928->19329023] (req 19324928->19329023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760709.201805:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520857984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63120us (63338us total) trans 4294972038 rc 0/0
00000100:00100000:0.0:1789760709.201816:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4751
00000100:00100000:0.0:1789760709.201825:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680784776621 time 680825353044 state 0x2 ref 0
00000100:00100000:1.0:1789760709.208382:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760709.208707:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520858112
00000100:00100000:3.0:1789760709.208717:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520858112
00000100:00100000:3.0:1789760709.208770:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680784776621 time 680825353044 state 0x0 ref 1
00000100:00100000:3.0:1789760709.208785:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680825613460 time 680825353044 state 0x1 ref 1
00000100:00100000:3.0:1789760709.208865:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680825613460 time 680895546335 state 0x0 ref 1
00000100:00100000:3.0:1789760709.208881:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520858112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760709.208932:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19329024, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:3.0:1789760709.208940:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.208956:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:3.0:1789760709.208976:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760709.208990:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.209003:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760709.241628:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548738432:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1789760709.241698:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760709.241811:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548738432
00000100:00100000:1.0:1789760709.241821:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548738432
00000100:00100000:1.0:1789760709.241865:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401
00000100:00100000:1.0:1789760709.241873:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548738432:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1789760709.241914:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:1.0:1789760709.241958:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548738432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (259us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760709.241965:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401
00000001:00080000:2.0:1789760709.242988:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972039 is committed
00002000:00010000:3.0:1789760709.243117:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19329024 -> 19333120
00010000:00010000:3.0:1789760709.243132:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.243144:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.243153:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.243161:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760709.243166:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.243176:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.243196:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.243204:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19329024->19333119] (req 19329024->19333119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760709.243278:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520858112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34396us (34903us total) trans 4294972039 rc 0/0
00000100:00100000:3.0:1789760709.243287:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4752
00000100:00100000:3.0:1789760709.243296:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680825613460 time 680895546335 state 0x2 ref 0
00000100:00100000:0.0:1789760709.244742:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548738432:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760709.248173:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760709.248686:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520858240
00000100:00100000:2.0:1789760709.248696:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520858240
00000100:00100000:2.0:1789760709.248749:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680825613460 time 680895546335 state 0x0 ref 1
00000100:00100000:2.0:1789760709.248764:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680895806751 time 680895546335 state 0x1 ref 1
00000100:00100000:2.0:1789760709.248831:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680895806751 time 680935512559 state 0x0 ref 1
00000100:00100000:2.0:1789760709.248843:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520858240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760709.248892:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19333120, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:2.0:1789760709.248902:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.248920:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:2.0:1789760709.248924:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760709.248929:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.248941:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760709.275489:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19333120 -> 19337216
00010000:00010000:3.0:1789760709.275565:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.275580:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.275589:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.275596:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760709.275601:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.275609:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.275686:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.275694:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b3f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19333120->19337215] (req 19333120->19337215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760709.275789:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520858240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26942us (27620us total) trans 4294972040 rc 0/0
00000100:00100000:3.0:1789760709.275799:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4753
00000100:00100000:3.0:1789760709.275808:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680895806751 time 680935512559 state 0x2 ref 0
00000001:00080000:2.0:1789760709.277216:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972040 is committed
00000100:00100000:2.0:1789760709.279814:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760709.279899:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520858368
00000100:00100000:3.0:1789760709.279908:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520858368
00000100:00100000:3.0:1789760709.279959:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680895806751 time 680935512559 state 0x0 ref 1
00000100:00100000:3.0:1789760709.279974:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680935772975 time 680935512559 state 0x1 ref 1
00000100:00100000:3.0:1789760709.280018:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680935772975 time 680966700566 state 0x0 ref 1
00000100:00100000:3.0:1789760709.280038:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520858368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760709.280082:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19337216, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:3.0:1789760709.280092:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.280108:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:3.0:1789760709.280113:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760709.280118:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.280132:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760709.304247:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972041 is committed
00002000:00010000:3.0:1789760709.304370:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19337216 -> 19341312
00010000:00010000:3.0:1789760709.304386:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.304400:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.304409:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.304416:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760709.304420:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.304430:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.304456:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.304463:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b3f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19337216->19341311] (req 19337216->19341311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760709.304688:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520858368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24646us (24877us total) trans 4294972041 rc 0/0
00000100:00100000:3.0:1789760709.304699:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4754
00000100:00100000:3.0:1789760709.304709:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680935772975 time 680966700566 state 0x2 ref 0
00000100:00100000:1.0:1789760709.307863:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760709.307934:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520858496
00000100:00100000:0.0:1789760709.307942:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520858496
00000100:00100000:0.0:1789760709.307998:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680935772975 time 680966700566 state 0x0 ref 1
00000100:00100000:0.0:1789760709.308019:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680966960982 time 680966700566 state 0x1 ref 1
00000100:00100000:0.0:1789760709.308045:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680966960982 time 680994728177 state 0x0 ref 1
00000100:00100000:0.0:1789760709.308057:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520858496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760709.308098:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19341312, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:0.0:1789760709.308107:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.308121:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=680s v=(0 0)
00010000:00010000:0.0:1789760709.308125:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760709.308132:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.308145:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760709.336707:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19341312 -> 19345408
00010000:00010000:0.0:1789760709.336727:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.336741:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.336749:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.336762:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760709.336767:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.336775:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.336796:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.336804:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b3ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19341312->19345407] (req 19341312->19345407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760709.336897:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520858496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28836us (29037us total) trans 4294972042 rc 0/0
00000100:00100000:0.0:1789760709.336907:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4755
00000100:00100000:0.0:1789760709.336917:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680966960982 time 680994728177 state 0x2 ref 0
00000001:00080000:1.0:1789760709.336990:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972042 is committed
00000100:00100000:2.0:1789760709.341231:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760709.341402:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520858624
00000100:00100000:1.0:1789760709.341411:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520858624
00000100:00100000:1.0:1789760709.341455:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680966960982 time 680994728177 state 0x0 ref 1
00000100:00100000:1.0:1789760709.341567:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680994988593 time 680994728177 state 0x1 ref 1
00000100:00100000:1.0:1789760709.341633:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680994988593 time 681028315809 state 0x0 ref 1
00000100:00100000:1.0:1789760709.341643:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520858624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760709.341681:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19345408, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:1.0:1789760709.341689:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.341705:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:1.0:1789760709.341709:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760709.341715:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.341739:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760709.404958:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972043 is committed
00002000:00010000:0.0:1789760709.405294:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19345408 -> 19349504
00010000:00010000:0.0:1789760709.405308:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.405352:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.405367:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.405375:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760709.405379:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.405388:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.405406:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.405415:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b406 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19345408->19349503] (req 19345408->19349503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760709.405502:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520858624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63855us (64276us total) trans 4294972043 rc 0/0
00000100:00100000:0.0:1789760709.406228:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4756
00000100:00100000:0.0:1789760709.406238:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680994988593 time 681028315809 state 0x2 ref 0
00000100:00100000:2.0:1789760709.409629:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760709.409700:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520858752
00000100:00100000:3.0:1789760709.409710:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520858752
00000100:00100000:3.0:1789760709.409768:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 680994988593 time 681028315809 state 0x0 ref 1
00000100:00100000:3.0:1789760709.409782:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681028576225 time 681028315809 state 0x1 ref 1
00000100:00100000:3.0:1789760709.409811:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681028576225 time 681096493465 state 0x0 ref 1
00000100:00100000:3.0:1789760709.409823:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520858752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760709.409868:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19349504, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:3.0:1789760709.409877:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.409893:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:3.0:1789760709.409898:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760709.409905:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.409918:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760709.456719:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19349504 -> 19353600
00010000:00010000:3.0:1789760709.456738:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.456752:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.456763:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.456772:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760709.456777:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.456787:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.456818:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.456830:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b40d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19349504->19353599] (req 19349504->19353599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760709.456855:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972044 is committed
00000100:00100000:3.0:1789760709.456920:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520858752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47094us (47295us total) trans 4294972044 rc 0/0
00000100:00100000:3.0:1789760709.456932:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4757
00000100:00100000:3.0:1789760709.456941:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681028576225 time 681096493465 state 0x2 ref 0
00000100:00100000:1.0:1789760709.460570:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760709.460679:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520858880
00000100:00100000:3.0:1789760709.460690:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520858880
00000100:00100000:3.0:1789760709.460748:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681028576225 time 681096493465 state 0x0 ref 1
00000100:00100000:3.0:1789760709.460764:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681096753881 time 681096493465 state 0x1 ref 1
00000100:00100000:3.0:1789760709.460792:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681096753881 time 681147474449 state 0x0 ref 1
00000100:00100000:3.0:1789760709.460898:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520858880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760709.460947:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19353600, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:3.0:1789760709.460956:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.460971:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:3.0:1789760709.460976:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760709.460991:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.461005:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760709.516381:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972045 is committed
00002000:00010000:2.0:1789760709.516500:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19353600 -> 19357696
00010000:00010000:2.0:1789760709.516521:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.516533:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.516542:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.516550:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760709.516554:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.516562:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.516579:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.516588:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b414 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19353600->19357695] (req 19353600->19357695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760709.516886:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520858880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55987us (56321us total) trans 4294972045 rc 0/0
00000100:00100000:2.0:1789760709.516897:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4758
00000100:00100000:2.0:1789760709.516907:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681096753881 time 681147474449 state 0x2 ref 0
00000100:00100000:2.0:1789760709.521293:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760709.521365:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520859008
00000100:00100000:0.0:1789760709.521375:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520859008
00000100:00100000:0.0:1789760709.521429:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681096753881 time 681147474449 state 0x0 ref 1
00000100:00100000:0.0:1789760709.521448:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681147734865 time 681147474449 state 0x1 ref 1
00000100:00100000:0.0:1789760709.521472:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681147734865 time 681208155306 state 0x0 ref 1
00000100:00100000:0.0:1789760709.521494:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760709.521597:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19357696, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:0.0:1789760709.521608:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.521634:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:0.0:1789760709.521638:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760709.521645:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.521659:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760709.589856:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972046 is committed
00002000:00010000:0.0:1789760709.590137:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19357696 -> 19361792
00010000:00010000:0.0:1789760709.590154:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.590169:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.590180:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.590194:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760709.590199:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.590208:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.590229:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.590238:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b41b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19357696->19361791] (req 19357696->19361791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760709.590378:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68882us (69089us total) trans 4294972046 rc 0/0
00000100:00100000:0.0:1789760709.590389:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4759
00000100:00100000:0.0:1789760709.590398:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681147734865 time 681208155306 state 0x2 ref 0
00000100:00100000:0.0:1789760709.607685:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760709.610525:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520859136
00000100:00100000:1.0:1789760709.610540:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520859136
00000100:00100000:1.0:1789760709.610602:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681147734865 time 681208155306 state 0x0 ref 1
00000100:00100000:1.0:1789760709.610618:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681208415722 time 681208155306 state 0x1 ref 1
00000100:00100000:1.0:1789760709.610658:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681208415722 time 681297340504 state 0x0 ref 1
00000100:00100000:1.0:1789760709.610672:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520859136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760709.610723:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19361792, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:1.0:1789760709.610743:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.610770:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:1.0:1789760709.610774:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760709.610780:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.610793:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760709.674832:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19361792 -> 19365888
00010000:00010000:2.0:1789760709.674851:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.674864:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.674874:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.674882:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760709.674887:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.674896:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.674915:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.674922:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b422 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19361792->19365887] (req 19361792->19365887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760709.675025:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520859136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64352us (67343us total) trans 4294972047 rc 0/0
00000100:00100000:2.0:1789760709.675037:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4760
00000100:00100000:2.0:1789760709.675048:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681208415722 time 681297340504 state 0x2 ref 0
00000001:00080000:3.0:1789760709.677801:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972047 is committed
00000100:00100000:2.0:1789760709.679556:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760709.679831:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520859264
00000100:00100000:0.0:1789760709.679841:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520859264
00000100:00100000:0.0:1789760709.679895:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681208415722 time 681297340504 state 0x0 ref 1
00000100:00100000:0.0:1789760709.679911:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681297600920 time 681297340504 state 0x1 ref 1
00000100:00100000:0.0:1789760709.679941:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681297600920 time 681366623702 state 0x0 ref 1
00000100:00100000:0.0:1789760709.679955:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760709.680011:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19365888, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:0.0:1789760709.680021:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.680036:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:0.0:1789760709.680041:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760709.680047:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760709.680061:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760709.767001:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972048 is committed
00002000:00010000:2.0:1789760709.767197:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19365888 -> 19369984
00010000:00010000:2.0:1789760709.767215:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.767228:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.767236:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.767243:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760709.767248:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.767256:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.767276:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.767284:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b429 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19365888->19369983] (req 19365888->19369983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760709.767431:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 87474us (87882us total) trans 4294972048 rc 0/0
00000100:00100000:2.0:1789760709.767443:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4761
00000100:00100000:2.0:1789760709.767452:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681297600920 time 681366623702 state 0x2 ref 0
00000100:00100000:0.0:1789760709.781165:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760709.781279:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520859392
00000100:00100000:1.0:1789760709.781290:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520859392
00000100:00100000:1.0:1789760709.781365:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681297600920 time 681366623702 state 0x0 ref 1
00000100:00100000:1.0:1789760709.781382:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681366884118 time 681366623702 state 0x1 ref 1
00000100:00100000:1.0:1789760709.781418:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681366884118 time 681468100004 state 0x0 ref 1
00000100:00100000:1.0:1789760709.781432:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520859392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760709.781495:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19369984, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:1.0:1789760709.781515:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.781537:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:1.0:1789760709.781542:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760709.781548:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.781563:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760709.867110:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972049 is committed
00002000:00010000:1.0:1789760709.867207:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19369984 -> 19374080
00010000:00010000:1.0:1789760709.867224:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.867237:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.867246:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.867254:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760709.867258:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.867267:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.867285:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760709.867292:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b430 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19369984->19374079] (req 19369984->19374079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760709.867418:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520859392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 85984us (86259us total) trans 4294972049 rc 0/0
00000100:00100000:1.0:1789760709.867428:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4762
00000100:00100000:1.0:1789760709.867437:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681366884118 time 681468100004 state 0x2 ref 0
00000100:00100000:0.0:1789760709.873676:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760709.873784:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520859520
00000100:00100000:3.0:1789760709.873803:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520859520
00000100:00100000:3.0:1789760709.873901:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681366884118 time 681468100004 state 0x0 ref 1
00000100:00100000:3.0:1789760709.873922:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681468360420 time 681468100004 state 0x1 ref 1
00000100:00100000:3.0:1789760709.874052:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681468360420 time 681560647318 state 0x0 ref 1
00000100:00100000:3.0:1789760709.874070:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760709.874298:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19374080, mtime: 0x6aad94c6, atime: 0x0, ctime: 0x6aad94c6, blocks: 0x9807
00010000:00010000:3.0:1789760709.874309:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.874363:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:3.0:1789760709.874368:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760709.874377:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.874395:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760709.949435:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972050 is committed
00002000:00010000:3.0:1789760709.949530:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19374080 -> 19378176
00002000:00010000:3.0:1789760709.949535:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760710 -> 1789760711
00002000:00010000:3.0:1789760709.949538:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760710 -> 1789760711
00010000:00010000:3.0:1789760709.949551:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.949566:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.949576:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.949583:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760709.949588:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.949598:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.950506:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760709.950518:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b437 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19374080->19378175] (req 19374080->19378175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760709.950695:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76625us (77024us total) trans 4294972050 rc 0/0
00000100:00100000:3.0:1789760709.950707:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4763
00000100:00100000:3.0:1789760709.950716:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681468360420 time 681560647318 state 0x2 ref 0
00000100:00100000:3.0:1789760709.963875:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760709.964052:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520859648
00000100:00100000:2.0:1789760709.964061:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520859648
00000100:00100000:2.0:1789760709.964121:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681468360420 time 681560647318 state 0x0 ref 1
00000100:00100000:2.0:1789760709.964137:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681560907734 time 681560647318 state 0x1 ref 1
00000100:00100000:2.0:1789760709.964171:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681560907734 time 681650854028 state 0x0 ref 1
00000100:00100000:2.0:1789760709.964184:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760709.964242:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19378176, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:2.0:1789760709.964254:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.964270:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:2.0:1789760709.964275:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760709.964281:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760709.964296:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760710.043085:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972051 is committed
00002000:00010000:3.0:1789760710.043281:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19378176 -> 19382272
00010000:00010000:3.0:1789760710.043297:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.043309:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.043349:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.043357:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.043361:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.043371:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.043390:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.043397:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b43e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19378176->19382271] (req 19378176->19382271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.043478:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 79292us (79611us total) trans 4294972051 rc 0/0
00000100:00100000:3.0:1789760710.043492:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4764
00000100:00100000:3.0:1789760710.043500:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681560907734 time 681650854028 state 0x2 ref 0
00000100:00100000:1.0:1789760710.050687:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760710.050826:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520859776
00000100:00100000:2.0:1789760710.050837:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520859776
00000100:00100000:2.0:1789760710.050913:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681560907734 time 681650854028 state 0x0 ref 1
00000100:00100000:2.0:1789760710.050929:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681651114444 time 681650854028 state 0x1 ref 1
00000100:00100000:2.0:1789760710.050959:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681651114444 time 681737641254 state 0x0 ref 1
00000100:00100000:2.0:1789760710.050995:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760710.051049:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19382272, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:2.0:1789760710.051059:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.051075:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:2.0:1789760710.051079:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760710.051086:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.051103:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760710.051937:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:1.0:1789760710.101368:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972052 is committed
00002000:00010000:2.0:1789760710.112360:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19382272 -> 19386368
00010000:00010000:2.0:1789760710.112382:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.112404:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.112414:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.112421:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760710.112427:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.112435:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.112464:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.112472:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b445 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19382272->19386367] (req 19382272->19386367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760710.112570:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520859776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61595us (61889us total) trans 4294972052 rc 0/0
00000100:00100000:2.0:1789760710.112580:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4765
00000100:00100000:2.0:1789760710.112589:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681651114444 time 681737641254 state 0x2 ref 0
00000100:00100000:0.0:1789760710.116141:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760710.116234:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520859904
00000100:00100000:1.0:1789760710.116244:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520859904
00000100:00100000:1.0:1789760710.116302:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681651114444 time 681737641254 state 0x0 ref 1
00000100:00100000:1.0:1789760710.116352:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681737901670 time 681737641254 state 0x1 ref 1
00000100:00100000:1.0:1789760710.116382:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681737901670 time 681803064754 state 0x0 ref 1
00000100:00100000:1.0:1789760710.116396:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520859904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760710.116446:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19386368, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:1.0:1789760710.116455:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.116470:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:1.0:1789760710.116474:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760710.116481:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.116495:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760710.175985:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972053 is committed
00002000:00010000:1.0:1789760710.176067:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19386368 -> 19390464
00010000:00010000:1.0:1789760710.176082:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.176095:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.176104:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.176113:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760710.176117:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.176126:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.176144:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.176153:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b44c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19386368->19390463] (req 19386368->19390463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760710.176299:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520859904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59901us (60164us total) trans 4294972053 rc 0/0
00000100:00100000:1.0:1789760710.176310:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4766
00000100:00100000:1.0:1789760710.176363:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681737901670 time 681803064754 state 0x2 ref 0
00000100:00100000:0.0:1789760710.186641:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760710.186798:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520860032
00000100:00100000:3.0:1789760710.186808:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520860032
00000100:00100000:3.0:1789760710.186863:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681737901670 time 681803064754 state 0x0 ref 1
00000100:00100000:3.0:1789760710.186881:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681803325170 time 681803064754 state 0x1 ref 1
00000100:00100000:3.0:1789760710.186915:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681803325170 time 681873597129 state 0x0 ref 1
00000100:00100000:3.0:1789760710.186929:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520860032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760710.186986:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19390464, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:3.0:1789760710.186995:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.187011:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:3.0:1789760710.187016:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760710.187022:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.187036:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.201554:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760710.234268:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972054 is committed
00002000:00010000:3.0:1789760710.234394:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19390464 -> 19394560
00010000:00010000:3.0:1789760710.234413:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.234426:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.234438:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.234447:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.234453:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.234463:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.234488:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.234495:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b453 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19390464->19394559] (req 19390464->19394559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.234709:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520860032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47777us (48078us total) trans 4294972054 rc 0/0
00000100:00100000:3.0:1789760710.234721:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4767
00000100:00100000:3.0:1789760710.234732:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681803325170 time 681873597129 state 0x2 ref 0
00000100:00100000:1.0:1789760710.241035:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760710.241112:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520860160
00000100:00100000:3.0:1789760710.241122:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520860160
00000100:00100000:3.0:1789760710.241178:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681803325170 time 681873597129 state 0x0 ref 1
00000100:00100000:3.0:1789760710.241194:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681873857545 time 681873597129 state 0x1 ref 1
00000100:00100000:3.0:1789760710.241224:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681873857545 time 681927907435 state 0x0 ref 1
00000100:00100000:3.0:1789760710.241238:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520860160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760710.241287:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19394560, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:3.0:1789760710.241296:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.241332:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:3.0:1789760710.241337:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760710.241344:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.241359:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760710.265492:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1789760710.265528:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548738560:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760710.265599:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760710.265878:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548738560
00000100:00100000:3.0:1789760710.265886:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548738560
00000100:00100000:3.0:1789760710.265940:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402
00000100:00100000:3.0:1789760710.265950:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548738560:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1789760710.265995:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:3.0:1789760710.266053:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548738560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (453us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760710.266061:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402
00000100:00100000:3.0:1789760710.266109:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548738560:0@lo:41:osp-pre-1-0.0
00000001:00080000:2.0:1789760710.284140:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972055 is committed
00002000:00010000:0.0:1789760710.284225:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19394560 -> 19398656
00010000:00010000:0.0:1789760710.284240:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.284259:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.284268:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.284275:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760710.284280:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.284289:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.284307:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.284348:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b45a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19394560->19398655] (req 19394560->19398655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760710.284476:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520860160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43237us (43447us total) trans 4294972055 rc 0/0
00000100:00100000:0.0:1789760710.284487:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4768
00000100:00100000:0.0:1789760710.284497:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681873857545 time 681927907435 state 0x2 ref 0
00000100:00100000:2.0:1789760710.287616:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.287724:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520860288
00000100:00100000:0.0:1789760710.287735:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520860288
00000100:00100000:0.0:1789760710.287793:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681873857545 time 681927907435 state 0x0 ref 1
00000100:00100000:0.0:1789760710.287810:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681928167851 time 681927907435 state 0x1 ref 1
00000100:00100000:3.0:1789760710.288055:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681928167851 time 681974734110 state 0x0 ref 1
00000100:00100000:3.0:1789760710.288069:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520860288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760710.288119:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19398656, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:3.0:1789760710.288128:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.288145:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=681s v=(0 0)
00010000:00010000:3.0:1789760710.288150:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760710.288157:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.288168:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760710.333372:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972056 is committed
00002000:00010000:2.0:1789760710.333494:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19398656 -> 19402752
00010000:00010000:2.0:1789760710.333688:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.333702:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.333711:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.333719:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760710.333723:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.333733:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.333770:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.333777:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b461 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19398656->19402751] (req 19398656->19402751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760710.334032:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520860288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45960us (46421us total) trans 4294972056 rc 0/0
00000100:00100000:2.0:1789760710.334048:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4769
00000100:00100000:2.0:1789760710.334059:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681928167851 time 681974734110 state 0x2 ref 0
00000100:00100000:2.0:1789760710.344267:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760710.344387:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520860416
00000100:00100000:1.0:1789760710.344398:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520860416
00000100:00100000:1.0:1789760710.344451:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681928167851 time 681974734110 state 0x0 ref 1
00000100:00100000:1.0:1789760710.344466:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681974994526 time 681974734110 state 0x1 ref 1
00000100:00100000:1.0:1789760710.344506:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681974994526 time 682031180109 state 0x0 ref 1
00000100:00100000:1.0:1789760710.344519:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520860416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760710.344577:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19402752, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:1.0:1789760710.344587:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.344610:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:1.0:1789760710.344615:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760710.344622:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.344636:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760710.416441:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972057 is committed
00002000:00010000:3.0:1789760710.416567:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19402752 -> 19406848
00010000:00010000:3.0:1789760710.416585:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.416598:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.416613:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.416621:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.416626:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.416635:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.416656:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.416665:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b468 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19402752->19406847] (req 19402752->19406847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.416760:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520860416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 72237us (72496us total) trans 4294972057 rc 0/0
00000100:00100000:3.0:1789760710.416770:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4770
00000100:00100000:3.0:1789760710.416779:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681974994526 time 682031180109 state 0x2 ref 0
00000100:00100000:0.0:1789760710.429896:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760710.430213:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520860544
00000100:00100000:2.0:1789760710.430224:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520860544
00000100:00100000:2.0:1789760710.430280:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 681974994526 time 682031180109 state 0x0 ref 1
00000100:00100000:2.0:1789760710.430297:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682031440525 time 682031180109 state 0x1 ref 1
00000100:00100000:2.0:1789760710.430416:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682031440525 time 682117097199 state 0x0 ref 1
00000100:00100000:2.0:1789760710.430430:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520860544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760710.430494:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19406848, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:2.0:1789760710.431478:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.431497:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:2.0:1789760710.431510:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760710.431517:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.431591:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760710.477073:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972058 is committed
00002000:00010000:3.0:1789760710.477420:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19406848 -> 19410944
00010000:00010000:3.0:1789760710.477440:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.477457:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.477466:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.477473:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.477478:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.477487:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.477573:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.477582:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b46f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19406848->19410943] (req 19406848->19410943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.477673:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520860544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47240us (47781us total) trans 4294972058 rc 0/0
00000100:00100000:3.0:1789760710.477684:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4771
00000100:00100000:3.0:1789760710.477694:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682031440525 time 682117097199 state 0x2 ref 0
00000100:00100000:1.0:1789760710.481123:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.481218:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520860672
00000100:00100000:0.0:1789760710.481227:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520860672
00000100:00100000:0.0:1789760710.481283:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682031440525 time 682117097199 state 0x0 ref 1
00000100:00100000:0.0:1789760710.481298:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682117357615 time 682117097199 state 0x1 ref 1
00000100:00100000:0.0:1789760710.481359:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682117357615 time 682168040881 state 0x0 ref 1
00000100:00100000:0.0:1789760710.481371:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520860672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760710.481420:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19410944, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:0.0:1789760710.481431:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.481446:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:0.0:1789760710.481450:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760710.481457:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.481470:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760710.496485:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.496522:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.496552:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.496571:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.496615:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.496651:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520860928
00000100:00100000:0.0:1789760710.496659:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520860928
00000100:00100000:0.0:1789760710.496712:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520861184
00000100:00100000:0.0:1789760710.496715:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520861184
00000100:00100000:0.0:1789760710.496728:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520861056
00000100:00100000:0.0:1789760710.496731:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520861056
00000100:00100000:0.0:1789760710.496740:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520861312
00000100:00100000:0.0:1789760710.496742:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520861312
00000100:00100000:0.0:1789760710.496756:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 813
00000100:00100000:0.0:1789760710.496765:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2407:x1876699520860928:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760710.496834:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2407:x1876699520860928:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 70us (359us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760710.496842:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 813
00000100:00100000:0.0:1789760710.496857:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 814
00000100:00100000:0.0:1789760710.496863:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520861184:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760710.496886:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520861184:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760710.496892:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 814
00000100:00100000:0.0:1789760710.496903:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 815
00000100:00100000:0.0:1789760710.496908:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520861056:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760710.496929:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520861056:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (357us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760710.496935:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 815
00000100:00100000:0.0:1789760710.496944:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 816
00000100:00100000:0.0:1789760710.496950:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520861312:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760710.496968:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520861312:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 18us (354us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760710.496987:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 816
00000100:00100000:0.0:1789760710.497010:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520860800
00000100:00100000:0.0:1789760710.497014:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520860800
00000100:00100000:0.0:1789760710.497039:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 458
00000100:00100000:0.0:1789760710.497045:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda0058c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2407:x1876699520860800:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760710.497067:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda0058c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2407:x1876699520860800:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760710.497074:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 458
00000100:00080000:0.0:1789760710.497102:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1789760710.497106:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000001:00080000:3.0:1789760710.535870:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972059 is committed
00002000:00010000:0.0:1789760710.536228:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19410944 -> 19415040
00010000:00010000:0.0:1789760710.536245:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.536258:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.536267:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.536275:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760710.536280:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.536290:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.536309:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.536332:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b476 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19410944->19415039] (req 19410944->19415039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760710.536436:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520860672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55062us (55317us total) trans 4294972059 rc 0/0
00000100:00100000:0.0:1789760710.536447:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4772
00000100:00100000:0.0:1789760710.536457:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682117357615 time 682168040881 state 0x2 ref 0
00000100:00100000:0.0:1789760710.540019:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760710.540092:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520861440
00000100:00100000:3.0:1789760710.540103:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520861440
00000100:00100000:3.0:1789760710.540160:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682117357615 time 682168040881 state 0x0 ref 1
00000100:00100000:3.0:1789760710.540175:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682168301297 time 682168040881 state 0x1 ref 1
00000100:00100000:3.0:1789760710.540207:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682168301297 time 682226889526 state 0x0 ref 1
00000100:00100000:3.0:1789760710.540219:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520861440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760710.540268:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19415040, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:3.0:1789760710.540277:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.540293:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760710.540298:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760710.540304:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.540345:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760710.584288:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972060 is committed
00002000:00010000:3.0:1789760710.584450:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19415040 -> 19419136
00010000:00010000:3.0:1789760710.584465:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.584478:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.584493:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.584555:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.584560:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.584570:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.584588:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.584595:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b47d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19415040->19419135] (req 19415040->19419135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.584882:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520861440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44660us (44867us total) trans 4294972060 rc 0/0
00000100:00100000:3.0:1789760710.584893:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4773
00000100:00100000:3.0:1789760710.584903:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682168301297 time 682226889526 state 0x2 ref 0
00000100:00100000:1.0:1789760710.587913:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760710.587994:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520861568
00000100:00100000:3.0:1789760710.588003:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520861568
00000100:00100000:3.0:1789760710.588056:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682168301297 time 682226889526 state 0x0 ref 1
00000100:00100000:3.0:1789760710.588072:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682227149942 time 682226889526 state 0x1 ref 1
00000100:00100000:3.0:1789760710.588105:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682227149942 time 682274787655 state 0x0 ref 1
00000100:00100000:3.0:1789760710.588119:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520861568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760710.588170:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19419136, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:3.0:1789760710.588179:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.588195:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760710.588200:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760710.588206:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.588220:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760710.618728:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972061 is committed
00002000:00010000:3.0:1789760710.618828:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19419136 -> 19423232
00010000:00010000:3.0:1789760710.618844:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.618856:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.618865:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.618873:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.618878:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.618886:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.618905:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.618913:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b484 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19419136->19423231] (req 19419136->19423231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.619018:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520861568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30897us (31112us total) trans 4294972061 rc 0/0
00000100:00100000:3.0:1789760710.619028:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4774
00000100:00100000:3.0:1789760710.619037:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682227149942 time 682274787655 state 0x2 ref 0
00000100:00100000:2.0:1789760710.623453:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.623658:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520861696
00000100:00100000:0.0:1789760710.623670:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520861696
00000100:00100000:0.0:1789760710.623724:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682227149942 time 682274787655 state 0x0 ref 1
00000100:00100000:0.0:1789760710.623740:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682275048071 time 682274787655 state 0x1 ref 1
00000100:00100000:0.0:1789760710.623803:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682275048071 time 682310484802 state 0x0 ref 1
00000100:00100000:0.0:1789760710.623818:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520861696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760710.623866:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19423232, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:0.0:1789760710.623875:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.623891:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:0.0:1789760710.623895:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760710.623901:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.623913:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760710.682377:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19423232 -> 19427328
00010000:00010000:2.0:1789760710.682399:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.682412:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.682420:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.682427:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760710.682431:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.682440:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.682459:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.682467:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b48b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19423232->19427327] (req 19423232->19427327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760710.682572:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520861696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58751us (59121us total) trans 4294972062 rc 0/0
00000100:00100000:2.0:1789760710.682583:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4775
00000100:00100000:2.0:1789760710.682593:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682275048071 time 682310484802 state 0x2 ref 0
00000001:00080000:2.0:1789760710.682632:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972062 is committed
00000100:00100000:1.0:1789760710.686478:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.686656:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520861824
00000100:00100000:0.0:1789760710.686666:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520861824
00000100:00100000:0.0:1789760710.686721:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682275048071 time 682310484802 state 0x0 ref 1
00000100:00100000:0.0:1789760710.686736:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682310745218 time 682310484802 state 0x1 ref 1
00000100:00100000:0.0:1789760710.686763:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682310745218 time 682373445109 state 0x0 ref 1
00000100:00100000:0.0:1789760710.686777:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520861824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760710.686826:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19427328, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:0.0:1789760710.686835:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.686856:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:0.0:1789760710.686861:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760710.686867:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.686881:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760710.736940:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972063 is committed
00002000:00010000:1.0:1789760710.737068:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19427328 -> 19431424
00010000:00010000:1.0:1789760710.737084:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.737098:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.737107:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.737114:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760710.737119:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.737128:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.737157:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.737170:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b492 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19427328->19431423] (req 19427328->19431423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760710.737269:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520861824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50490us (50795us total) trans 4294972063 rc 0/0
00000100:00100000:1.0:1789760710.737279:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4776
00000100:00100000:1.0:1789760710.737287:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682310745218 time 682373445109 state 0x2 ref 0
00000100:00100000:1.0:1789760710.746049:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760710.746136:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520861952
00000100:00100000:3.0:1789760710.746147:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520861952
00000100:00100000:3.0:1789760710.746200:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682310745218 time 682373445109 state 0x0 ref 1
00000100:00100000:3.0:1789760710.746215:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682373705525 time 682373445109 state 0x1 ref 1
00000100:00100000:3.0:1789760710.746249:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682373705525 time 682432930781 state 0x0 ref 1
00000100:00100000:3.0:1789760710.746261:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520861952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760710.746307:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19431424, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:3.0:1789760710.746428:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.746445:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760710.746449:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760710.746455:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.746468:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760710.777450:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789760710.777473:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548738688:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1789760710.777547:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760710.777602:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548738688
00000100:00100000:2.0:1789760710.777612:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548738688
00000100:00080000:1.0:1789760710.777660:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789760710.777682:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334
00000100:00100000:2.0:1789760710.777692:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548738688:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1789760710.777713:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528023552 pending 1703936 free 3838836736 avail 3814719488
00000100:00100000:2.0:1789760710.777790:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548738688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (242us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760710.777797:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334
00000100:00100000:1.0:1789760710.777946:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548738688:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1789760710.780180:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548738816:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1789760710.780247:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760710.780495:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548738816
00000100:00100000:3.0:1789760710.780631:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548738816
00000100:00100000:3.0:1789760710.780693:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335
00000100:00100000:3.0:1789760710.780702:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548738816:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1789760710.780726:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528023552 pending 1703936 free 3838836736 avail 3814719488
00000100:00100000:3.0:1789760710.780786:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548738816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (538us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760710.780794:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335
00000100:00100000:2.0:1789760710.780837:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548738816:0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1789760710.781385:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760710.800360:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972064 is committed
00002000:00010000:3.0:1789760710.800429:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19431424 -> 19435520
00010000:00010000:3.0:1789760710.800445:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.800458:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.800467:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.800476:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.800480:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.800489:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.800520:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.800529:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b499 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19431424->19435519] (req 19431424->19435519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.800618:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520861952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54352us (54573us total) trans 4294972064 rc 0/0
00000100:00100000:3.0:1789760710.800628:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4777
00000100:00100000:3.0:1789760710.800637:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682373705525 time 682432930781 state 0x2 ref 0
00000100:00100000:2.0:1789760710.804605:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760710.808026:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520862080
00000100:00100000:3.0:1789760710.808044:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520862080
00000100:00100000:3.0:1789760710.808110:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682373705525 time 682432930781 state 0x0 ref 1
00000100:00100000:3.0:1789760710.808127:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682433191197 time 682432930781 state 0x1 ref 1
00000100:00100000:3.0:1789760710.808161:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682433191197 time 682494844421 state 0x0 ref 1
00000100:00100000:3.0:1789760710.808180:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520862080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760710.808234:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19435520, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:3.0:1789760710.808243:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.808259:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760710.808263:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760710.808270:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.808284:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760710.840033:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972065 is committed
00002000:00010000:3.0:1789760710.840210:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19435520 -> 19439616
00010000:00010000:3.0:1789760710.840226:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.840239:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.840248:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.840255:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.840260:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.840270:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.840291:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.840299:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19435520->19439615] (req 19435520->19439615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.840419:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520862080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32238us (35818us total) trans 4294972065 rc 0/0
00000100:00100000:3.0:1789760710.840431:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4778
00000100:00100000:3.0:1789760710.840441:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682433191197 time 682494844421 state 0x2 ref 0
00000100:00100000:3.0:1789760710.846603:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760710.846960:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520862208
00000100:00100000:2.0:1789760710.846981:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520862208
00000100:00100000:2.0:1789760710.847100:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682433191197 time 682494844421 state 0x0 ref 1
00000100:00100000:2.0:1789760710.847116:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682495104837 time 682494844421 state 0x1 ref 1
00000100:00100000:2.0:1789760710.847182:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682495104837 time 682533864415 state 0x0 ref 1
00000100:00100000:2.0:1789760710.847196:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520862208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760710.847245:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19439616, mtime: 0x6aad94c7, atime: 0x0, ctime: 0x6aad94c7, blocks: 0x9807
00010000:00010000:2.0:1789760710.847254:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.847269:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:2.0:1789760710.847275:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760710.847282:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760710.847295:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760710.912226:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19439616 -> 19443712
00002000:00010000:1.0:1789760710.912236:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760711 -> 1789760712
00002000:00010000:1.0:1789760710.912239:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760711 -> 1789760712
00010000:00010000:1.0:1789760710.912253:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.912339:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.912349:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.912355:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760710.912360:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.912368:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.912387:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760710.912395:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b4a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19439616->19443711] (req 19439616->19443711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760710.912638:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520862208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65440us (66039us total) trans 4294972066 rc 0/0
00000100:00100000:1.0:1789760710.912649:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4779
00000100:00100000:1.0:1789760710.912658:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682495104837 time 682533864415 state 0x2 ref 0
00000001:00080000:1.0:1789760710.912694:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972066 is committed
00000100:00100000:1.0:1789760710.919498:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760710.919751:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520862336
00000100:00100000:0.0:1789760710.919763:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520862336
00000100:00100000:0.0:1789760710.919888:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682495104837 time 682533864415 state 0x0 ref 1
00000100:00100000:0.0:1789760710.919904:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682534124831 time 682533864415 state 0x1 ref 1
00000100:00100000:0.0:1789760710.919979:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682534124831 time 682606661141 state 0x0 ref 1
00000100:00100000:0.0:1789760710.919992:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520862336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760710.920047:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19443712, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:0.0:1789760710.920057:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.920081:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:0.0:1789760710.920086:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760710.920092:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760710.920111:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760710.958272:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972067 is committed
00002000:00010000:3.0:1789760710.958561:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19443712 -> 19447808
00010000:00010000:3.0:1789760710.958577:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.958596:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.958606:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.958619:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760710.958623:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.958632:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.958649:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.958656:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b4ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19443712->19447807] (req 19443712->19447807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760710.958745:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520862336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38751us (39253us total) trans 4294972067 rc 0/0
00000100:00100000:3.0:1789760710.958756:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4780
00000100:00100000:3.0:1789760710.958764:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682534124831 time 682606661141 state 0x2 ref 0
00000100:00100000:2.0:1789760710.963064:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760710.963706:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520862464
00000100:00100000:3.0:1789760710.963717:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520862464
00000100:00100000:3.0:1789760710.963774:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682534124831 time 682606661141 state 0x0 ref 1
00000100:00100000:3.0:1789760710.963790:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682606921557 time 682606661141 state 0x1 ref 1
00000100:00100000:3.0:1789760710.963820:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682606921557 time 682650502697 state 0x0 ref 1
00000100:00100000:3.0:1789760710.963836:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520862464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760710.963880:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19447808, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760710.963889:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.963906:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760710.963910:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760710.963917:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760710.963931:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760711.002786:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972068 is committed
00002000:00010000:3.0:1789760711.003103:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19447808 -> 19451904
00010000:00010000:3.0:1789760711.003118:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.003131:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.003150:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.003158:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760711.003162:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.003172:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.003190:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.003197:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19447808->19451903] (req 19447808->19451903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760711.003290:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520862464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39451us (40231us total) trans 4294972068 rc 0/0
00000100:00100000:3.0:1789760711.003302:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4781
00000100:00100000:3.0:1789760711.003310:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682606921557 time 682650502697 state 0x2 ref 0
00000100:00100000:1.0:1789760711.008505:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760711.008579:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520862592
00000100:00100000:3.0:1789760711.008599:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520862592
00000100:00100000:3.0:1789760711.008652:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682606921557 time 682650502697 state 0x0 ref 1
00000100:00100000:3.0:1789760711.008667:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682650763113 time 682650502697 state 0x1 ref 1
00000100:00100000:3.0:1789760711.008694:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682650763113 time 682695377418 state 0x0 ref 1
00000100:00100000:3.0:1789760711.008706:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520862592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760711.008753:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19451904, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760711.008762:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.008779:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760711.008783:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760711.008789:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.008803:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760711.049861:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972069 is committed
00002000:00010000:3.0:1789760711.050027:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19451904 -> 19456000
00010000:00010000:3.0:1789760711.050045:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.050058:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.050067:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.050075:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760711.050080:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.050089:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.050108:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.050117:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19451904->19455999] (req 19451904->19455999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760711.050243:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520862592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41534us (41753us total) trans 4294972069 rc 0/0
00000100:00100000:3.0:1789760711.050254:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4782
00000100:00100000:3.0:1789760711.050265:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682650763113 time 682695377418 state 0x2 ref 0
00000100:00100000:1.0:1789760711.053579:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760711.053724:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520862720
00000100:00100000:2.0:1789760711.053734:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520862720
00000100:00100000:2.0:1789760711.053788:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682650763113 time 682695377418 state 0x0 ref 1
00000100:00100000:2.0:1789760711.053804:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682695637834 time 682695377418 state 0x1 ref 1
00000100:00100000:2.0:1789760711.053863:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682695637834 time 682740543995 state 0x0 ref 1
00000100:00100000:2.0:1789760711.053875:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520862720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760711.053918:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19456000, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:2.0:1789760711.053927:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.053942:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:2.0:1789760711.053947:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760711.053954:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.053975:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760711.105157:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972070 is committed
00002000:00010000:1.0:1789760711.105363:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19456000 -> 19460096
00010000:00010000:1.0:1789760711.105378:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.105390:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.105399:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.105407:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760711.105411:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.105419:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.105438:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.105444:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60b4c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19456000->19460095] (req 19456000->19460095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760711.105538:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520862720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51659us (51965us total) trans 4294972070 rc 0/0
00000100:00100000:1.0:1789760711.105551:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4783
00000100:00100000:1.0:1789760711.105560:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682695637834 time 682740543995 state 0x2 ref 0
00000100:00100000:0.0:1789760711.110406:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760711.110745:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520862848
00000100:00100000:3.0:1789760711.110754:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520862848
00000100:00100000:3.0:1789760711.110808:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682695637834 time 682740543995 state 0x0 ref 1
00000100:00100000:3.0:1789760711.110822:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682740804411 time 682740543995 state 0x1 ref 1
00000100:00100000:3.0:1789760711.110850:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682740804411 time 682797533488 state 0x0 ref 1
00000100:00100000:3.0:1789760711.110863:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520862848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760711.110910:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19460096, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760711.110920:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.110935:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760711.110939:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760711.110944:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.110961:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760711.145903:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972071 is committed
00002000:00010000:1.0:1789760711.146024:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19460096 -> 19464192
00010000:00010000:1.0:1789760711.146039:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.146052:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.146061:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.146069:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760711.146076:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.146085:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.146104:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.146112:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b4ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19460096->19464191] (req 19460096->19464191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760711.146209:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520862848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35345us (35809us total) trans 4294972071 rc 0/0
00000100:00100000:1.0:1789760711.146219:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4784
00000100:00100000:1.0:1789760711.146229:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682740804411 time 682797533488 state 0x2 ref 0
00000100:00100000:0.0:1789760711.150892:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760711.150980:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520862976
00000100:00100000:3.0:1789760711.150990:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520862976
00000100:00100000:3.0:1789760711.151044:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682740804411 time 682797533488 state 0x0 ref 1
00000100:00100000:3.0:1789760711.151059:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682797793904 time 682797533488 state 0x1 ref 1
00000100:00100000:3.0:1789760711.151086:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682797793904 time 682837769098 state 0x0 ref 1
00000100:00100000:3.0:1789760711.151097:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520862976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760711.151144:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19464192, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760711.151153:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.151169:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760711.151174:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760711.151180:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.151194:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760711.202355:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972072 is committed
00002000:00010000:1.0:1789760711.202787:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19464192 -> 19468288
00010000:00010000:1.0:1789760711.202804:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.202818:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.202828:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.202835:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760711.202840:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.202848:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.202867:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.202879:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b4d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19464192->19468287] (req 19464192->19468287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760711.202978:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520862976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51867us (52081us total) trans 4294972072 rc 0/0
00000100:00100000:1.0:1789760711.202989:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4785
00000100:00100000:1.0:1789760711.202998:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682797793904 time 682837769098 state 0x2 ref 0
00000100:00100000:0.0:1789760711.207736:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760711.207851:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520863104
00000100:00100000:3.0:1789760711.207861:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520863104
00000100:00100000:3.0:1789760711.207910:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682797793904 time 682837769098 state 0x0 ref 1
00000100:00100000:3.0:1789760711.207925:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682838029514 time 682837769098 state 0x1 ref 1
00000100:00100000:3.0:1789760711.208062:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682838029514 time 682894742966 state 0x0 ref 1
00000100:00100000:3.0:1789760711.208075:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520863104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760711.208121:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19468288, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760711.208130:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.208145:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:3.0:1789760711.208150:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760711.208155:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.208168:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.228749:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1789760711.247252:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19468288 -> 19472384
00010000:00010000:0.0:1789760711.247274:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.247287:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.247296:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.247303:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760711.247308:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.247344:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.247363:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.247444:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19468288->19472383] (req 19468288->19472383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760711.248884:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520863104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39521us (39868us total) trans 4294972073 rc 0/0
00000100:00100000:0.0:1789760711.248898:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4786
00000100:00100000:0.0:1789760711.248909:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682838029514 time 682894742966 state 0x2 ref 0
00000001:00080000:1.0:1789760711.249020:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972073 is committed
00000100:00100000:0.0:1789760711.252843:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760711.252888:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520863232
00000100:00100000:1.0:1789760711.252897:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520863232
00000100:00100000:1.0:1789760711.252942:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682838029514 time 682894742966 state 0x0 ref 1
00000100:00100000:1.0:1789760711.252954:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682895003382 time 682894742966 state 0x1 ref 1
00000100:00100000:1.0:1789760711.253058:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682895003382 time 682939738612 state 0x0 ref 1
00000100:00100000:1.0:1789760711.253071:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520863232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760711.253116:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19472384, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:1.0:1789760711.253125:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.253212:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:1.0:1789760711.253216:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760711.253221:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.253232:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760711.307401:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972074 is committed
00002000:00010000:2.0:1789760711.307644:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19472384 -> 19476480
00010000:00010000:2.0:1789760711.307659:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.307673:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.307682:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.307690:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760711.307695:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.307704:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.307724:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.307732:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b4df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19472384->19476479] (req 19472384->19476479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760711.307828:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520863232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54754us (54987us total) trans 4294972074 rc 0/0
00000100:00100000:2.0:1789760711.307839:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4787
00000100:00100000:2.0:1789760711.307850:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682895003382 time 682939738612 state 0x2 ref 0
00000100:00100000:2.0:1789760711.313409:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760711.314117:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520863360
00000100:00100000:1.0:1789760711.314127:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520863360
00000100:00100000:1.0:1789760711.314185:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682895003382 time 682939738612 state 0x0 ref 1
00000100:00100000:1.0:1789760711.314201:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682939999028 time 682939738612 state 0x1 ref 1
00000100:00100000:1.0:1789760711.314230:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682939999028 time 683000913096 state 0x0 ref 1
00000100:00100000:1.0:1789760711.314243:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520863360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760711.314288:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19476480, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:1.0:1789760711.314298:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.314332:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=682s v=(0 0)
00010000:00010000:1.0:1789760711.314337:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760711.314344:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.314358:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760711.478453:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19476480 -> 19480576
00010000:00010000:1.0:1789760711.478472:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.478486:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.478495:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.478503:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760711.478507:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.478516:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.478536:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.478545:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b4e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19476480->19480575] (req 19476480->19480575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760711.478688:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520863360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 164443us (165285us total) trans 4294972075 rc 0/0
00000100:00100000:1.0:1789760711.478703:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4788
00000100:00100000:1.0:1789760711.478712:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682939999028 time 683000913096 state 0x2 ref 0
00000001:00080000:1.0:1789760711.478752:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972075 is committed
00000100:00100000:3.0:1789760711.482222:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760711.482262:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520863488
00000100:00100000:3.0:1789760711.482271:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520863488
00000100:00100000:3.0:1789760711.482337:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 682939999028 time 683000913096 state 0x0 ref 1
00000100:00100000:3.0:1789760711.482559:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683001173512 time 683000913096 state 0x1 ref 1
00000100:00100000:3.0:1789760711.482590:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683001173512 time 683169271847 state 0x0 ref 1
00000100:00100000:3.0:1789760711.482720:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520863488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760711.482770:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19480576, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760711.482779:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.482795:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:3.0:1789760711.482799:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760711.482806:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.482820:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760711.565236:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19480576 -> 19484672
00010000:00010000:0.0:1789760711.565253:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.565267:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.565276:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.565283:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760711.565288:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.565298:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.565346:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.565354:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b4ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19480576->19484671] (req 19480576->19484671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760711.565435:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520863488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 82716us (83220us total) trans 4294972076 rc 0/0
00000100:00100000:0.0:1789760711.565445:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4789
00000100:00100000:0.0:1789760711.565454:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683001173512 time 683169271847 state 0x2 ref 0
00000001:00080000:1.0:1789760711.567238:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972076 is committed
00000100:00100000:3.0:1789760711.569680:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760711.570016:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520863616
00000100:00100000:0.0:1789760711.570026:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520863616
00000100:00100000:0.0:1789760711.570077:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683001173512 time 683169271847 state 0x0 ref 1
00000100:00100000:0.0:1789760711.570092:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683169532263 time 683169271847 state 0x1 ref 1
00000100:00100000:0.0:1789760711.570111:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683169532263 time 683256794866 state 0x0 ref 1
00000100:00100000:0.0:1789760711.570122:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520863616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760711.570174:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19484672, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:0.0:1789760711.570183:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.570198:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:0.0:1789760711.570203:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760711.570209:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.570220:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760711.618306:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972077 is committed
00002000:00010000:1.0:1789760711.618420:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19484672 -> 19488768
00010000:00010000:1.0:1789760711.618435:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.618447:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.618455:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.618463:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760711.618467:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.618476:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.618505:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.618513:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b4f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19484672->19488767] (req 19484672->19488767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760711.618608:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520863616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48482us (48932us total) trans 4294972077 rc 0/0
00000100:00100000:1.0:1789760711.618618:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4790
00000100:00100000:1.0:1789760711.618628:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683169532263 time 683256794866 state 0x2 ref 0
00000100:00100000:3.0:1789760711.622115:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760711.622203:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520863744
00000100:00100000:0.0:1789760711.622213:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520863744
00000100:00100000:0.0:1789760711.622261:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683169532263 time 683256794866 state 0x0 ref 1
00000100:00100000:0.0:1789760711.622276:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683257055282 time 683256794866 state 0x1 ref 1
00000100:00100000:0.0:1789760711.622304:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683257055282 time 683308986624 state 0x0 ref 1
00000100:00100000:0.0:1789760711.622335:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520863744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760711.622381:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19488768, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:0.0:1789760711.622390:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.622405:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:0.0:1789760711.622409:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760711.622414:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.622427:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760711.661145:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972078 is committed
00002000:00010000:3.0:1789760711.661254:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19488768 -> 19492864
00010000:00010000:3.0:1789760711.661268:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.661282:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.661292:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.661305:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760711.661310:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.661348:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.661367:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.661375:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b4fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19488768->19492863] (req 19488768->19492863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760711.661461:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520863744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39143us (39350us total) trans 4294972078 rc 0/0
00000100:00100000:3.0:1789760711.661471:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4791
00000100:00100000:3.0:1789760711.661480:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683257055282 time 683308986624 state 0x2 ref 0
00000100:00100000:3.0:1789760711.665285:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760711.665382:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520863872
00000100:00100000:1.0:1789760711.665392:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520863872
00000100:00100000:1.0:1789760711.665438:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683257055282 time 683308986624 state 0x0 ref 1
00000100:00100000:1.0:1789760711.665452:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683309247040 time 683308986624 state 0x1 ref 1
00000100:00100000:1.0:1789760711.665485:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683309247040 time 683352167379 state 0x0 ref 1
00000100:00100000:1.0:1789760711.665496:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520863872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760711.665539:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19492864, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:1.0:1789760711.665548:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.665564:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:1.0:1789760711.665568:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760711.665575:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.665587:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760711.690990:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19492864 -> 19496960
00010000:00010000:3.0:1789760711.691010:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.691023:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.691038:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.691046:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760711.691051:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.691060:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.691079:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.691086:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b502 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19492864->19496959] (req 19492864->19496959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760711.691183:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520863872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25683us (25901us total) trans 4294972079 rc 0/0
00000100:00100000:3.0:1789760711.691193:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4792
00000100:00100000:3.0:1789760711.691202:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683309247040 time 683352167379 state 0x2 ref 0
00000001:00080000:0.0:1789760711.691703:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972079 is committed
00000100:00100000:1.0:1789760711.695028:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760711.695114:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520864000
00000100:00100000:3.0:1789760711.695124:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520864000
00000100:00100000:3.0:1789760711.695183:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683309247040 time 683352167379 state 0x0 ref 1
00000100:00100000:3.0:1789760711.695199:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683352427795 time 683352167379 state 0x1 ref 1
00000100:00100000:3.0:1789760711.695238:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683352427795 time 683381920264 state 0x0 ref 1
00000100:00100000:3.0:1789760711.695250:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520864000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760711.695295:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19496960, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760711.695305:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.695358:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:3.0:1789760711.695363:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760711.695369:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.695384:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760711.728491:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972080 is committed
00002000:00010000:1.0:1789760711.728697:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19496960 -> 19501056
00010000:00010000:1.0:1789760711.728712:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.728724:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.728732:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.728739:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760711.728744:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.728753:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.728773:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760711.728781:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b509 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19496960->19501055] (req 19496960->19501055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760711.728903:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520864000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33651us (33882us total) trans 4294972080 rc 0/0
00000100:00100000:1.0:1789760711.728915:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4793
00000100:00100000:1.0:1789760711.728925:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683352427795 time 683381920264 state 0x2 ref 0
00000100:00100000:1.0:1789760711.732921:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760711.733013:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520864128
00000100:00100000:2.0:1789760711.733022:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520864128
00000100:00100000:2.0:1789760711.733077:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683352427795 time 683381920264 state 0x0 ref 1
00000100:00100000:2.0:1789760711.733092:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683382180680 time 683381920264 state 0x1 ref 1
00000100:00100000:2.0:1789760711.733120:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683382180680 time 683419802917 state 0x0 ref 1
00000100:00100000:2.0:1789760711.733132:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520864128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760711.733176:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19501056, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:2.0:1789760711.733185:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.733200:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:2.0:1789760711.733204:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760711.733211:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.733224:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760711.765121:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972081 is committed
00002000:00010000:2.0:1789760711.765222:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19501056 -> 19505152
00010000:00010000:2.0:1789760711.765241:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.765255:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.765265:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.765272:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760711.765277:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.765285:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.765303:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760711.765311:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b510 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19501056->19505151] (req 19501056->19505151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760711.765420:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520864128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32286us (32505us total) trans 4294972081 rc 0/0
00000100:00100000:2.0:1789760711.765434:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4794
00000100:00100000:2.0:1789760711.765443:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683382180680 time 683419802917 state 0x2 ref 0
00000100:00100000:3.0:1789760711.773850:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760711.774020:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520864256
00000100:00100000:0.0:1789760711.774031:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520864256
00000100:00100000:0.0:1789760711.774090:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683382180680 time 683419802917 state 0x0 ref 1
00000100:00100000:0.0:1789760711.774106:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683420063333 time 683419802917 state 0x1 ref 1
00000100:00100000:0.0:1789760711.774178:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683420063333 time 683460859890 state 0x0 ref 1
00000100:00100000:0.0:1789760711.774191:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520864256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760711.774241:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19505152, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:0.0:1789760711.774249:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.774266:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:0.0:1789760711.774271:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760711.774277:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.774292:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760711.801486:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548738944:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760711.801566:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.801838:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548738944
00000100:00100000:1.0:1789760711.801845:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548738944
00000100:00100000:1.0:1789760711.802254:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336
00000100:00100000:1.0:1789760711.802265:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548738944:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:1.0:1789760711.802300:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760711.802375:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548738944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (809us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.802383:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336
00000100:00080000:1.0:1789760711.802404:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789760711.802442:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548738944:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760711.803652:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548739072:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760711.803715:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.803829:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548739072
00000100:00100000:1.0:1789760711.803836:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548739072
00000100:00100000:1.0:1789760711.804397:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337
00000100:00100000:1.0:1789760711.804407:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548739072:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1789760711.804426:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760711.804468:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548739072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (752us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.804478:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337
00000100:00100000:0.0:1789760711.804549:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548739072:0@lo:13:osp-pre-1-1.0
00000100:00080000:1.0:1789760711.809292:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789760711.809524:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548739200:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.809601:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.809641:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548739712:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.809669:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.809686:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548740224:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.809709:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.809737:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:1.0:1789760711.809743:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548739328:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.809768:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.809785:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548739840:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.809805:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.809819:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548740352:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.809836:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.809880:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548739200
00000100:00100000:1.0:1789760711.809888:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548739200
00000100:00100000:1.0:1789760711.809932:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459
00000100:00100000:1.0:1789760711.809941:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda0058050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548739200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.810276:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda0058050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548739200:12345-0@lo:400:kworker.0 Request processed in 334us (673us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.810284:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459
00000100:00100000:1.0:1789760711.810342:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548740224
00000100:00100000:1.0:1789760711.810347:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548740224
00000100:00100000:1.0:1789760711.810419:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264
00000100:00100000:1.0:1789760711.810428:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548740224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.810465:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548740224:12345-0@lo:400:kworker.0 Request processed in 39us (755us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.810471:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264
00000100:00100000:1.0:1789760711.810497:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548739328
00000100:00100000:1.0:1789760711.810501:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548739328
00000100:00100000:1.0:1789760711.810526:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548739840
00000100:00100000:1.0:1789760711.810529:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548739840
00000100:00100000:1.0:1789760711.810552:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548740352
00000100:00100000:1.0:1789760711.810554:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548740352
00000100:00100000:1.0:1789760711.810568:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817
00000100:00100000:1.0:1789760711.810574:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548739328:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.810604:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548739328:12345-0@lo:400:kworker.0 Request processed in 31us (835us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.810610:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817
00000100:00100000:1.0:1789760711.810621:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818
00000100:00100000:1.0:1789760711.810627:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548739840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.810654:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548739840:12345-0@lo:400:kworker.0 Request processed in 27us (847us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.810660:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818
00000100:00100000:1.0:1789760711.810670:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819
00000100:00100000:1.0:1789760711.810676:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548740352:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.810700:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548740352:12345-0@lo:400:kworker.0 Request processed in 25us (863us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.810706:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819
00000100:00080000:1.0:1789760711.810735:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789760711.810750:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548739456:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.810778:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.810798:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548739968:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.810820:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.810836:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548740480:0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.813281:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548739712
00000100:00100000:3.0:1789760711.813296:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548739712
00000100:00100000:3.0:1789760711.813378:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548739456
00000100:00100000:3.0:1789760711.813382:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548739456
00000100:00100000:3.0:1789760711.813401:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403
00000100:00100000:3.0:1789760711.813409:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548739712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.813494:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548739712:12345-0@lo:400:kworker.0 Request processed in 84us (3822us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760711.813501:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403
00000100:00100000:3.0:1789760711.813518:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404
00000100:00100000:3.0:1789760711.813525:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548739456:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.813556:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548739456:12345-0@lo:400:kworker.0 Request processed in 32us (2778us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760711.813562:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404
00000100:00100000:3.0:1789760711.814216:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548739328:0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.814233:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548739840:0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.814243:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548740352:0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.814253:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548739200:0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.814262:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548739712:0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.814272:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548740224:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.814813:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760711.815065:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548739968
00000100:00100000:3.0:1789760711.815072:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548739968
00000100:00100000:3.0:1789760711.815116:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548740480
00000100:00100000:3.0:1789760711.815120:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548740480
00000100:00100000:3.0:1789760711.815141:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820
00000100:00100000:3.0:1789760711.815148:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548739968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.815203:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548739968:12345-0@lo:400:kworker.0 Request processed in 55us (4381us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760711.815210:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820
00000100:00100000:3.0:1789760711.815224:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821
00000100:00100000:3.0:1789760711.815230:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548740480:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760711.815257:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548740480:12345-0@lo:400:kworker.0 Request processed in 27us (4401us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760711.815263:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821
00000100:00080000:3.0:1789760711.815286:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1789760711.816089:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548739456:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.816112:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548739968:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.816123:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548740480:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.816143:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:1.0:1789760711.816153:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548739584:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.816192:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.816225:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548740096:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.816249:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760711.816274:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548740096
00000100:00100000:1.0:1789760711.816279:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548740096
00000100:00100000:1.0:1789760711.816329:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265
00000100:00100000:1.0:1789760711.816336:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548740096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.816364:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548740096:12345-0@lo:400:kworker.0 Request processed in 29us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.816370:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265
00000100:00100000:1.0:1789760711.816389:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548739584
00000100:00100000:1.0:1789760711.816392:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548739584
00000100:00100000:1.0:1789760711.816412:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822
00000100:00100000:1.0:1789760711.816417:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548739584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.816445:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548739584:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760711.816450:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822
00000100:00100000:1.0:1789760711.816468:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548740096:0@lo:400:kworker.0
00000100:00100000:1.0:1789760711.816480:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548739584:0@lo:400:kworker.0
00002000:00010000:0.0:1789760711.825481:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19505152 -> 19509248
00010000:00010000:0.0:1789760711.825510:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.825523:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.825532:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.825539:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760711.825544:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.825554:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.825573:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760711.825580:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b517 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19505152->19509247] (req 19505152->19509247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760711.825670:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520864256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51477us (51827us total) trans 4294972082 rc 0/0
00000100:00100000:0.0:1789760711.825681:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4795
00000100:00100000:0.0:1789760711.825691:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683420063333 time 683460859890 state 0x2 ref 0
00000001:00080000:2.0:1789760711.826920:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972082 is committed
00000100:00100000:1.0:1789760711.831559:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760711.831695:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520864384
00000100:00100000:3.0:1789760711.831705:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520864384
00000100:00100000:3.0:1789760711.831763:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683420063333 time 683460859890 state 0x0 ref 1
00000100:00100000:3.0:1789760711.831779:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683461120306 time 683460859890 state 0x1 ref 1
00000100:00100000:3.0:1789760711.831815:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683461120306 time 683518496841 state 0x0 ref 1
00000100:00100000:3.0:1789760711.831827:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520864384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760711.831892:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19509248, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760711.831903:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.831920:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:3.0:1789760711.831925:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760711.831932:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.831947:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760711.898095:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972083 is committed
00002000:00010000:3.0:1789760711.898279:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19509248 -> 19513344
00010000:00010000:3.0:1789760711.898294:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.898331:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.898341:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.898362:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760711.898367:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.898376:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.898396:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.898405:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b51e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19509248->19513343] (req 19509248->19513343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760711.898507:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520864384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66677us (66955us total) trans 4294972083 rc 0/0
00000100:00100000:3.0:1789760711.898518:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4796
00000100:00100000:3.0:1789760711.898527:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683461120306 time 683518496841 state 0x2 ref 0
00000100:00100000:1.0:1789760711.909779:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760711.909928:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520864512
00000100:00100000:3.0:1789760711.909938:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520864512
00000100:00100000:3.0:1789760711.909996:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683461120306 time 683518496841 state 0x0 ref 1
00000100:00100000:3.0:1789760711.910012:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683518757257 time 683518496841 state 0x1 ref 1
00000100:00100000:3.0:1789760711.910135:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683518757257 time 683596817656 state 0x0 ref 1
00000100:00100000:3.0:1789760711.910147:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520864512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760711.910192:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19513344, mtime: 0x6aad94c8, atime: 0x0, ctime: 0x6aad94c8, blocks: 0x9807
00010000:00010000:3.0:1789760711.910201:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.910216:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:3.0:1789760711.910220:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760711.910226:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760711.910239:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760712.002752:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972084 is committed
00002000:00010000:1.0:1789760712.002919:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19513344 -> 19517440
00002000:00010000:1.0:1789760712.002924:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760712 -> 1789760713
00002000:00010000:1.0:1789760712.002926:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760712 -> 1789760713
00010000:00010000:1.0:1789760712.002939:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.002952:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.002972:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.002979:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760712.002985:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.002994:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.003018:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.003026:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b525 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19513344->19517439] (req 19513344->19517439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760712.003122:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520864512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 92971us (93348us total) trans 4294972084 rc 0/0
00000100:00100000:1.0:1789760712.003132:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4797
00000100:00100000:1.0:1789760712.003142:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683518757257 time 683596817656 state 0x2 ref 0
00000100:00100000:1.0:1789760712.014787:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760712.014897:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520864640
00000100:00100000:2.0:1789760712.014907:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520864640
00000100:00100000:2.0:1789760712.014991:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683518757257 time 683596817656 state 0x0 ref 1
00000100:00100000:2.0:1789760712.015007:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683597078072 time 683596817656 state 0x1 ref 1
00000100:00100000:2.0:1789760712.015041:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683597078072 time 683701723269 state 0x0 ref 1
00000100:00100000:2.0:1789760712.015053:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520864640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760712.015102:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19517440, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:2.0:1789760712.015111:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.015126:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:2.0:1789760712.015131:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760712.015137:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.015150:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760712.015617:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:1.0:1789760712.077034:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972085 is committed
00002000:00010000:2.0:1789760712.077116:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19517440 -> 19521536
00010000:00010000:2.0:1789760712.077132:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.077145:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.077155:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.077163:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760712.077168:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.077176:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.077194:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.077202:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b52c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19517440->19521535] (req 19517440->19521535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760712.077438:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520864640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62382us (62656us total) trans 4294972085 rc 0/0
00000100:00100000:2.0:1789760712.077454:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4798
00000100:00100000:2.0:1789760712.077464:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683597078072 time 683701723269 state 0x2 ref 0
00000100:00100000:0.0:1789760712.081765:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760712.081855:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520864768
00000100:00100000:2.0:1789760712.081866:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520864768
00000100:00100000:2.0:1789760712.081920:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683597078072 time 683701723269 state 0x0 ref 1
00000100:00100000:2.0:1789760712.081936:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683701983685 time 683701723269 state 0x1 ref 1
00000100:00100000:2.0:1789760712.082077:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683701983685 time 683768758262 state 0x0 ref 1
00000100:00100000:2.0:1789760712.082091:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520864768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760712.082143:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19521536, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:2.0:1789760712.082152:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.082169:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:2.0:1789760712.082174:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760712.082180:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.082196:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760712.128418:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972086 is committed
00002000:00010000:2.0:1789760712.128643:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19521536 -> 19525632
00010000:00010000:2.0:1789760712.128658:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.128672:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.128681:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.128689:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760712.128694:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.128703:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.128722:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.128730:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b533 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19521536->19525631] (req 19521536->19525631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760712.128825:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520864768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46732us (47067us total) trans 4294972086 rc 0/0
00000100:00100000:2.0:1789760712.128835:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4799
00000100:00100000:2.0:1789760712.128843:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683701983685 time 683768758262 state 0x2 ref 0
00000100:00100000:2.0:1789760712.133942:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760712.134182:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520864896
00000100:00100000:3.0:1789760712.134192:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520864896
00000100:00100000:3.0:1789760712.134248:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683701983685 time 683768758262 state 0x0 ref 1
00000100:00100000:3.0:1789760712.134263:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683769018678 time 683768758262 state 0x1 ref 1
00000100:00100000:3.0:1789760712.134291:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683769018678 time 683820973774 state 0x0 ref 1
00000100:00100000:3.0:1789760712.134304:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520864896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760712.134376:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19525632, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:3.0:1789760712.134386:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.134402:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:3.0:1789760712.134406:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760712.134412:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.134425:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760712.186506:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19525632 -> 19529728
00010000:00010000:3.0:1789760712.186527:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.186540:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.186548:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.186556:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760712.186561:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.186571:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760712.186675:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972087 is committed
00010000:00010000:3.0:1789760712.186818:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.186828:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b53a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19525632->19529727] (req 19525632->19529727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760712.187047:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520864896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52740us (53108us total) trans 4294972087 rc 0/0
00000100:00100000:3.0:1789760712.187058:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4800
00000100:00100000:3.0:1789760712.187068:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683769018678 time 683820973774 state 0x2 ref 0
00000100:00100000:1.0:1789760712.191901:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760712.191982:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520865024
00000100:00100000:3.0:1789760712.191993:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520865024
00000100:00100000:3.0:1789760712.192045:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683769018678 time 683820973774 state 0x0 ref 1
00000100:00100000:3.0:1789760712.192061:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683821234190 time 683820973774 state 0x1 ref 1
00000100:00100000:3.0:1789760712.192093:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683821234190 time 683878775264 state 0x0 ref 1
00000100:00100000:3.0:1789760712.192105:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520865024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760712.192150:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19529728, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:3.0:1789760712.192159:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.192174:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:3.0:1789760712.192178:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760712.192184:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.192198:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760712.227751:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972088 is committed
00002000:00010000:1.0:1789760712.227868:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19529728 -> 19533824
00010000:00010000:1.0:1789760712.227884:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.227896:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.227905:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.227917:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760712.227922:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.227930:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.227947:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.227954:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b541 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19529728->19533823] (req 19529728->19533823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760712.228165:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520865024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36057us (36269us total) trans 4294972088 rc 0/0
00000100:00100000:1.0:1789760712.228175:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4801
00000100:00100000:1.0:1789760712.228183:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683821234190 time 683878775264 state 0x2 ref 0
00000100:00100000:1.0:1789760712.233914:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760712.234079:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520865152
00000100:00100000:2.0:1789760712.234089:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520865152
00000100:00100000:2.0:1789760712.234139:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683821234190 time 683878775264 state 0x0 ref 1
00000100:00100000:2.0:1789760712.234154:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683879035680 time 683878775264 state 0x1 ref 1
00000100:00100000:2.0:1789760712.234213:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683879035680 time 683920894771 state 0x0 ref 1
00000100:00100000:2.0:1789760712.234226:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520865152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760712.234273:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19533824, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:2.0:1789760712.234282:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.234298:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=683s v=(0 0)
00010000:00010000:2.0:1789760712.234303:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760712.234340:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.234356:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.255997:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760712.326789:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972089 is committed
00002000:00010000:0.0:1789760712.326859:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19533824 -> 19537920
00010000:00010000:0.0:1789760712.326876:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.326890:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.326899:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.326907:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760712.326913:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.326924:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.326946:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.326954:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b548 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19533824->19537919] (req 19533824->19537919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760712.327129:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520865152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 92900us (93280us total) trans 4294972089 rc 0/0
00000100:00100000:0.0:1789760712.327141:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4802
00000100:00100000:0.0:1789760712.327151:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683879035680 time 683920894771 state 0x2 ref 0
00000100:00100000:2.0:1789760712.339909:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760712.340005:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520865280
00000100:00100000:0.0:1789760712.340014:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520865280
00000100:00100000:0.0:1789760712.340060:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683879035680 time 683920894771 state 0x0 ref 1
00000100:00100000:0.0:1789760712.340075:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683921155187 time 683920894771 state 0x1 ref 1
00000100:00100000:0.0:1789760712.340103:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683921155187 time 684026785813 state 0x0 ref 1
00000100:00100000:0.0:1789760712.340114:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520865280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760712.340156:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19537920, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:0.0:1789760712.340164:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.340179:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:0.0:1789760712.340183:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760712.340189:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.340204:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760712.436335:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972090 is committed
00002000:00010000:0.0:1789760712.436538:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19537920 -> 19542016
00010000:00010000:0.0:1789760712.436553:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.436566:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.436576:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.436584:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760712.436590:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.436598:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.436618:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.436625:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b54f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19537920->19542015] (req 19537920->19542015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760712.436715:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520865280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 96596us (96810us total) trans 4294972090 rc 0/0
00000100:00100000:0.0:1789760712.436725:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4803
00000100:00100000:0.0:1789760712.436734:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683921155187 time 684026785813 state 0x2 ref 0
00000100:00100000:1.0:1789760712.440239:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760712.440375:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520865408
00000100:00100000:3.0:1789760712.440385:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520865408
00000100:00100000:3.0:1789760712.440436:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 683921155187 time 684026785813 state 0x0 ref 1
00000100:00100000:3.0:1789760712.440451:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684027046229 time 684026785813 state 0x1 ref 1
00000100:00100000:3.0:1789760712.440514:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684027046229 time 684127196507 state 0x0 ref 1
00000100:00100000:3.0:1789760712.440527:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520865408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760712.440567:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19542016, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:3.0:1789760712.440575:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.440600:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:3.0:1789760712.440605:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760712.440611:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.440629:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760712.469812:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972091 is committed
00002000:00010000:3.0:1789760712.469896:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19542016 -> 19546112
00010000:00010000:3.0:1789760712.469913:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.469927:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.469936:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.469945:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760712.469950:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.469971:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.469990:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.469998:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b556 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19542016->19546111] (req 19542016->19546111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760712.470099:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520865408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29568us (29862us total) trans 4294972091 rc 0/0
00000100:00100000:3.0:1789760712.470109:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4804
00000100:00100000:3.0:1789760712.470118:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684027046229 time 684127196507 state 0x2 ref 0
00000100:00100000:1.0:1789760712.474769:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760712.474856:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520865536
00000100:00100000:3.0:1789760712.474869:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520865536
00000100:00100000:3.0:1789760712.474939:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684027046229 time 684127196507 state 0x0 ref 1
00000100:00100000:3.0:1789760712.474968:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684127456923 time 684127196507 state 0x1 ref 1
00000100:00100000:3.0:1789760712.475046:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684127456923 time 684161727744 state 0x0 ref 1
00000100:00100000:3.0:1789760712.475058:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520865536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760712.475110:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19546112, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:3.0:1789760712.475119:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.475134:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:3.0:1789760712.475139:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760712.475145:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.475160:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760712.509358:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972092 is committed
00002000:00010000:2.0:1789760712.509700:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19546112 -> 19550208
00010000:00010000:2.0:1789760712.509716:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.509729:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.509739:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.509747:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760712.509753:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.509762:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.509781:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.509788:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b55d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19546112->19550207] (req 19546112->19550207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760712.509940:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520865536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34877us (35178us total) trans 4294972092 rc 0/0
00000100:00100000:2.0:1789760712.509951:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4805
00000100:00100000:2.0:1789760712.509992:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684127456923 time 684161727744 state 0x2 ref 0
00000100:00100000:2.0:1789760712.523998:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760712.524151:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520865664
00000100:00100000:0.0:1789760712.524161:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520865664
00000100:00100000:0.0:1789760712.524215:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684127456923 time 684161727744 state 0x0 ref 1
00000100:00100000:0.0:1789760712.524231:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684161988160 time 684161727744 state 0x1 ref 1
00000100:00100000:0.0:1789760712.524260:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684161988160 time 684210943264 state 0x0 ref 1
00000100:00100000:0.0:1789760712.524273:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520865664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760712.524355:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19550208, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:0.0:1789760712.524365:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.524382:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:0.0:1789760712.524386:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760712.524394:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.524408:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760712.664868:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972093 is committed
00002000:00010000:1.0:1789760712.665073:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19550208 -> 19554304
00010000:00010000:1.0:1789760712.665089:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.665108:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.665118:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.665125:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760712.665130:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.665139:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.665157:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.665165:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b564 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19550208->19554303] (req 19550208->19554303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760712.665252:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520865664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 140976us (141259us total) trans 4294972093 rc 0/0
00000100:00100000:1.0:1789760712.665262:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4806
00000100:00100000:1.0:1789760712.665271:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684161988160 time 684210943264 state 0x2 ref 0
00000100:00100000:1.0:1789760712.669283:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760712.669567:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520865792
00000100:00100000:0.0:1789760712.669578:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520865792
00000100:00100000:0.0:1789760712.669645:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684161988160 time 684210943264 state 0x0 ref 1
00000100:00100000:0.0:1789760712.669660:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684211203680 time 684210943264 state 0x1 ref 1
00000100:00100000:0.0:1789760712.669704:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684211203680 time 684356386398 state 0x0 ref 1
00000100:00100000:0.0:1789760712.669723:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520865792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760712.669772:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19554304, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:0.0:1789760712.669780:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.669797:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:0.0:1789760712.669802:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760712.669809:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.669824:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760712.716839:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972094 is committed
00002000:00010000:1.0:1789760712.716994:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19554304 -> 19558400
00010000:00010000:1.0:1789760712.717014:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.717029:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.717039:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.717047:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760712.717053:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.717063:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.717087:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.717094:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60b56b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19554304->19558399] (req 19554304->19558399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760712.717214:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520865792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47491us (47931us total) trans 4294972094 rc 0/0
00000100:00100000:1.0:1789760712.717228:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4807
00000100:00100000:1.0:1789760712.717241:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684211203680 time 684356386398 state 0x2 ref 0
00000100:00100000:2.0:1789760712.728286:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760712.728479:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520865920
00000100:00100000:3.0:1789760712.728491:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520865920
00000100:00100000:3.0:1789760712.728560:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684211203680 time 684356386398 state 0x0 ref 1
00000100:00100000:3.0:1789760712.728579:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684356646814 time 684356386398 state 0x1 ref 1
00000100:00100000:3.0:1789760712.728614:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684356646814 time 684415296079 state 0x0 ref 1
00000100:00100000:3.0:1789760712.728627:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520865920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760712.728690:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19558400, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:3.0:1789760712.729209:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.729232:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:3.0:1789760712.729237:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760712.729244:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760712.729263:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760712.766406:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972095 is committed
00002000:00010000:2.0:1789760712.766898:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19558400 -> 19562496
00010000:00010000:2.0:1789760712.766919:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.766934:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.766943:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.766950:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760712.766968:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.766977:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.767002:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.767009:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b572 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19558400->19562495] (req 19558400->19562495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760712.767144:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520865920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38512us (38863us total) trans 4294972095 rc 0/0
00000100:00100000:2.0:1789760712.767158:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4808
00000100:00100000:2.0:1789760712.767170:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684356646814 time 684415296079 state 0x2 ref 0
00000100:00100000:2.0:1789760712.779798:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760712.781149:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520866048
00000100:00100000:1.0:1789760712.781164:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520866048
00000100:00100000:1.0:1789760712.781228:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684356646814 time 684415296079 state 0x0 ref 1
00000100:00100000:1.0:1789760712.781244:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684415556495 time 684415296079 state 0x1 ref 1
00000100:00100000:1.0:1789760712.781382:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684415556495 time 684468063463 state 0x0 ref 1
00000100:00100000:1.0:1789760712.781397:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520866048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760712.781444:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19562496, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:1.0:1789760712.781453:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.781469:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:1.0:1789760712.781473:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760712.781479:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760712.781503:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760712.869135:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972096 is committed
00002000:00010000:2.0:1789760712.869202:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19562496 -> 19566592
00010000:00010000:2.0:1789760712.869218:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.869232:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.869242:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.869249:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760712.869253:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.869261:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.869279:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760712.869284:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b579 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19562496->19566591] (req 19562496->19566591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760712.869398:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520866048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 87999us (89607us total) trans 4294972096 rc 0/0
00000100:00100000:2.0:1789760712.869411:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4809
00000100:00100000:2.0:1789760712.869421:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684415556495 time 684468063463 state 0x2 ref 0
00000100:00100000:1.0:1789760712.873274:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760712.873394:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520866176
00000100:00100000:0.0:1789760712.873404:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520866176
00000100:00100000:0.0:1789760712.873451:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684415556495 time 684468063463 state 0x0 ref 1
00000100:00100000:0.0:1789760712.873464:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684468323879 time 684468063463 state 0x1 ref 1
00000100:00100000:0.0:1789760712.873485:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684468323879 time 684560169215 state 0x0 ref 1
00000100:00100000:0.0:1789760712.873497:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520866176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760712.873609:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19566592, mtime: 0x6aad94c9, atime: 0x0, ctime: 0x6aad94c9, blocks: 0x9807
00010000:00010000:0.0:1789760712.873618:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.873634:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:0.0:1789760712.873638:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760712.873644:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.873657:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760712.949388:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19566592 -> 19570688
00002000:00010000:0.0:1789760712.949400:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760713 -> 1789760714
00002000:00010000:0.0:1789760712.949403:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760713 -> 1789760714
00010000:00010000:0.0:1789760712.949417:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.949432:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.949443:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.949451:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760712.949456:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.949470:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.949500:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.949516:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b580 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19566592->19570687] (req 19566592->19570687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760712.949614:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520866176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76114us (76344us total) trans 4294972097 rc 0/0
00000100:00100000:0.0:1789760712.949626:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4810
00000100:00100000:0.0:1789760712.949635:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684468323879 time 684560169215 state 0x2 ref 0
00000001:00080000:2.0:1789760712.949772:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972097 is committed
00000100:00100000:2.0:1789760712.955495:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760712.955659:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520866304
00000100:00100000:0.0:1789760712.955669:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520866304
00000100:00100000:0.0:1789760712.955724:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684468323879 time 684560169215 state 0x0 ref 1
00000100:00100000:0.0:1789760712.955742:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684560429631 time 684560169215 state 0x1 ref 1
00000100:00100000:0.0:1789760712.955772:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684560429631 time 684642454916 state 0x0 ref 1
00000100:00100000:0.0:1789760712.955786:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520866304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760712.955861:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19570688, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:0.0:1789760712.955889:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.955912:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:0.0:1789760712.955917:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760712.955925:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760712.955942:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760713.028788:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972098 is committed
00002000:00010000:2.0:1789760713.028864:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19570688 -> 19574784
00010000:00010000:2.0:1789760713.028879:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.028892:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.028901:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.028908:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760713.028913:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.028922:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.028941:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.028948:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b587 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19570688->19574783] (req 19570688->19574783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760713.029052:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520866304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73262us (73562us total) trans 4294972098 rc 0/0
00000100:00100000:2.0:1789760713.029064:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4811
00000100:00100000:2.0:1789760713.029073:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684560429631 time 684642454916 state 0x2 ref 0
00000100:00100000:1.0:1789760713.031690:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760713.031783:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520866432
00000100:00100000:2.0:1789760713.031793:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520866432
00000100:00100000:2.0:1789760713.031839:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684560429631 time 684642454916 state 0x0 ref 1
00000100:00100000:2.0:1789760713.031851:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684642715332 time 684642454916 state 0x1 ref 1
00000100:00100000:2.0:1789760713.031874:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684642715332 time 684718557051 state 0x0 ref 1
00000100:00100000:2.0:1789760713.031886:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520866432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760713.031931:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19574784, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:2.0:1789760713.031941:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.031970:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:2.0:1789760713.032062:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760713.032067:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.032078:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760713.064336:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972099 is committed
00002000:00010000:2.0:1789760713.064498:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19574784 -> 19578880
00010000:00010000:2.0:1789760713.064513:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.064525:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.064534:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.064542:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760713.064546:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.064555:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.064573:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.064581:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b58e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19574784->19578879] (req 19574784->19578879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760713.064932:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520866432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33044us (33256us total) trans 4294972099 rc 0/0
00000100:00100000:2.0:1789760713.064944:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4812
00000100:00100000:2.0:1789760713.064963:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684642715332 time 684718557051 state 0x2 ref 0
00000100:00100000:3.0:1789760713.073160:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760713.073365:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520866560
00000100:00100000:2.0:1789760713.073375:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520866560
00000100:00100000:2.0:1789760713.073432:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684642715332 time 684718557051 state 0x0 ref 1
00000100:00100000:2.0:1789760713.073448:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684718817467 time 684718557051 state 0x1 ref 1
00000100:00100000:2.0:1789760713.073485:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684718817467 time 684760167163 state 0x0 ref 1
00000100:00100000:2.0:1789760713.073498:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520866560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760713.073545:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19578880, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:2.0:1789760713.073554:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.073570:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:2.0:1789760713.073574:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760713.073580:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.073594:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760713.119382:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972100 is committed
00002000:00010000:3.0:1789760713.119443:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19578880 -> 19582976
00010000:00010000:3.0:1789760713.119459:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.119478:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.119557:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.119565:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760713.119570:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.119580:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.119601:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.119610:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b595 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19578880->19582975] (req 19578880->19582975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760713.119694:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520866560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46193us (46543us total) trans 4294972100 rc 0/0
00000100:00100000:3.0:1789760713.119705:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4813
00000100:00100000:3.0:1789760713.119714:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684718817467 time 684760167163 state 0x2 ref 0
00000100:00100000:0.0:1789760713.124055:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760713.124158:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520866688
00000100:00100000:1.0:1789760713.124167:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520866688
00000100:00100000:1.0:1789760713.124219:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684718817467 time 684760167163 state 0x0 ref 1
00000100:00100000:1.0:1789760713.124234:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684760427579 time 684760167163 state 0x1 ref 1
00000100:00100000:1.0:1789760713.124269:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684760427579 time 684810951032 state 0x0 ref 1
00000100:00100000:1.0:1789760713.124280:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520866688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760713.128424:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19582976, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:1.0:1789760713.128440:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760713.128457:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:1.0:1789760713.128462:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760713.128469:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760713.128495:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760713.162884:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972101 is committed
00002000:00010000:3.0:1789760713.163177:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19582976 -> 19587072
00010000:00010000:3.0:1789760713.163193:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.163205:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.163214:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.163222:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760713.163226:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.163234:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.163253:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.163260:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b59c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19582976->19587071] (req 19582976->19587071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760713.163618:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520866688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39334us (39567us total) trans 4294972101 rc 0/0
00000100:00100000:3.0:1789760713.163629:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4814
00000100:00100000:3.0:1789760713.163638:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684760427579 time 684810951032 state 0x2 ref 0
00000100:00100000:1.0:1789760713.171526:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760713.171614:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520866816
00000100:00100000:0.0:1789760713.171623:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520866816
00000100:00100000:0.0:1789760713.171677:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684760427579 time 684810951032 state 0x0 ref 1
00000100:00100000:0.0:1789760713.171692:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684811211448 time 684810951032 state 0x1 ref 1
00000100:00100000:0.0:1789760713.171765:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684811211448 time 684858446794 state 0x0 ref 1
00000100:00100000:0.0:1789760713.171778:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520866816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760713.171830:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19587072, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:0.0:1789760713.171839:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.171866:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:0.0:1789760713.171872:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760713.171878:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.171893:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760713.273971:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972102 is committed
00002000:00010000:0.0:1789760713.274141:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19587072 -> 19591168
00010000:00010000:0.0:1789760713.274157:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.274170:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.274180:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.274188:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760713.274192:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.274201:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.274219:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.274228:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19587072->19591167] (req 19587072->19591167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760713.274356:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520866816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 102575us (102835us total) trans 4294972102 rc 0/0
00000100:00100000:0.0:1789760713.274367:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4815
00000100:00100000:0.0:1789760713.274377:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684811211448 time 684858446794 state 0x2 ref 0
00010000:00010000:2.0:1789760713.275057:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789760713.296797:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760713.305253:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520866944
00000100:00100000:2.0:1789760713.305269:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520866944
00000100:00100000:2.0:1789760713.305357:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684811211448 time 684858446794 state 0x0 ref 1
00000100:00100000:2.0:1789760713.305373:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684858707210 time 684858446794 state 0x1 ref 1
00000100:00100000:2.0:1789760713.305400:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684858707210 time 684992083302 state 0x0 ref 1
00000100:00100000:2.0:1789760713.305415:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520866944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760713.305466:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19591168, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:2.0:1789760713.305476:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.305762:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=684s v=(0 0)
00010000:00010000:2.0:1789760713.305767:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760713.305774:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.305789:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760713.341411:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972103 is committed
00002000:00010000:0.0:1789760713.341824:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19591168 -> 19595264
00010000:00010000:0.0:1789760713.341838:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.341851:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.341860:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.341867:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760713.341872:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.341881:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.341903:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.341917:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19591168->19595263] (req 19591168->19595263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760713.342294:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520866944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36877us (45503us total) trans 4294972103 rc 0/0
00000100:00100000:0.0:1789760713.342306:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4816
00000100:00100000:0.0:1789760713.342363:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684858707210 time 684992083302 state 0x2 ref 0
00000100:00100000:0.0:1789760713.361750:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760713.361966:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520867072
00000100:00100000:3.0:1789760713.361976:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520867072
00000100:00100000:3.0:1789760713.362030:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684858707210 time 684992083302 state 0x0 ref 1
00000100:00100000:3.0:1789760713.362045:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684992343718 time 684992083302 state 0x1 ref 1
00000100:00100000:3.0:1789760713.362078:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684992343718 time 685048760266 state 0x0 ref 1
00000100:00100000:3.0:1789760713.362091:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520867072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760713.362135:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19595264, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:3.0:1789760713.362145:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.362159:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:3.0:1789760713.362164:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760713.362170:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.362185:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760713.432700:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972104 is committed
00002000:00010000:0.0:1789760713.432851:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19595264 -> 19599360
00010000:00010000:0.0:1789760713.432867:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.432879:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.432889:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.432896:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760713.432901:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.432911:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.432936:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.432944:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b5b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19595264->19599359] (req 19595264->19599359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760713.433042:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520867072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70949us (71299us total) trans 4294972104 rc 0/0
00000100:00100000:0.0:1789760713.433052:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4817
00000100:00100000:0.0:1789760713.433067:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684992343718 time 685048760266 state 0x2 ref 0
00000100:00100000:1.0:1789760713.439872:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760713.440443:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520867200
00000100:00100000:3.0:1789760713.440453:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520867200
00000100:00100000:3.0:1789760713.440526:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 684992343718 time 685048760266 state 0x0 ref 1
00000100:00100000:3.0:1789760713.440545:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685049020682 time 685048760266 state 0x1 ref 1
00000100:00100000:3.0:1789760713.440570:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685049020682 time 685127253106 state 0x0 ref 1
00000100:00100000:3.0:1789760713.440582:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520867200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760713.440628:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19599360, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:3.0:1789760713.440636:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.440652:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:3.0:1789760713.440656:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760713.440662:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.440675:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760713.520128:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972105 is committed
00002000:00010000:0.0:1789760713.520235:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19599360 -> 19603456
00010000:00010000:0.0:1789760713.520250:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.520263:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.520271:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.520279:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760713.520284:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.520298:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.520341:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.520350:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b5b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19599360->19603455] (req 19599360->19603455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760713.520429:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520867200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 79845us (80561us total) trans 4294972105 rc 0/0
00000100:00100000:0.0:1789760713.520440:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4818
00000100:00100000:0.0:1789760713.520449:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685049020682 time 685127253106 state 0x2 ref 0
00000100:00100000:1.0:1789760713.529248:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760713.529347:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520867328
00000100:00100000:0.0:1789760713.529357:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520867328
00000100:00100000:0.0:1789760713.529408:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685049020682 time 685127253106 state 0x0 ref 1
00000100:00100000:0.0:1789760713.529423:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685127513522 time 685127253106 state 0x1 ref 1
00000100:00100000:0.0:1789760713.529450:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685127513522 time 685216133432 state 0x0 ref 1
00000100:00100000:0.0:1789760713.529462:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520867328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760713.529515:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19603456, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:0.0:1789760713.529523:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.529539:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:0.0:1789760713.529544:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760713.529549:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.529562:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760713.612133:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19603456 -> 19607552
00010000:00010000:2.0:1789760713.612154:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.612167:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.612180:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.612187:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760713.612192:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.612200:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.612218:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.612225:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b5bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19603456->19607551] (req 19603456->19607551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760713.612351:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520867328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 82849us (83070us total) trans 4294972106 rc 0/0
00000100:00100000:2.0:1789760713.612361:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4819
00000100:00100000:2.0:1789760713.612371:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685127513522 time 685216133432 state 0x2 ref 0
00000001:00080000:2.0:1789760713.612407:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972106 is committed
00000100:00100000:2.0:1789760713.617677:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760713.618001:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520867456
00000100:00100000:0.0:1789760713.618010:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520867456
00000100:00100000:0.0:1789760713.618064:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685127513522 time 685216133432 state 0x0 ref 1
00000100:00100000:0.0:1789760713.618079:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685216393848 time 685216133432 state 0x1 ref 1
00000100:00100000:0.0:1789760713.618112:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685216393848 time 685304794503 state 0x0 ref 1
00000100:00100000:0.0:1789760713.618125:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520867456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760713.618174:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19607552, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:0.0:1789760713.618183:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.618200:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:0.0:1789760713.618204:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760713.618211:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.618230:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760713.666001:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972107 is committed
00002000:00010000:2.0:1789760713.666153:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19607552 -> 19611648
00010000:00010000:2.0:1789760713.666170:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.666183:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.666192:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.666200:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760713.666205:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.666235:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.666255:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.666262:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b5c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19607552->19611647] (req 19607552->19611647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760713.666382:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520867456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48255us (48712us total) trans 4294972107 rc 0/0
00000100:00100000:2.0:1789760713.666393:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4820
00000100:00100000:2.0:1789760713.666403:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685216393848 time 685304794503 state 0x2 ref 0
00000100:00100000:1.0:1789760713.672267:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760713.672368:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520867584
00000100:00100000:3.0:1789760713.672378:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520867584
00000100:00100000:3.0:1789760713.672433:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685216393848 time 685304794503 state 0x0 ref 1
00000100:00100000:3.0:1789760713.672449:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685305054919 time 685304794503 state 0x1 ref 1
00000100:00100000:3.0:1789760713.672488:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685305054919 time 685359163415 state 0x0 ref 1
00000100:00100000:3.0:1789760713.672501:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520867584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760713.672549:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19611648, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:3.0:1789760713.672558:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.672575:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:3.0:1789760713.672580:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760713.672587:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.672600:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760713.742142:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19611648 -> 19615744
00010000:00010000:3.0:1789760713.742162:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.742176:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.742186:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.742193:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760713.742198:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.742207:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.742228:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.742236:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b5cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19611648->19615743] (req 19611648->19615743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760713.742366:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520867584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 69862us (70103us total) trans 4294972108 rc 0/0
00000100:00100000:3.0:1789760713.742377:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4821
00000100:00100000:3.0:1789760713.742386:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685305054919 time 685359163415 state 0x2 ref 0
00000001:00080000:2.0:1789760713.742987:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972108 is committed
00000100:00100000:1.0:1789760713.746039:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760713.746116:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520867712
00000100:00100000:3.0:1789760713.746125:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520867712
00000100:00100000:3.0:1789760713.746178:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685305054919 time 685359163415 state 0x0 ref 1
00000100:00100000:3.0:1789760713.746192:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685359423831 time 685359163415 state 0x1 ref 1
00000100:00100000:3.0:1789760713.746221:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685359423831 time 685432904953 state 0x0 ref 1
00000100:00100000:3.0:1789760713.746232:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520867712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760713.746281:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19615744, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:3.0:1789760713.746289:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.746305:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:3.0:1789760713.746311:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760713.746353:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.746369:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760713.799223:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19615744 -> 19619840
00010000:00010000:3.0:1789760713.799243:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.799255:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.799264:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.799271:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760713.799276:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.799283:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.799302:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.799310:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19615744->19619839] (req 19615744->19619839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760713.799443:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520867712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53207us (53408us total) trans 4294972109 rc 0/0
00000100:00100000:3.0:1789760713.799453:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4822
00000100:00100000:3.0:1789760713.799462:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685359423831 time 685432904953 state 0x2 ref 0
00000100:00100000:0.0:1789760713.805687:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760713.805786:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520867840
00000100:00100000:1.0:1789760713.805796:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520867840
00000100:00100000:1.0:1789760713.805852:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685359423831 time 685432904953 state 0x0 ref 1
00000100:00100000:1.0:1789760713.805868:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685433165369 time 685432904953 state 0x1 ref 1
00000100:00100000:1.0:1789760713.805897:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685433165369 time 685492579850 state 0x0 ref 1
00000100:00100000:1.0:1789760713.805910:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520867840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760713.805971:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19619840, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:1.0:1789760713.805980:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760713.805996:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:1.0:1789760713.806000:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760713.806006:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760713.806019:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760713.812500:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972109 is committed
00002000:00010000:3.0:1789760713.889846:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19619840 -> 19623936
00010000:00010000:3.0:1789760713.889863:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.889876:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.889895:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.889904:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760713.889909:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.889918:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.889936:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760713.889959:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b5db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19619840->19623935] (req 19619840->19623935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760713.890043:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520867840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 84130us (84362us total) trans 4294972110 rc 0/0
00000100:00100000:3.0:1789760713.890053:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4823
00000100:00100000:3.0:1789760713.890063:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685433165369 time 685492579850 state 0x2 ref 0
00000001:00080000:2.0:1789760713.890983:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972110 is committed
00000100:00100000:1.0:1789760713.902404:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760713.902594:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520867968
00000100:00100000:2.0:1789760713.902604:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520867968
00000100:00100000:2.0:1789760713.902651:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685433165369 time 685492579850 state 0x0 ref 1
00000100:00100000:2.0:1789760713.902665:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685492840266 time 685492579850 state 0x1 ref 1
00000100:00100000:2.0:1789760713.902699:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685492840266 time 685589381479 state 0x0 ref 1
00000100:00100000:2.0:1789760713.902711:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520867968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760713.902752:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19623936, mtime: 0x6aad94ca, atime: 0x0, ctime: 0x6aad94ca, blocks: 0x9807
00010000:00010000:2.0:1789760713.902762:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.902777:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:2.0:1789760713.902782:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760713.902788:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.902801:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760713.956519:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972111 is committed
00002000:00010000:0.0:1789760713.956822:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19623936 -> 19628032
00002000:00010000:0.0:1789760713.956827:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760714 -> 1789760715
00002000:00010000:0.0:1789760713.956829:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760714 -> 1789760715
00010000:00010000:0.0:1789760713.956842:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.956855:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.956865:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.956873:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760713.956879:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.956969:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.956988:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760713.956996:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b5e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19623936->19628031] (req 19623936->19628031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760713.957132:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520867968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54417us (54730us total) trans 4294972111 rc 0/0
00000100:00100000:0.0:1789760713.957143:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4824
00000100:00100000:0.0:1789760713.957151:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685492840266 time 685589381479 state 0x2 ref 0
00000100:00100000:1.0:1789760713.960953:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760713.961051:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520868096
00000100:00100000:3.0:1789760713.961062:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520868096
00000100:00100000:3.0:1789760713.961118:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685492840266 time 685589381479 state 0x0 ref 1
00000100:00100000:3.0:1789760713.961132:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685589641895 time 685589381479 state 0x1 ref 1
00000100:00100000:3.0:1789760713.961366:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685589641895 time 685648047202 state 0x0 ref 1
00000100:00100000:2.0:1789760713.961487:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520868096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760713.961544:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19628032, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:2.0:1789760713.961554:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.961571:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:2.0:1789760713.961576:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760713.961583:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760713.961597:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760714.025063:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972112 is committed
00002000:00010000:2.0:1789760714.025404:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19628032 -> 19632128
00010000:00010000:2.0:1789760714.025420:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760714.025434:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760714.025443:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760714.025451:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760714.025456:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760714.025465:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760714.025595:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760714.025605:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b5e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19628032->19632127] (req 19628032->19632127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760714.025800:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520868096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64417us (64912us total) trans 4294972112 rc 0/0
00000100:00100000:2.0:1789760714.025812:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4825
00000100:00100000:2.0:1789760714.025820:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685589641895 time 685648047202 state 0x2 ref 0
00000100:00100000:2.0:1789760714.030019:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760714.030279:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520868224
00000100:00100000:3.0:1789760714.030290:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520868224
00000100:00100000:0.0:1789760714.030930:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685589641895 time 685648047202 state 0x0 ref 1
00000100:00100000:0.0:1789760714.030954:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685648307618 time 685648047202 state 0x1 ref 1
00000100:00100000:0.0:1789760714.030983:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685648307618 time 685717665920 state 0x0 ref 1
00000100:00100000:0.0:1789760714.030995:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520868224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760714.031040:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19632128, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:0.0:1789760714.031057:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.031080:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:0.0:1789760714.031085:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760714.031091:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.031104:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760714.031455:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760714.127409:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972113 is committed
00002000:00010000:3.0:1789760714.127546:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19632128 -> 19636224
00010000:00010000:3.0:1789760714.127564:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.127579:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.127593:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.127609:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760714.127614:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.127623:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.127642:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.127650:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b5f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19632128->19636223] (req 19632128->19636223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760714.127737:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520868224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 96740us (97723us total) trans 4294972113 rc 0/0
00000100:00100000:3.0:1789760714.127747:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4826
00000100:00100000:3.0:1789760714.127755:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685648307618 time 685717665920 state 0x2 ref 0
00000100:00100000:1.0:1789760714.135783:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760714.135872:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520868352
00000100:00100000:3.0:1789760714.135883:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520868352
00000100:00100000:3.0:1789760714.135956:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685648307618 time 685717665920 state 0x0 ref 1
00000100:00100000:3.0:1789760714.135972:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685717926336 time 685717665920 state 0x1 ref 1
00000100:00100000:3.0:1789760714.136002:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685717926336 time 685822685277 state 0x0 ref 1
00000100:00100000:3.0:1789760714.136015:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520868352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760714.136207:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19636224, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:3.0:1789760714.136216:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.136232:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:3.0:1789760714.136237:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760714.136243:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.136257:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760714.204042:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972114 is committed
00002000:00010000:1.0:1789760714.204821:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19636224 -> 19640320
00010000:00010000:1.0:1789760714.204837:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.204849:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.204856:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.204863:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760714.204867:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.204876:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.204894:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.204901:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b5f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19636224->19640319] (req 19636224->19640319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760714.205008:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520868352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68990us (69230us total) trans 4294972114 rc 0/0
00000100:00100000:1.0:1789760714.205021:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4827
00000100:00100000:1.0:1789760714.205031:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685717926336 time 685822685277 state 0x2 ref 0
00000100:00100000:1.0:1789760714.215442:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760714.215596:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520868480
00000100:00100000:2.0:1789760714.215606:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520868480
00000100:00100000:2.0:1789760714.215670:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685717926336 time 685822685277 state 0x0 ref 1
00000100:00100000:2.0:1789760714.215685:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685822945693 time 685822685277 state 0x1 ref 1
00000100:00100000:2.0:1789760714.215717:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685822945693 time 685902399666 state 0x0 ref 1
00000100:00100000:2.0:1789760714.215729:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520868480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760714.215773:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19640320, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:2.0:1789760714.215783:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760714.215798:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:2.0:1789760714.215803:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760714.215808:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760714.215821:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760714.273067:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972115 is committed
00002000:00010000:3.0:1789760714.274124:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19640320 -> 19644416
00010000:00010000:3.0:1789760714.274153:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.274166:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.274176:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.274189:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760714.274193:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.274203:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.274221:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.274230:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b5fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19640320->19644415] (req 19640320->19644415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760714.274369:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520868480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58637us (58931us total) trans 4294972115 rc 0/0
00000100:00100000:3.0:1789760714.274380:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4828
00000100:00100000:3.0:1789760714.274390:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685822945693 time 685902399666 state 0x2 ref 0
00000100:00100000:2.0:1789760714.281585:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760714.281728:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520868608
00000100:00100000:0.0:1789760714.281739:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520868608
00000100:00100000:0.0:1789760714.281791:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685822945693 time 685902399666 state 0x0 ref 1
00000100:00100000:0.0:1789760714.281806:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685902660082 time 685902399666 state 0x1 ref 1
00000100:00100000:0.0:1789760714.281838:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685902660082 time 685968520533 state 0x0 ref 1
00000100:00100000:0.0:1789760714.281851:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520868608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760714.281896:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19644416, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:0.0:1789760714.281905:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.281919:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=685s v=(0 0)
00010000:00010000:0.0:1789760714.281924:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760714.281930:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.281954:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.297411:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760714.320104:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972116 is committed
00002000:00010000:1.0:1789760714.320242:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19644416 -> 19648512
00010000:00010000:1.0:1789760714.320258:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.320271:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.320281:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.320289:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760714.320295:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.320303:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.320345:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.320354:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b605 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19644416->19648511] (req 19644416->19648511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760714.321053:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520868608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39197us (39471us total) trans 4294972116 rc 0/0
00000100:00100000:0.0:1789760714.321064:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4829
00000100:00100000:0.0:1789760714.321074:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685902660082 time 685968520533 state 0x2 ref 0
00000100:00100000:1.0:1789760714.337028:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760714.337119:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520868736
00000100:00100000:3.0:1789760714.337129:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520868736
00000100:00100000:3.0:1789760714.337189:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685902660082 time 685968520533 state 0x0 ref 1
00000100:00100000:3.0:1789760714.337203:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685968780949 time 685968520533 state 0x1 ref 1
00000100:00100000:3.0:1789760714.337238:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685968780949 time 686023920776 state 0x0 ref 1
00000100:00100000:3.0:1789760714.337251:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520868736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760714.337298:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19648512, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:3.0:1789760714.337308:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.337367:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:3.0:1789760714.337371:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760714.337378:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.337393:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760714.377706:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548740608:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1789760714.377774:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760714.378053:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548740608
00000100:00100000:3.0:1789760714.378061:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548740608
00000100:00100000:3.0:1789760714.378107:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405
00000100:00100000:3.0:1789760714.378117:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548740608:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1789760714.378153:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:3.0:1789760714.378206:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548740608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (431us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760714.378214:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405
00000100:00100000:3.0:1789760714.378258:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548740608:0@lo:41:osp-pre-0-1.0
00000001:00080000:1.0:1789760714.381508:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972117 is committed
00002000:00010000:3.0:1789760714.381771:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19648512 -> 19652608
00010000:00010000:3.0:1789760714.381786:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.381800:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.381810:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.381818:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760714.381823:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.381833:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.381851:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.381859:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b60c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19648512->19652607] (req 19648512->19652607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760714.381950:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520868736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44688us (44918us total) trans 4294972117 rc 0/0
00000100:00100000:3.0:1789760714.381960:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4830
00000100:00100000:3.0:1789760714.381970:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685968780949 time 686023920776 state 0x2 ref 0
00000100:00100000:1.0:1789760714.386837:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760714.386911:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520868864
00000100:00100000:0.0:1789760714.386919:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520868864
00000100:00100000:0.0:1789760714.386976:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 685968780949 time 686023920776 state 0x0 ref 1
00000100:00100000:0.0:1789760714.386992:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686024181192 time 686023920776 state 0x1 ref 1
00000100:00100000:0.0:1789760714.387026:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686024181192 time 686073708673 state 0x0 ref 1
00000100:00100000:0.0:1789760714.387038:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520868864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760714.387086:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19652608, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:0.0:1789760714.387094:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.387108:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:0.0:1789760714.387112:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760714.387118:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.387131:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760714.453116:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19652608 -> 19656704
00010000:00010000:1.0:1789760714.453136:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.453149:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.453158:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.453166:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760714.453171:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.453187:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.453208:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.453216:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19652608->19656703] (req 19652608->19656703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760714.453349:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520868864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66277us (66485us total) trans 4294972118 rc 0/0
00000100:00100000:1.0:1789760714.453360:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4831
00000100:00100000:1.0:1789760714.453369:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686024181192 time 686073708673 state 0x2 ref 0
00000001:00080000:1.0:1789760714.453404:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972118 is committed
00000100:00100000:2.0:1789760714.460833:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760714.460916:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520868992
00000100:00100000:3.0:1789760714.460925:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520868992
00000100:00100000:3.0:1789760714.460982:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686024181192 time 686073708673 state 0x0 ref 1
00000100:00100000:3.0:1789760714.460997:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686073969089 time 686073708673 state 0x1 ref 1
00000100:00100000:3.0:1789760714.461025:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686073969089 time 686147708011 state 0x0 ref 1
00000100:00100000:3.0:1789760714.461036:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520868992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760714.461077:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19656704, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:3.0:1789760714.461086:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.461100:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:3.0:1789760714.461104:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760714.461111:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.461124:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760714.500908:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972119 is committed
00002000:00010000:1.0:1789760714.501018:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19656704 -> 19660800
00010000:00010000:1.0:1789760714.501032:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.501045:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.501053:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.501060:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760714.501064:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.501071:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.501089:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.501100:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b61a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19656704->19660799] (req 19656704->19660799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760714.501190:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520868992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40150us (40361us total) trans 4294972119 rc 0/0
00000100:00100000:1.0:1789760714.501200:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4832
00000100:00100000:1.0:1789760714.501209:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686073969089 time 686147708011 state 0x2 ref 0
00000100:00100000:2.0:1789760714.506112:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760714.506195:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520869120
00000100:00100000:0.0:1789760714.506204:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520869120
00000100:00100000:0.0:1789760714.506255:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686073969089 time 686147708011 state 0x0 ref 1
00000100:00100000:0.0:1789760714.506270:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686147968427 time 686147708011 state 0x1 ref 1
00000100:00100000:0.0:1789760714.506298:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686147968427 time 686192981037 state 0x0 ref 1
00000100:00100000:0.0:1789760714.506309:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520869120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760714.506382:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19660800, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:0.0:1789760714.506391:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.506405:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:0.0:1789760714.506410:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760714.506415:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.506431:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760714.558283:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19660800 -> 19664896
00010000:00010000:0.0:1789760714.558302:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.558349:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.558358:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.558366:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760714.558371:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.558379:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.558399:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.558406:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b621 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19660800->19664895] (req 19660800->19664895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760714.558542:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520869120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52230us (52432us total) trans 4294972120 rc 0/0
00000100:00100000:0.0:1789760714.558552:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4833
00000100:00100000:0.0:1789760714.558561:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686147968427 time 686192981037 state 0x2 ref 0
00000001:00080000:2.0:1789760714.558756:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972120 is committed
00000100:00100000:2.0:1789760714.563804:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760714.563881:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520869248
00000100:00100000:0.0:1789760714.563891:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520869248
00000100:00100000:0.0:1789760714.563952:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686147968427 time 686192981037 state 0x0 ref 1
00000100:00100000:0.0:1789760714.563967:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686193241453 time 686192981037 state 0x1 ref 1
00000100:00100000:0.0:1789760714.563998:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686193241453 time 686250680277 state 0x0 ref 1
00000100:00100000:0.0:1789760714.564014:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520869248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760714.564059:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19664896, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:0.0:1789760714.564068:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.564082:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:0.0:1789760714.564086:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760714.564092:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.564105:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760714.620153:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19664896 -> 19668992
00010000:00010000:1.0:1789760714.620173:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.620187:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.620196:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.620205:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760714.620210:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.620219:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.620244:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.620252:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60b628 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19664896->19668991] (req 19664896->19668991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760714.620375:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520869248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56359us (56576us total) trans 4294972121 rc 0/0
00000100:00100000:1.0:1789760714.620387:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4834
00000100:00100000:1.0:1789760714.620395:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686193241453 time 686250680277 state 0x2 ref 0
00000001:00080000:2.0:1789760714.620620:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972121 is committed
00000100:00100000:3.0:1789760714.628561:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760714.628709:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520869376
00000100:00100000:1.0:1789760714.628719:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520869376
00000100:00100000:1.0:1789760714.628768:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686193241453 time 686250680277 state 0x0 ref 1
00000100:00100000:1.0:1789760714.628784:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686250940693 time 686250680277 state 0x1 ref 1
00000100:00100000:1.0:1789760714.628817:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686250940693 time 686315499294 state 0x0 ref 1
00000100:00100000:1.0:1789760714.628830:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520869376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760714.628878:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19668992, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:1.0:1789760714.628888:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.628903:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:1.0:1789760714.628908:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760714.628914:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.628927:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760714.678981:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19668992 -> 19673088
00010000:00010000:1.0:1789760714.679002:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.679015:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.679024:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.679031:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760714.679036:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.679046:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.679065:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.679073:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b62f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19668992->19673087] (req 19668992->19673087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760714.679154:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520869376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50322us (50596us total) trans 4294972122 rc 0/0
00000100:00100000:1.0:1789760714.679164:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4835
00000100:00100000:1.0:1789760714.679174:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686250940693 time 686315499294 state 0x2 ref 0
00000001:00080000:2.0:1789760714.679456:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972122 is committed
00000100:00100000:2.0:1789760714.684555:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760714.685780:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520869504
00000100:00100000:1.0:1789760714.685794:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520869504
00000100:00100000:1.0:1789760714.685851:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686250940693 time 686315499294 state 0x0 ref 1
00000100:00100000:1.0:1789760714.685866:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686315759710 time 686315499294 state 0x1 ref 1
00000100:00100000:1.0:1789760714.685888:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686315759710 time 686372571097 state 0x0 ref 1
00000100:00100000:1.0:1789760714.685900:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520869504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760714.685954:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19673088, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:1.0:1789760714.685963:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.685979:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:1.0:1789760714.685984:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760714.685990:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.686004:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760714.744634:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19673088 -> 19677184
00010000:00010000:3.0:1789760714.744654:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.744670:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.744678:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.744685:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760714.744689:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.744698:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.744716:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.744724:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b636 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19673088->19677183] (req 19673088->19677183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760714.744819:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520869504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58918us (60272us total) trans 4294972123 rc 0/0
00000100:00100000:3.0:1789760714.744829:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4836
00000100:00100000:3.0:1789760714.744838:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686315759710 time 686372571097 state 0x2 ref 0
00000001:00080000:2.0:1789760714.748036:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972123 is committed
00000100:00100000:2.0:1789760714.748426:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760714.748580:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520869632
00000100:00100000:0.0:1789760714.748591:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520869632
00000100:00100000:0.0:1789760714.748653:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686315759710 time 686372571097 state 0x0 ref 1
00000100:00100000:0.0:1789760714.748668:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686372831513 time 686372571097 state 0x1 ref 1
00000100:00100000:0.0:1789760714.748751:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686372831513 time 686435432551 state 0x0 ref 1
00000100:00100000:0.0:1789760714.748763:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520869632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760714.748810:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19677184, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:0.0:1789760714.748818:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.748839:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:0.0:1789760714.748843:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760714.748850:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760714.748863:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760714.796980:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19677184 -> 19681280
00010000:00010000:3.0:1789760714.797000:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.797013:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.797022:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.797029:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760714.797034:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.797043:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.797063:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.797072:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b63d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19677184->19681279] (req 19677184->19681279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760714.797167:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520869632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48401us (48741us total) trans 4294972124 rc 0/0
00000100:00100000:3.0:1789760714.797178:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4837
00000100:00100000:3.0:1789760714.797187:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686372831513 time 686435432551 state 0x2 ref 0
00000001:00080000:2.0:1789760714.797275:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972124 is committed
00000100:00100000:3.0:1789760714.800531:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760714.805141:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520869760
00000100:00100000:1.0:1789760714.805155:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520869760
00000100:00100000:1.0:1789760714.805215:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686372831513 time 686435432551 state 0x0 ref 1
00000100:00100000:1.0:1789760714.805230:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686435692967 time 686435432551 state 0x1 ref 1
00000100:00100000:1.0:1789760714.805261:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686435692967 time 686491943044 state 0x0 ref 1
00000100:00100000:1.0:1789760714.805274:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520869760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760714.805341:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19681280, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:1.0:1789760714.805350:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.805365:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:1.0:1789760714.805369:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760714.805375:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.805388:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760714.867932:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972125 is committed
00002000:00010000:1.0:1789760714.868121:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19681280 -> 19685376
00010000:00010000:1.0:1789760714.868137:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.868155:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.868164:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.868171:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760714.868175:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.868183:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.868202:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.868209:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19681280->19685375] (req 19681280->19685375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760714.868306:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520869760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63029us (67780us total) trans 4294972125 rc 0/0
00000100:00100000:1.0:1789760714.868369:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4838
00000100:00100000:1.0:1789760714.868377:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686435692967 time 686491943044 state 0x2 ref 0
00000100:00100000:0.0:1789760714.876603:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760714.876707:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520869888
00000100:00100000:1.0:1789760714.876716:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520869888
00000100:00100000:1.0:1789760714.876769:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686435692967 time 686491943044 state 0x0 ref 1
00000100:00100000:1.0:1789760714.876784:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686492203460 time 686491943044 state 0x1 ref 1
00000100:00100000:1.0:1789760714.876815:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686492203460 time 686563497252 state 0x0 ref 1
00000100:00100000:1.0:1789760714.876827:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520869888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760714.876876:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19685376, mtime: 0x6aad94cb, atime: 0x0, ctime: 0x6aad94cb, blocks: 0x9807
00010000:00010000:1.0:1789760714.876885:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.876900:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:1.0:1789760714.876905:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760714.876911:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.876924:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760714.922273:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972126 is committed
00002000:00010000:3.0:1789760714.922394:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19685376 -> 19689472
00002000:00010000:3.0:1789760714.922400:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760715 -> 1789760716
00002000:00010000:3.0:1789760714.922402:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760715 -> 1789760716
00010000:00010000:3.0:1789760714.922415:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.922426:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.922434:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.922441:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760714.922445:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.922454:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.922478:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.922486:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b64b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19685376->19689471] (req 19685376->19689471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760714.922588:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520869888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45759us (45991us total) trans 4294972126 rc 0/0
00000100:00100000:3.0:1789760714.922599:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4839
00000100:00100000:3.0:1789760714.922608:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686492203460 time 686563497252 state 0x2 ref 0
00000100:00100000:3.0:1789760714.931700:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760714.931818:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520870016
00000100:00100000:1.0:1789760714.931827:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520870016
00000100:00100000:1.0:1789760714.931880:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686492203460 time 686563497252 state 0x0 ref 1
00000100:00100000:1.0:1789760714.931895:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686563757668 time 686563497252 state 0x1 ref 1
00000100:00100000:1.0:1789760714.931929:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686563757668 time 686618611087 state 0x0 ref 1
00000100:00100000:1.0:1789760714.931963:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520870016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760714.932010:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19689472, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:1.0:1789760714.932019:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.932035:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:1.0:1789760714.932039:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760714.932045:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760714.932059:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760714.992090:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972127 is committed
00002000:00010000:3.0:1789760714.992199:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19689472 -> 19693568
00010000:00010000:3.0:1789760714.992214:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.992226:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.992234:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.992241:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760714.992246:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.992254:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.992273:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.992285:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19689472->19693567] (req 19689472->19693567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760714.992433:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520870016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60470us (60740us total) trans 4294972127 rc 0/0
00000100:00100000:3.0:1789760714.992443:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4840
00000100:00100000:3.0:1789760714.992452:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686563757668 time 686618611087 state 0x2 ref 0
00000100:00100000:1.0:1789760714.996829:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760714.997781:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520870144
00000100:00100000:3.0:1789760714.997794:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520870144
00000100:00100000:3.0:1789760714.997856:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686563757668 time 686618611087 state 0x0 ref 1
00000100:00100000:3.0:1789760714.997871:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686618871503 time 686618611087 state 0x1 ref 1
00000100:00100000:3.0:1789760714.997893:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686618871503 time 686684576281 state 0x0 ref 1
00000100:00100000:3.0:1789760714.997904:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520870144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760714.997959:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19693568, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:3.0:1789760714.997968:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.997983:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:3.0:1789760714.997988:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760714.997994:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760714.998012:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760715.051560:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972128 is committed
00002000:00010000:3.0:1789760715.052058:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19693568 -> 19697664
00010000:00010000:3.0:1789760715.052073:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.052085:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.052094:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.052101:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760715.052106:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.052115:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.052134:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.052141:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19693568->19697663] (req 19693568->19697663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.052282:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520870144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54374us (55459us total) trans 4294972128 rc 0/0
00000100:00100000:3.0:1789760715.052292:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4841
00000100:00100000:3.0:1789760715.052300:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686618871503 time 686684576281 state 0x2 ref 0
00000100:00100000:2.0:1789760715.056221:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760715.059874:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520870272
00000100:00100000:0.0:1789760715.059889:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520870272
00000100:00100000:1.0:1789760715.061067:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686618871503 time 686684576281 state 0x0 ref 1
00000100:00100000:1.0:1789760715.061083:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686684836697 time 686684576281 state 0x1 ref 1
00000100:00100000:1.0:1789760715.061155:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686684836697 time 686747836948 state 0x0 ref 1
00000100:00100000:1.0:1789760715.061170:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520870272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760715.061223:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19697664, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:1.0:1789760715.061233:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.061249:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:1.0:1789760715.061254:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760715.061260:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.061274:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760715.110412:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972129 is committed
00002000:00010000:3.0:1789760715.110711:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19697664 -> 19701760
00010000:00010000:3.0:1789760715.110727:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.110740:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.110749:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.110757:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760715.110762:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.110771:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.110789:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.110801:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b660 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19697664->19701759] (req 19697664->19701759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.110930:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520870272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49760us (54714us total) trans 4294972129 rc 0/0
00000100:00100000:3.0:1789760715.110952:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4842
00000100:00100000:3.0:1789760715.110963:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686684836697 time 686747836948 state 0x2 ref 0
00000100:00100000:2.0:1789760715.120585:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.120835:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520870400
00000100:00100000:1.0:1789760715.120845:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520870400
00000100:00100000:1.0:1789760715.120904:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686684836697 time 686747836948 state 0x0 ref 1
00000100:00100000:1.0:1789760715.120920:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686748097364 time 686747836948 state 0x1 ref 1
00000100:00100000:1.0:1789760715.120995:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686748097364 time 686807676796 state 0x0 ref 1
00000100:00100000:1.0:1789760715.121008:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520870400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760715.121056:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19701760, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:1.0:1789760715.121065:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.121080:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:1.0:1789760715.121085:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760715.121091:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.121109:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760715.174441:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972130 is committed
00002000:00010000:1.0:1789760715.174874:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19701760 -> 19705856
00010000:00010000:1.0:1789760715.174890:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.174903:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.174911:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.174918:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760715.174923:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.174931:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.174958:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.174966:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19701760->19705855] (req 19701760->19705855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760715.175060:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520870400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54051us (54493us total) trans 4294972130 rc 0/0
00000100:00100000:1.0:1789760715.175071:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4843
00000100:00100000:1.0:1789760715.175079:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686748097364 time 686807676796 state 0x2 ref 0
00000100:00100000:1.0:1789760715.180804:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760715.180888:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520870528
00000100:00100000:3.0:1789760715.180897:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520870528
00000100:00100000:3.0:1789760715.180957:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686748097364 time 686807676796 state 0x0 ref 1
00000100:00100000:3.0:1789760715.180971:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686807937212 time 686807676796 state 0x1 ref 1
00000100:00100000:3.0:1789760715.181030:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686807937212 time 686867712939 state 0x0 ref 1
00000100:00100000:3.0:1789760715.181043:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520870528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760715.181087:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19705856, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:3.0:1789760715.181095:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.181110:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:3.0:1789760715.181114:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760715.181121:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.181140:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760715.234304:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972131 is committed
00002000:00010000:1.0:1789760715.234511:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19705856 -> 19709952
00010000:00010000:1.0:1789760715.234527:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.234541:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.234550:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.234558:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760715.234564:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.234573:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.234593:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.234605:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b66e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19705856->19709951] (req 19705856->19709951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760715.234792:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520870528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53745us (53990us total) trans 4294972131 rc 0/0
00000100:00100000:1.0:1789760715.234802:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4844
00000100:00100000:1.0:1789760715.234813:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686807937212 time 686867712939 state 0x2 ref 0
00000100:00100000:2.0:1789760715.242693:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760715.242794:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520870656
00000100:00100000:3.0:1789760715.242803:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520870656
00000100:00100000:3.0:1789760715.242861:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686807937212 time 686867712939 state 0x0 ref 1
00000100:00100000:3.0:1789760715.242876:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686867973355 time 686867712939 state 0x1 ref 1
00000100:00100000:3.0:1789760715.242944:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686867973355 time 686929617318 state 0x0 ref 1
00000100:00100000:3.0:1789760715.242957:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520870656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760715.243003:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19709952, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:3.0:1789760715.243012:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.243028:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:3.0:1789760715.243033:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760715.243040:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.243053:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760715.298295:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972132 is committed
00002000:00010000:3.0:1789760715.298723:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19709952 -> 19714048
00010000:00010000:3.0:1789760715.298739:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.298751:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.298758:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.298765:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760715.298770:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.298778:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.298799:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.298806:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19709952->19714047] (req 19709952->19714047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.299063:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520870656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56103us (56372us total) trans 4294972132 rc 0/0
00000100:00100000:3.0:1789760715.299074:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4845
00000100:00100000:3.0:1789760715.299083:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686867973355 time 686929617318 state 0x2 ref 0
00000100:00100000:2.0:1789760715.309823:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.309949:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520870784
00000100:00100000:1.0:1789760715.309958:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520870784
00000100:00100000:1.0:1789760715.310009:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686867973355 time 686929617318 state 0x0 ref 1
00000100:00100000:1.0:1789760715.310025:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686929877734 time 686929617318 state 0x1 ref 1
00000100:00100000:1.0:1789760715.310090:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686929877734 time 686996771597 state 0x0 ref 1
00000100:00100000:1.0:1789760715.310103:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520870784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760715.310151:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19714048, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:1.0:1789760715.310162:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.310180:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=686s v=(0 0)
00010000:00010000:1.0:1789760715.310185:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760715.310192:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.310214:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.324257:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1789760715.369393:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19714048 -> 19718144
00010000:00010000:3.0:1789760715.369418:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.369433:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.369442:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.369450:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760715.369455:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.369464:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.369484:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.369491:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b67c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19714048->19718143] (req 19714048->19718143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.369600:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520870784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59494us (59783us total) trans 4294972133 rc 0/0
00000100:00100000:3.0:1789760715.369612:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4846
00000100:00100000:3.0:1789760715.369623:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686929877734 time 686996771597 state 0x2 ref 0
00000001:00080000:0.0:1789760715.369984:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972133 is committed
00000100:00100000:1.0:1789760715.374154:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760715.374261:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520870912
00000100:00100000:2.0:1789760715.374270:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520870912
00000100:00100000:2.0:1789760715.374363:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686929877734 time 686996771597 state 0x0 ref 1
00000100:00100000:2.0:1789760715.374379:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686997032013 time 686996771597 state 0x1 ref 1
00000100:00100000:2.0:1789760715.374406:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686997032013 time 687061088348 state 0x0 ref 1
00000100:00100000:2.0:1789760715.374419:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520870912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760715.374464:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19718144, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:2.0:1789760715.374485:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.374501:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:2.0:1789760715.374506:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760715.374513:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.374528:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.385855:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548740736:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1789760715.385922:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760715.386002:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548740736
00000100:00100000:3.0:1789760715.386009:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548740736
00000100:00100000:3.0:1789760715.386052:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406
00000100:00100000:3.0:1789760715.386061:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548740736:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1789760715.386097:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:3.0:1789760715.386143:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548740736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (219us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760715.386150:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406
00000100:00100000:3.0:1789760715.386204:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548740736:0@lo:41:osp-pre-1-0.0
00002000:00010000:2.0:1789760715.417755:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19718144 -> 19722240
00010000:00010000:2.0:1789760715.417777:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.417788:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.417797:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.417804:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760715.417809:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.417818:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.417835:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.417842:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60b683 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19718144->19722239] (req 19718144->19722239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760715.417930:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520870912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43510us (43781us total) trans 4294972134 rc 0/0
00000100:00100000:2.0:1789760715.418020:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4847
00000100:00100000:2.0:1789760715.418030:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686997032013 time 687061088348 state 0x2 ref 0
00000001:00080000:1.0:1789760715.419950:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972134 is committed
00000100:00100000:2.0:1789760715.426258:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760715.426347:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520871040
00000100:00100000:3.0:1789760715.426357:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520871040
00000100:00100000:3.0:1789760715.426408:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 686997032013 time 687061088348 state 0x0 ref 1
00000100:00100000:3.0:1789760715.426422:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687061348764 time 687061088348 state 0x1 ref 1
00000100:00100000:3.0:1789760715.426502:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687061348764 time 687113183990 state 0x0 ref 1
00000100:00100000:3.0:1789760715.426515:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520871040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760715.426577:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19722240, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:3.0:1789760715.426587:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.426607:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760715.426619:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760715.426626:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.426640:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760715.478365:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19722240 -> 19726336
00010000:00010000:3.0:1789760715.478387:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.478400:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.478409:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.478416:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760715.478421:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.478429:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.478448:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.478456:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b68a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19722240->19726335] (req 19722240->19726335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.482828:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520871040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52048us (52312us total) trans 4294972135 rc 0/0
00000100:00100000:3.0:1789760715.482848:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4848
00000100:00100000:3.0:1789760715.482858:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687061348764 time 687113183990 state 0x2 ref 0
00000100:00100000:3.0:1789760715.482998:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760715.483025:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520871168
00000100:00100000:3.0:1789760715.483032:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520871168
00000100:00100000:3.0:1789760715.483076:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687061348764 time 687113183990 state 0x0 ref 1
00000100:00100000:3.0:1789760715.483089:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687113444406 time 687113183990 state 0x1 ref 1
00000100:00100000:3.0:1789760715.483111:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687113444406 time 687169793873 state 0x0 ref 1
00000100:00100000:3.0:1789760715.483124:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520871168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760715.483169:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19726336, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:3.0:1789760715.483178:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.483195:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760715.483199:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760715.483207:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.483221:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760715.486294:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972135 is committed
00000001:00080000:1.0:1789760715.530096:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972136 is committed
00002000:00010000:0.0:1789760715.530190:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19726336 -> 19730432
00010000:00010000:0.0:1789760715.530208:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.530221:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.530229:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.530236:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760715.530240:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.530250:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.530267:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.530275:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19726336->19730431] (req 19726336->19730431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760715.530540:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520871168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47413us (47537us total) trans 4294972136 rc 0/0
00000100:00100000:0.0:1789760715.530551:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4849
00000100:00100000:0.0:1789760715.530561:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687113444406 time 687169793873 state 0x2 ref 0
00000100:00100000:2.0:1789760715.535832:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.537118:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520871296
00000100:00100000:1.0:1789760715.537130:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520871296
00000100:00100000:1.0:1789760715.537190:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687113444406 time 687169793873 state 0x0 ref 1
00000100:00100000:1.0:1789760715.537206:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687170054289 time 687169793873 state 0x1 ref 1
00000100:00100000:1.0:1789760715.537235:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687170054289 time 687223918601 state 0x0 ref 1
00000100:00100000:1.0:1789760715.537248:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520871296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760715.537295:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19730432, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:1.0:1789760715.537303:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.537412:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:1.0:1789760715.537416:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760715.537424:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.537438:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760715.573558:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19730432 -> 19734528
00010000:00010000:1.0:1789760715.573587:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.573600:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.573616:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.573623:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760715.573628:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.573637:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.573656:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.573664:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b698 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19730432->19734527] (req 19730432->19734527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760715.573758:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520871296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36508us (37932us total) trans 4294972137 rc 0/0
00000100:00100000:1.0:1789760715.573773:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4850
00000100:00100000:1.0:1789760715.573781:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687170054289 time 687223918601 state 0x2 ref 0
00000001:00080000:0.0:1789760715.574117:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972137 is committed
00000100:00100000:2.0:1789760715.579704:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760715.579781:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520871424
00000100:00100000:3.0:1789760715.579791:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520871424
00000100:00100000:3.0:1789760715.579842:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687170054289 time 687223918601 state 0x0 ref 1
00000100:00100000:3.0:1789760715.579857:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687224179017 time 687223918601 state 0x1 ref 1
00000100:00100000:3.0:1789760715.579888:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687224179017 time 687266570304 state 0x0 ref 1
00000100:00100000:3.0:1789760715.579901:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520871424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760715.580079:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19734528, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:3.0:1789760715.580088:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.580102:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760715.580106:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760715.580112:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.580125:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760715.615136:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.615213:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.615244:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.615268:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.615288:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.615331:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520871808
00000100:00100000:1.0:1789760715.615339:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520871808
00000100:00100000:1.0:1789760715.615390:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520872064
00000100:00100000:1.0:1789760715.615394:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520872064
00000100:00100000:1.0:1789760715.615408:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520871680
00000100:00100000:1.0:1789760715.615411:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520871680
00000100:00100000:1.0:1789760715.615421:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520871936
00000100:00100000:1.0:1789760715.615423:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520871936
00000100:00100000:1.0:1789760715.615437:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 823
00000100:00100000:1.0:1789760715.615445:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520871808:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760715.615635:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520871808:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 189us (420us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760715.615643:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 823
00000100:00100000:1.0:1789760715.615661:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 824
00000100:00100000:1.0:1789760715.615668:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520872064:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760715.615694:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520872064:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (450us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760715.615700:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 824
00000100:00100000:1.0:1789760715.615712:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 825
00000100:00100000:1.0:1789760715.615718:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520871680:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760715.615740:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520871680:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (472us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760715.615745:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 825
00000100:00100000:1.0:1789760715.615755:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 826
00000100:00100000:1.0:1789760715.615760:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520871936:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760715.615780:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520871936:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 20us (492us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760715.615786:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 826
00000100:00080000:1.0:1789760715.615809:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:1.0:1789760715.615813:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1789760715.618545:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520871552
00000100:00100000:0.0:1789760715.618561:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520871552
00000100:00100000:0.0:1789760715.618723:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 460
00000100:00100000:0.0:1789760715.618735:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda005b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520871552:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760715.618810:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda005b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520871552:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 77us (3681us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760715.618817:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 460
00002000:00010000:3.0:1789760715.621864:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19734528 -> 19738624
00010000:00010000:3.0:1789760715.621882:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.621894:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.621902:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.621910:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760715.621915:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.621923:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.621950:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.621958:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b69f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19734528->19738623] (req 19734528->19738623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.622039:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520871424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42135us (42340us total) trans 4294972138 rc 0/0
00000100:00100000:3.0:1789760715.622049:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4851
00000100:00100000:3.0:1789760715.622058:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687224179017 time 687266570304 state 0x2 ref 0
00000001:00080000:0.0:1789760715.624791:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972138 is committed
00000100:00100000:1.0:1789760715.625225:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760715.625296:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520872192
00000100:00100000:3.0:1789760715.625306:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520872192
00000100:00100000:3.0:1789760715.625373:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687224179017 time 687266570304 state 0x0 ref 1
00000100:00100000:3.0:1789760715.625387:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687266830720 time 687266570304 state 0x1 ref 1
00000100:00100000:3.0:1789760715.625415:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687266830720 time 687312098431 state 0x0 ref 1
00000100:00100000:3.0:1789760715.625428:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520872192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760715.625481:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19738624, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:3.0:1789760715.625493:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.625508:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760715.625513:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760715.625519:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.625532:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760715.661127:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972139 is committed
00002000:00010000:3.0:1789760715.661228:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19738624 -> 19742720
00010000:00010000:3.0:1789760715.661243:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.661255:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.661265:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.661273:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760715.661278:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.661286:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.661305:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.661347:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19738624->19742719] (req 19738624->19742719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.661436:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520872192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36005us (36210us total) trans 4294972139 rc 0/0
00000100:00100000:3.0:1789760715.661446:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4852
00000100:00100000:3.0:1789760715.661456:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687266830720 time 687312098431 state 0x2 ref 0
00000100:00100000:3.0:1789760715.666793:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760715.666942:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520872320
00000100:00100000:0.0:1789760715.666952:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520872320
00000100:00100000:0.0:1789760715.667006:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687266830720 time 687312098431 state 0x0 ref 1
00000100:00100000:0.0:1789760715.667021:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687312358847 time 687312098431 state 0x1 ref 1
00000100:00100000:0.0:1789760715.667053:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687312358847 time 687353735418 state 0x0 ref 1
00000100:00100000:0.0:1789760715.667064:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520872320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760715.667112:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19742720, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:0.0:1789760715.667122:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.667137:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:0.0:1789760715.667141:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760715.667147:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.667160:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760715.705650:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972140 is committed
00002000:00010000:3.0:1789760715.705763:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19742720 -> 19746816
00010000:00010000:3.0:1789760715.705778:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.705795:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.705804:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.705811:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760715.705815:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.705824:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.705843:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.705850:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b6ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19742720->19746815] (req 19742720->19746815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760715.706048:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520872320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38981us (39259us total) trans 4294972140 rc 0/0
00000100:00100000:3.0:1789760715.706060:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4853
00000100:00100000:3.0:1789760715.706069:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687312358847 time 687353735418 state 0x2 ref 0
00000100:00100000:0.0:1789760715.710263:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.710365:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520872448
00000100:00100000:1.0:1789760715.710375:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520872448
00000100:00100000:1.0:1789760715.710436:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687312358847 time 687353735418 state 0x0 ref 1
00000100:00100000:1.0:1789760715.710452:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687353995834 time 687353735418 state 0x1 ref 1
00000100:00100000:1.0:1789760715.710479:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687353995834 time 687397161193 state 0x0 ref 1
00000100:00100000:1.0:1789760715.710491:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520872448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760715.710542:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19746816, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:1.0:1789760715.710552:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.710575:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:1.0:1789760715.710579:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760715.710586:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.710599:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760715.771581:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19746816 -> 19750912
00010000:00010000:2.0:1789760715.771602:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.771616:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.771632:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.771640:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760715.771646:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.771656:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.771676:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.771684:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60b6b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19746816->19750911] (req 19746816->19750911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760715.771854:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520872448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61359us (61595us total) trans 4294972141 rc 0/0
00000100:00100000:2.0:1789760715.771865:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4854
00000100:00100000:2.0:1789760715.771875:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687353995834 time 687397161193 state 0x2 ref 0
00000001:00080000:0.0:1789760715.773650:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972141 is committed
00000100:00100000:1.0:1789760715.780295:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760715.780925:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520872576
00000100:00100000:3.0:1789760715.780944:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520872576
00000100:00100000:3.0:1789760715.780996:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687353995834 time 687397161193 state 0x0 ref 1
00000100:00100000:3.0:1789760715.781011:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687397421609 time 687397161193 state 0x1 ref 1
00000100:00100000:3.0:1789760715.781035:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687397421609 time 687467717603 state 0x0 ref 1
00000100:00100000:3.0:1789760715.781046:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520872576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760715.781092:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19750912, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:3.0:1789760715.781101:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.781115:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760715.781118:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760715.781122:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760715.781133:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760715.814267:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972142 is committed
00002000:00010000:0.0:1789760715.815346:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19750912 -> 19755008
00010000:00010000:0.0:1789760715.815363:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.815382:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.815391:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.815399:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760715.815411:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.815421:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.815440:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.815447:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b6bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19750912->19755007] (req 19750912->19755007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760715.815699:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520872576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34649us (35407us total) trans 4294972142 rc 0/0
00000100:00100000:0.0:1789760715.815710:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4855
00000100:00100000:0.0:1789760715.815720:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687397421609 time 687467717603 state 0x2 ref 0
00000100:00100000:3.0:1789760715.821874:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760715.822027:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520872704
00000100:00100000:1.0:1789760715.822036:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520872704
00000100:00100000:1.0:1789760715.822087:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687397421609 time 687467717603 state 0x0 ref 1
00000100:00100000:1.0:1789760715.822100:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687467978019 time 687467717603 state 0x1 ref 1
00000100:00100000:1.0:1789760715.822132:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687467978019 time 687508815580 state 0x0 ref 1
00000100:00100000:1.0:1789760715.822143:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520872704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760715.822186:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19755008, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:1.0:1789760715.822195:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.822209:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:1.0:1789760715.822213:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760715.822220:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760715.822233:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760715.843901:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972143 is committed
00002000:00010000:0.0:1789760715.843957:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19755008 -> 19759104
00010000:00010000:0.0:1789760715.843973:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.843985:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.843995:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.844003:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760715.844008:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.844017:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.844040:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.844048:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b6c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19755008->19759103] (req 19755008->19759103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760715.844136:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520872704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 21989us (22268us total) trans 4294972143 rc 0/0
00000100:00100000:0.0:1789760715.844146:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4856
00000100:00100000:0.0:1789760715.844156:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687467978019 time 687508815580 state 0x2 ref 0
00000100:00100000:2.0:1789760715.847088:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760715.847395:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520872832
00000100:00100000:0.0:1789760715.847406:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520872832
00000100:00100000:0.0:1789760715.847457:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687467978019 time 687508815580 state 0x0 ref 1
00000100:00100000:0.0:1789760715.847478:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687509075996 time 687508815580 state 0x1 ref 1
00000100:00100000:0.0:1789760715.847510:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687509075996 time 687534192056 state 0x0 ref 1
00000100:00100000:0.0:1789760715.847522:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520872832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760715.847666:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19759104, mtime: 0x6aad94cc, atime: 0x0, ctime: 0x6aad94cc, blocks: 0x9807
00010000:00010000:0.0:1789760715.847674:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.847687:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:0.0:1789760715.847691:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760715.847698:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.847711:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760715.894886:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972144 is committed
00002000:00010000:0.0:1789760715.895223:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19759104 -> 19763200
00002000:00010000:0.0:1789760715.895227:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760716 -> 1789760717
00002000:00010000:0.0:1789760715.895229:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760716 -> 1789760717
00010000:00010000:0.0:1789760715.895239:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.895253:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.895259:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.895264:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760715.895267:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.895272:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.895286:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.895291:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19759104->19763199] (req 19759104->19763199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760715.895548:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520872832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48022us (48465us total) trans 4294972144 rc 0/0
00000100:00100000:0.0:1789760715.895558:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4857
00000100:00100000:0.0:1789760715.895576:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687509075996 time 687534192056 state 0x2 ref 0
00000100:00100000:0.0:1789760715.897634:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548740864:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1789760715.897703:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760715.898069:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1789760715.898084:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548740992:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760715.898306:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760715.898589:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548740864
00000100:00100000:2.0:1789760715.898598:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548740864
00000100:00100000:2.0:1789760715.898664:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548740992
00000100:00100000:2.0:1789760715.898668:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548740992
00000100:00100000:2.0:1789760715.898687:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338
00000100:00100000:2.0:1789760715.898696:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548740864:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1789760715.898719:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3838836736 avail 3825205248
00000100:00100000:2.0:1789760715.898779:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548740864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1075us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760715.898786:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338
00000100:00100000:2.0:1789760715.898802:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339
00000100:00100000:2.0:1789760715.898814:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548740992:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1789760715.898824:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526319616 pending 0 free 3838836736 avail 3825205248
00000100:00100000:2.0:1789760715.898854:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548740992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (548us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760715.898859:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339
00000100:00100000:0.0:1789760715.898948:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548740864:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1789760715.899057:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760715.899083:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548740992:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1789760715.900160:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760715.900237:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520872960
00000100:00100000:2.0:1789760715.900244:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520872960
00000100:00100000:2.0:1789760715.900287:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687509075996 time 687534192056 state 0x0 ref 1
00000100:00100000:2.0:1789760715.900301:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687534452472 time 687534192056 state 0x1 ref 1
00000100:00100000:2.0:1789760715.904073:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687534452472 time 687590743655 state 0x0 ref 1
00000100:00100000:2.0:1789760715.904105:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520872960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760715.904168:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19763200, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:2.0:1789760715.904178:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.904193:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:2.0:1789760715.904198:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760715.904204:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760715.904217:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760715.924098:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972145 is committed
00002000:00010000:0.0:1789760715.924197:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19763200 -> 19767296
00010000:00010000:0.0:1789760715.924211:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.924221:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.924227:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.924232:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760715.924236:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.924242:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.924256:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.924260:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b6d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19763200->19767295] (req 19763200->19767295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760715.924366:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520872960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 20269us (24205us total) trans 4294972145 rc 0/0
00000100:00100000:0.0:1789760715.924376:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4858
00000100:00100000:0.0:1789760715.924385:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687534452472 time 687590743655 state 0x2 ref 0
00000100:00100000:3.0:1789760715.928125:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760715.928172:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520873088
00000100:00100000:0.0:1789760715.928182:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520873088
00000100:00100000:0.0:1789760715.928233:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687534452472 time 687590743655 state 0x0 ref 1
00000100:00100000:0.0:1789760715.928249:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687591004071 time 687590743655 state 0x1 ref 1
00000100:00100000:0.0:1789760715.928280:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687591004071 time 687614963034 state 0x0 ref 1
00000100:00100000:0.0:1789760715.928293:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760715.928365:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19767296, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:0.0:1789760715.928372:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.928384:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:0.0:1789760715.928387:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760715.928391:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760715.928401:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760716.010089:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972146 is committed
00002000:00010000:0.0:1789760716.010192:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19767296 -> 19771392
00010000:00010000:0.0:1789760716.010211:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.010224:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.010233:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.010240:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760716.010245:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.010254:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.010272:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.010281:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b6d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19767296->19771391] (req 19767296->19771391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760716.010453:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 82157us (82329us total) trans 4294972146 rc 0/0
00000100:00100000:0.0:1789760716.010471:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4859
00000100:00100000:0.0:1789760716.010481:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687591004071 time 687614963034 state 0x2 ref 0
00000100:00100000:2.0:1789760716.018922:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760716.019009:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520873216
00000100:00100000:0.0:1789760716.019020:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520873216
00000100:00100000:0.0:1789760716.019090:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687591004071 time 687614963034 state 0x0 ref 1
00000100:00100000:0.0:1789760716.019105:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687615223450 time 687614963034 state 0x1 ref 1
00000100:00100000:0.0:1789760716.019163:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687615223450 time 687705845705 state 0x0 ref 1
00000100:00100000:0.0:1789760716.019176:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520873216:12345-192.168.203.16@tcp:4:dd.0
00000100:00080000:3.0:1789760716.019180:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:0.0:1789760716.019225:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19771392, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:0.0:1789760716.019234:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.019249:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:0.0:1789760716.019253:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760716.019260:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.019273:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760716.045939:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972147 is committed
00002000:00010000:0.0:1789760716.046180:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19771392 -> 19775488
00010000:00010000:0.0:1789760716.046196:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.046209:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.046224:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.046233:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760716.046238:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.046248:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.046266:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.046273:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60b6de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19771392->19775487] (req 19771392->19775487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760716.046430:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520873216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27251us (27513us total) trans 4294972147 rc 0/0
00000100:00100000:0.0:1789760716.046440:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4860
00000100:00100000:0.0:1789760716.046450:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687615223450 time 687705845705 state 0x2 ref 0
00000100:00100000:1.0:1789760716.050244:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.050375:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520873344
00000100:00100000:3.0:1789760716.050386:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520873344
00000100:00100000:3.0:1789760716.050443:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687615223450 time 687705845705 state 0x0 ref 1
00000100:00100000:3.0:1789760716.050470:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687706106121 time 687705845705 state 0x1 ref 1
00000100:00100000:3.0:1789760716.050496:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687706106121 time 687737179355 state 0x0 ref 1
00000100:00100000:3.0:1789760716.050509:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.050561:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19775488, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:3.0:1789760716.050576:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.050590:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760716.050594:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.050600:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.050613:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760716.088250:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19775488 -> 19779584
00010000:00010000:3.0:1789760716.088269:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.088290:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.088299:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.088306:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760716.088311:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.088337:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.088356:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.088364:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19775488->19779583] (req 19775488->19779583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760716.088665:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520873344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38153us (38427us total) trans 4294972148 rc 0/0
00000100:00100000:3.0:1789760716.088676:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4861
00000100:00100000:3.0:1789760716.088686:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687706106121 time 687737179355 state 0x2 ref 0
00000001:00080000:2.0:1789760716.088882:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972148 is committed
00000100:00100000:3.0:1789760716.094254:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760716.094355:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520873472
00000100:00100000:2.0:1789760716.094366:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520873472
00000100:00100000:2.0:1789760716.094430:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687706106121 time 687737179355 state 0x0 ref 1
00000100:00100000:2.0:1789760716.094444:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687737439771 time 687737179355 state 0x1 ref 1
00000100:00100000:2.0:1789760716.094733:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687737439771 time 687781413821 state 0x0 ref 1
00000100:00100000:2.0:1789760716.094746:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760716.094868:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19779584, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:2.0:1789760716.094878:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760716.094895:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:2.0:1789760716.094900:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760716.094907:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760716.094920:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760716.133949:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972149 is committed
00002000:00010000:0.0:1789760716.134030:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19779584 -> 19783680
00010000:00010000:0.0:1789760716.134045:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.134062:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.134072:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.134080:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760716.134085:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.134094:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.134117:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.134125:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b6ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19779584->19783679] (req 19779584->19783679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760716.134236:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39486us (39986us total) trans 4294972149 rc 0/0
00000100:00100000:0.0:1789760716.134246:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4862
00000100:00100000:0.0:1789760716.134256:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687737439771 time 687781413821 state 0x2 ref 0
00000100:00100000:0.0:1789760716.140091:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.140175:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520873600
00000100:00100000:3.0:1789760716.140185:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520873600
00000100:00100000:3.0:1789760716.140241:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687737439771 time 687781413821 state 0x0 ref 1
00000100:00100000:3.0:1789760716.140256:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687781674237 time 687781413821 state 0x1 ref 1
00000100:00100000:3.0:1789760716.140281:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687781674237 time 687826963531 state 0x0 ref 1
00000100:00100000:3.0:1789760716.140293:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.140359:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19783680, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:3.0:1789760716.140368:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.140383:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760716.140388:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.140394:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.140416:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760716.194089:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972150 is committed
00002000:00010000:3.0:1789760716.194182:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19783680 -> 19787776
00010000:00010000:3.0:1789760716.194198:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.194212:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.194222:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.194229:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760716.194234:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.194243:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.194261:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.194269:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b6f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19783680->19787775] (req 19783680->19787775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760716.194395:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54099us (54308us total) trans 4294972150 rc 0/0
00000100:00100000:3.0:1789760716.194405:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4863
00000100:00100000:3.0:1789760716.194415:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687781674237 time 687826963531 state 0x2 ref 0
00000100:00100000:3.0:1789760716.197509:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760716.197602:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520873728
00000100:00100000:0.0:1789760716.197611:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520873728
00000100:00100000:0.0:1789760716.197661:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687781674237 time 687826963531 state 0x0 ref 1
00000100:00100000:0.0:1789760716.197677:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687827223947 time 687826963531 state 0x1 ref 1
00000100:00100000:0.0:1789760716.197708:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687827223947 time 687884389181 state 0x0 ref 1
00000100:00100000:0.0:1789760716.197730:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520873728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760716.197980:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19787776, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:0.0:1789760716.197989:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.198006:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:0.0:1789760716.198011:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760716.198017:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.198032:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760716.242455:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972151 is committed
00002000:00010000:1.0:1789760716.242685:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19787776 -> 19791872
00010000:00010000:1.0:1789760716.242700:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.242722:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.242732:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.242739:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760716.242743:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.242878:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.242900:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.242915:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60b6fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19787776->19791871] (req 19787776->19791871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760716.243019:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520873728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45295us (45515us total) trans 4294972151 rc 0/0
00000100:00100000:1.0:1789760716.243029:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4864
00000100:00100000:1.0:1789760716.243038:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687827223947 time 687884389181 state 0x2 ref 0
00000100:00100000:1.0:1789760716.246490:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.246620:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520873856
00000100:00100000:3.0:1789760716.246629:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520873856
00000100:00100000:3.0:1789760716.246685:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687827223947 time 687884389181 state 0x0 ref 1
00000100:00100000:3.0:1789760716.246703:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687884649597 time 687884389181 state 0x1 ref 1
00000100:00100000:3.0:1789760716.246741:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687884649597 time 687933422722 state 0x0 ref 1
00000100:00100000:3.0:1789760716.246905:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.246965:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19791872, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:3.0:1789760716.246974:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.246988:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760716.246993:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.246999:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.247012:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760716.300748:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972152 is committed
00002000:00010000:1.0:1789760716.300990:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19791872 -> 19795968
00010000:00010000:1.0:1789760716.301006:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.301019:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.301029:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.301037:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760716.301041:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.301050:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.301075:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.301083:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b701 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19791872->19795967] (req 19791872->19795967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760716.301211:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520873856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54455us (54727us total) trans 4294972152 rc 0/0
00000100:00100000:1.0:1789760716.301221:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4865
00000100:00100000:1.0:1789760716.301231:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687884649597 time 687933422722 state 0x2 ref 0
00000100:00100000:0.0:1789760716.305707:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.305920:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520873984
00000100:00100000:3.0:1789760716.305938:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520873984
00000100:00100000:3.0:1789760716.305993:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687884649597 time 687933422722 state 0x0 ref 1
00000100:00100000:3.0:1789760716.306009:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687933683138 time 687933422722 state 0x1 ref 1
00000100:00100000:3.0:1789760716.306068:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687933683138 time 687992749986 state 0x0 ref 1
00000100:00100000:3.0:1789760716.306081:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520873984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.306128:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19795968, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:3.0:1789760716.306137:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.306152:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=687s v=(0 0)
00010000:00010000:3.0:1789760716.306157:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.306164:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.306178:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760716.339345:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972153 is committed
00002000:00010000:0.0:1789760716.339446:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19795968 -> 19800064
00010000:00010000:0.0:1789760716.339469:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.339488:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.339496:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.339504:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760716.339509:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.339517:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.339539:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.339547:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b708 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19795968->19800063] (req 19795968->19800063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760716.339769:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520873984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33682us (34063us total) trans 4294972153 rc 0/0
00000100:00100000:0.0:1789760716.339781:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4866
00000100:00100000:0.0:1789760716.339792:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687933683138 time 687992749986 state 0x2 ref 0
00000100:00100000:2.0:1789760716.345150:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760716.345252:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520874112
00000100:00100000:0.0:1789760716.345262:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520874112
00000100:00100000:0.0:1789760716.345443:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687933683138 time 687992749986 state 0x0 ref 1
00000100:00100000:0.0:1789760716.345523:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687993010402 time 687992749986 state 0x1 ref 1
00000100:00100000:0.0:1789760716.345656:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687993010402 time 688032337086 state 0x0 ref 1
00000100:00100000:0.0:1789760716.345670:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520874112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760716.345730:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19800064, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:0.0:1789760716.345739:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.345764:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:0.0:1789760716.345768:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760716.345775:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.345789:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.350222:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760716.387535:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972154 is committed
00002000:00010000:1.0:1789760716.388037:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19800064 -> 19804160
00010000:00010000:1.0:1789760716.388051:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.388065:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.388075:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.388083:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760716.388088:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.388103:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.388123:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.388131:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60b70f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19800064->19804159] (req 19800064->19804159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760716.388253:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520874112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42581us (43107us total) trans 4294972154 rc 0/0
00000100:00100000:1.0:1789760716.388264:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4867
00000100:00100000:1.0:1789760716.388274:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687993010402 time 688032337086 state 0x2 ref 0
00000100:00100000:1.0:1789760716.392291:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760716.392550:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520874240
00000100:00100000:0.0:1789760716.392623:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520874240
00000100:00100000:0.0:1789760716.392676:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 687993010402 time 688032337086 state 0x0 ref 1
00000100:00100000:0.0:1789760716.392692:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688032597502 time 688032337086 state 0x1 ref 1
00000100:00100000:0.0:1789760716.392880:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688032597502 time 688079560838 state 0x0 ref 1
00000100:00100000:0.0:1789760716.392895:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520874240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760716.392951:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19804160, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:0.0:1789760716.392960:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.392975:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:0.0:1789760716.392979:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760716.392986:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.392999:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760716.436352:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19804160 -> 19808256
00010000:00010000:1.0:1789760716.436371:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.436384:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.436393:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.436406:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760716.436411:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.436420:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.436439:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.436446:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b716 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19804160->19808255] (req 19804160->19808255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760716.436551:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520874240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43653us (44264us total) trans 4294972155 rc 0/0
00000100:00100000:1.0:1789760716.436570:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4868
00000100:00100000:1.0:1789760716.436579:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688032597502 time 688079560838 state 0x2 ref 0
00000001:00080000:3.0:1789760716.437041:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972155 is committed
00000100:00100000:1.0:1789760716.440688:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.440919:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520874368
00000100:00100000:3.0:1789760716.440937:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520874368
00000100:00100000:3.0:1789760716.440991:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688032597502 time 688079560838 state 0x0 ref 1
00000100:00100000:3.0:1789760716.441005:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688079821254 time 688079560838 state 0x1 ref 1
00000100:00100000:3.0:1789760716.441033:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688079821254 time 688127715715 state 0x0 ref 1
00000100:00100000:3.0:1789760716.441046:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520874368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.441091:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19808256, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:3.0:1789760716.441100:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.441122:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:3.0:1789760716.441126:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.441132:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.441145:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760716.505410:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19808256 -> 19812352
00010000:00010000:1.0:1789760716.505429:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.505441:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.505517:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.505526:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760716.505530:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.505540:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.505623:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.505632:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b71d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19808256->19812351] (req 19808256->19812351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760716.508795:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520874368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64669us (65033us total) trans 4294972156 rc 0/0
00000100:00100000:1.0:1789760716.508815:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4869
00000100:00100000:1.0:1789760716.508825:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688079821254 time 688127715715 state 0x2 ref 0
00000001:00080000:0.0:1789760716.509094:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972156 is committed
00000100:00100000:1.0:1789760716.510056:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.510138:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520874496
00000100:00100000:3.0:1789760716.510147:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520874496
00000100:00100000:3.0:1789760716.510193:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688079821254 time 688127715715 state 0x0 ref 1
00000100:00100000:3.0:1789760716.510208:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688127976131 time 688127715715 state 0x1 ref 1
00000100:00100000:3.0:1789760716.510266:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688127976131 time 688196948596 state 0x0 ref 1
00000100:00100000:3.0:1789760716.510279:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520874496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.510341:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19812352, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:3.0:1789760716.510351:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.510366:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:3.0:1789760716.510370:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.510377:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.510397:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760716.544533:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972157 is committed
00002000:00010000:0.0:1789760716.544964:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19812352 -> 19816448
00010000:00010000:0.0:1789760716.544980:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.544993:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.545001:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.545008:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760716.545013:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.545023:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.545042:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.545050:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b724 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19812352->19816447] (req 19812352->19816447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760716.545192:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520874496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34910us (35136us total) trans 4294972157 rc 0/0
00000100:00100000:0.0:1789760716.545203:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4870
00000100:00100000:0.0:1789760716.545212:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688127976131 time 688196948596 state 0x2 ref 0
00000100:00100000:2.0:1789760716.550110:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760716.550209:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520874624
00000100:00100000:1.0:1789760716.550219:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520874624
00000100:00100000:1.0:1789760716.550275:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688127976131 time 688196948596 state 0x0 ref 1
00000100:00100000:1.0:1789760716.550293:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688197209012 time 688196948596 state 0x1 ref 1
00000100:00100000:1.0:1789760716.550424:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688197209012 time 688237104936 state 0x0 ref 1
00000100:00100000:1.0:1789760716.550439:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520874624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760716.550496:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19816448, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:1.0:1789760716.550506:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.550522:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:1.0:1789760716.550526:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760716.550532:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.550546:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760716.587713:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972158 is committed
00002000:00010000:1.0:1789760716.587785:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19816448 -> 19820544
00010000:00010000:1.0:1789760716.587800:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.587813:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.587822:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.587835:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760716.587840:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.587849:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.587867:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.587874:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b72b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19816448->19820543] (req 19816448->19820543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760716.587980:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520874624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37539us (37874us total) trans 4294972158 rc 0/0
00000100:00100000:1.0:1789760716.587991:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4871
00000100:00100000:1.0:1789760716.587999:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688197209012 time 688237104936 state 0x2 ref 0
00000100:00100000:1.0:1789760716.590943:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760716.591036:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520874752
00000100:00100000:0.0:1789760716.591044:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520874752
00000100:00100000:0.0:1789760716.591087:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688197209012 time 688237104936 state 0x0 ref 1
00000100:00100000:0.0:1789760716.591098:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688237365352 time 688237104936 state 0x1 ref 1
00000100:00100000:0.0:1789760716.591127:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688237365352 time 688277809870 state 0x0 ref 1
00000100:00100000:0.0:1789760716.591139:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520874752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760716.591195:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19820544, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:0.0:1789760716.591204:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.591219:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:0.0:1789760716.591224:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760716.591229:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.591239:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760716.643201:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972159 is committed
00002000:00010000:1.0:1789760716.643247:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19820544 -> 19824640
00010000:00010000:1.0:1789760716.643263:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.643276:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.643290:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.643305:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760716.643309:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.643353:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.643372:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.643380:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b732 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19820544->19824639] (req 19820544->19824639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760716.643483:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520874752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52339us (52556us total) trans 4294972159 rc 0/0
00000100:00100000:1.0:1789760716.643493:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4872
00000100:00100000:1.0:1789760716.643502:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688237365352 time 688277809870 state 0x2 ref 0
00000100:00100000:2.0:1789760716.649898:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.650150:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520874880
00000100:00100000:3.0:1789760716.650163:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520874880
00000100:00100000:3.0:1789760716.650216:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688237365352 time 688277809870 state 0x0 ref 1
00000100:00100000:3.0:1789760716.650231:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688278070286 time 688277809870 state 0x1 ref 1
00000100:00100000:1.0:1789760716.650490:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688278070286 time 688337169621 state 0x0 ref 1
00000100:00100000:1.0:1789760716.650504:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520874880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760716.650627:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19824640, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:1.0:1789760716.650638:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.650653:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:1.0:1789760716.650657:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760716.650664:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.650678:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760716.685903:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972160 is committed
00002000:00010000:0.0:1789760716.686222:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19824640 -> 19828736
00010000:00010000:0.0:1789760716.686237:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.686249:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.686257:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.686263:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760716.686268:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.686276:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.686300:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.686309:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b739 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19824640->19828735] (req 19824640->19828735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760716.686415:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520874880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35910us (36522us total) trans 4294972160 rc 0/0
00000100:00100000:0.0:1789760716.686426:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4873
00000100:00100000:0.0:1789760716.686435:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688278070286 time 688337169621 state 0x2 ref 0
00000100:00100000:2.0:1789760716.690214:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.690298:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520875008
00000100:00100000:3.0:1789760716.690309:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520875008
00000100:00100000:3.0:1789760716.690406:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688278070286 time 688337169621 state 0x0 ref 1
00000100:00100000:3.0:1789760716.690421:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688337430037 time 688337169621 state 0x1 ref 1
00000100:00100000:3.0:1789760716.690443:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688337430037 time 688377125817 state 0x0 ref 1
00000100:00100000:3.0:1789760716.690567:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.690617:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19828736, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:3.0:1789760716.690626:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.690641:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:3.0:1789760716.690645:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.690652:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.690670:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760716.721073:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972161 is committed
00002000:00010000:3.0:1789760716.721073:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19828736 -> 19832832
00010000:00010000:3.0:1789760716.721091:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.721103:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.721113:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.721121:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760716.721130:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.721139:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.721159:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.721167:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b740 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19828736->19832831] (req 19828736->19832831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760716.721268:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30810us (31059us total) trans 4294972161 rc 0/0
00000100:00100000:3.0:1789760716.721278:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4874
00000100:00100000:3.0:1789760716.721289:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688337430037 time 688377125817 state 0x2 ref 0
00000100:00100000:2.0:1789760716.727434:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760716.728449:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520875136
00000100:00100000:1.0:1789760716.728470:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520875136
00000100:00100000:1.0:1789760716.728543:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688337430037 time 688377125817 state 0x0 ref 1
00000100:00100000:1.0:1789760716.728559:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688377386233 time 688377125817 state 0x1 ref 1
00000100:00100000:1.0:1789760716.728638:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688377386233 time 688415319465 state 0x0 ref 1
00000100:00100000:1.0:1789760716.728651:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520875136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760716.728697:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19832832, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:1.0:1789760716.728706:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.728722:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:1.0:1789760716.728727:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760716.728733:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.728747:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760716.791487:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19832832 -> 19836928
00010000:00010000:3.0:1789760716.791506:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.791518:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.791527:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.791533:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760716.791538:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.791545:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.791740:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.791756:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b747 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19832832->19836927] (req 19832832->19836927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760716.791852:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520875136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63199us (64421us total) trans 4294972162 rc 0/0
00000100:00100000:3.0:1789760716.791863:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4875
00000100:00100000:3.0:1789760716.791872:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688377386233 time 688415319465 state 0x2 ref 0
00000001:00080000:0.0:1789760716.793055:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972162 is committed
00000100:00100000:2.0:1789760716.799261:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760716.799363:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520875264
00000100:00100000:1.0:1789760716.799373:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520875264
00000100:00100000:1.0:1789760716.799425:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688377386233 time 688415319465 state 0x0 ref 1
00000100:00100000:1.0:1789760716.799440:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688415579881 time 688415319465 state 0x1 ref 1
00000100:00100000:1.0:1789760716.799517:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688415579881 time 688486189892 state 0x0 ref 1
00000100:00100000:1.0:1789760716.799530:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760716.799580:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19836928, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:1.0:1789760716.799590:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.799605:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:1.0:1789760716.799610:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760716.799616:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.799629:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760716.846831:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972163 is committed
00002000:00010000:0.0:1789760716.846892:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19836928 -> 19841024
00010000:00010000:0.0:1789760716.846906:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.846919:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.846937:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.846945:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760716.846950:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.846959:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.846977:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.846985:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b74e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19836928->19841023] (req 19836928->19841023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760716.847080:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47548us (47824us total) trans 4294972163 rc 0/0
00000100:00100000:0.0:1789760716.847091:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4876
00000100:00100000:0.0:1789760716.847101:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688415579881 time 688486189892 state 0x2 ref 0
00000100:00100000:2.0:1789760716.853498:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760716.853592:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520875392
00000100:00100000:0.0:1789760716.853604:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520875392
00000100:00100000:0.0:1789760716.853671:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688415579881 time 688486189892 state 0x0 ref 1
00000100:00100000:0.0:1789760716.853688:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688486450308 time 688486189892 state 0x1 ref 1
00000100:00100000:0.0:1789760716.853716:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688486450308 time 688540398664 state 0x0 ref 1
00000100:00100000:0.0:1789760716.853730:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520875392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760716.853781:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19841024, mtime: 0x6aad94cd, atime: 0x0, ctime: 0x6aad94cd, blocks: 0x9807
00010000:00010000:0.0:1789760716.853791:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.853807:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:0.0:1789760716.853812:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760716.853818:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.853832:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760716.907621:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19841024 -> 19845120
00002000:00010000:0.0:1789760716.907630:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760717 -> 1789760718
00002000:00010000:0.0:1789760716.907633:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760717 -> 1789760718
00010000:00010000:0.0:1789760716.907648:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.907735:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.907745:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.907752:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760716.907757:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.907767:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.907787:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.907795:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b755 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19841024->19845119] (req 19841024->19845119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760716.907878:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520875392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54146us (54384us total) trans 4294972164 rc 0/0
00000100:00100000:0.0:1789760716.907889:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4877
00000100:00100000:0.0:1789760716.907899:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688486450308 time 688540398664 state 0x2 ref 0
00000001:00080000:0.0:1789760716.907951:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972164 is committed
00000100:00100000:2.0:1789760716.914199:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.914871:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520875520
00000100:00100000:3.0:1789760716.914882:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520875520
00000100:00100000:3.0:1789760716.914947:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688486450308 time 688540398664 state 0x0 ref 1
00000100:00100000:3.0:1789760716.914963:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688540659080 time 688540398664 state 0x1 ref 1
00000100:00100000:3.0:1789760716.915028:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688540659080 time 688601709876 state 0x0 ref 1
00000100:00100000:3.0:1789760716.915040:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.915083:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19845120, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:3.0:1789760716.915092:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.915106:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:3.0:1789760716.915110:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.915412:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.915433:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760716.924537:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548741376:0@lo:400:kworker.0
00000100:00100000:2.0:1789760716.924616:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760716.924957:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3454:1876699548741888:0@lo:400:kworker.0
00000100:00100000:2.0:1789760716.924994:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760716.925026:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd9df6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3454:1876699548742400:0@lo:400:kworker.0
00000100:00100000:2.0:1789760716.925054:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760716.925090:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:2.0:1789760716.925100:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876699548741248:0@lo:400:kworker.0
00000100:00100000:2.0:1789760716.925129:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760716.925158:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3454:1876699548741760:0@lo:400:kworker.0
00000100:00100000:2.0:1789760716.925186:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760716.925231:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd9df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3454:1876699548742272:0@lo:400:kworker.0
00000100:00100000:2.0:1789760716.925274:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760716.926075:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1789760716.926088:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548742784:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760716.926125:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760716.926170:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548742784
00000100:00100000:0.0:1789760716.926177:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548742784
00000100:00100000:3.0:1789760716.926195:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e2f0499-cafa-479a-9c13-a508b560cb61:3456:1876699548741120:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.926232:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340
00000100:00100000:3.0:1789760716.926237:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760716.926244:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548742784:12345-0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1789760716.926272:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548741632:0@lo:400:kworker.0
00002000:00000024:0.0:1789760716.926278:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:3.0:1789760716.926301:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760716.926337:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548741120
00000100:00100000:2.0:1789760716.926343:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548741120
00000100:00100000:0.0:1789760716.926355:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548742784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (229us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760716.926358:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd9df6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548742144:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.926367:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340
00000100:00100000:2.0:1789760716.926371:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461
00000100:00100000:2.0:1789760716.926378:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda005b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3456:x1876699548741120:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1789760716.926387:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1789760716.926395:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760716.926420:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548742784:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1789760716.926425:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd9df6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548742656:0@lo:400:kworker.0
00000100:00100000:2.0:1789760716.926427:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda005b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3456:x1876699548741120:12345-0@lo:400:kworker.0 Request processed in 49us (191us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760716.926436:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461
00000100:00100000:3.0:1789760716.926464:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760716.926621:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e2f0499-cafa-479a-9c13-a508b560cb61:3456:1876699548741120:0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.926631:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:3.0:1789760716.926638:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3456:1876699548741504:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.926656:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548742144
00000100:00100000:0.0:1789760716.926661:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548742144
00000100:00100000:0.0:1789760716.926698:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548742656
00000100:00100000:0.0:1789760716.926701:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548742656
00000100:00100000:0.0:1789760716.926728:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266
00000100:00100000:0.0:1789760716.926736:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548742144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.926744:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760716.926765:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267
00000100:00100000:3.0:1789760716.926765:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548742016:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.926776:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548742144:12345-0@lo:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760716.926776:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548742656:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.926783:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266
00000100:00100000:3.0:1789760716.926800:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:0.0:1789760716.926802:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1789760716.926817:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548742656:12345-0@lo:400:kworker.0 Request processed in 44us (352us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760716.926823:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267
00000100:00100000:2.0:1789760716.926833:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548742016
00000100:00100000:2.0:1789760716.926836:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548742016
00000100:00100000:2.0:1789760716.926854:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268
00000100:00100000:2.0:1789760716.926860:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548742016:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.927247:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8daba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548742912:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760716.927252:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548741888
00000100:00100000:1.0:1789760716.927257:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548741888
00000100:00100000:1.0:1789760716.927642:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548742400
00000100:00100000:1.0:1789760716.927647:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548742400
00000100:00100000:1.0:1789760716.928008:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548741248
00000100:00100000:1.0:1789760716.928013:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548741248
00000100:00100000:1.0:1789760716.928026:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548741760
00000100:00100000:1.0:1789760716.928029:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548741760
00000100:00100000:1.0:1789760716.928042:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548742272
00000100:00100000:1.0:1789760716.928045:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548742272
00000100:00100000:1.0:1789760716.928058:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548741504
00000100:00100000:1.0:1789760716.928061:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548741504
00000100:00100000:1.0:1789760716.928081:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827
00000100:00100000:1.0:1789760716.928091:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3454:x1876699548741888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760716.928219:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3454:x1876699548741888:12345-0@lo:400:kworker.0 Request processed in 130us (3225us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760716.928227:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827
00000100:00100000:1.0:1789760716.928245:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828
00000100:00100000:1.0:1789760716.928252:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876699548742400:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760716.928287:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876699548742400:12345-0@lo:400:kworker.0 Request processed in 35us (3233us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760716.928294:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828
00000100:00100000:1.0:1789760716.928309:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829
00000100:00100000:1.0:1789760716.928333:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876699548741248:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760716.928361:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876699548741248:12345-0@lo:400:kworker.0 Request processed in 46us (3233us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760716.928370:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829
00000100:00100000:1.0:1789760716.928379:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830
00000100:00100000:1.0:1789760716.928384:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876699548741760:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760716.928406:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876699548741760:12345-0@lo:400:kworker.0 Request processed in 22us (3223us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760716.928412:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830
00000100:00100000:1.0:1789760716.928420:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831
00000100:00100000:1.0:1789760716.928426:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3454:x1876699548742272:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760716.928445:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3454:x1876699548742272:12345-0@lo:400:kworker.0 Request processed in 20us (3174us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760716.928449:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831
00000100:00100000:3.0:1789760716.928549:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd9df6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548742528:0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.928580:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760716.928591:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832
00000100:00100000:1.0:1789760716.928600:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3456:x1876699548741504:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.928617:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd9df6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548742144:0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.928632:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd9df6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548742656:0@lo:400:kworker.0
00000100:00100000:1.0:1789760716.928638:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3456:x1876699548741504:12345-0@lo:400:kworker.0 Request processed in 40us (1895us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760716.928645:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832
00000100:00100000:3.0:1789760716.928659:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3456:1876699548741504:0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.928686:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548741376
00000100:00100000:3.0:1789760716.928690:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548741376
00000100:00100000:3.0:1789760716.928714:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548741632
00000100:00100000:3.0:1789760716.928717:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548741632
00000100:00100000:3.0:1789760716.928734:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407
00000100:00100000:3.0:1789760716.928740:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548741376:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.928774:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548741376:12345-0@lo:400:kworker.0 Request processed in 35us (4162us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760716.928781:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407
00000100:00100000:3.0:1789760716.928794:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408
00000100:00100000:3.0:1789760716.928800:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548741632:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.928833:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548741632:12345-0@lo:400:kworker.0 Request processed in 32us (2532us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760716.928841:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408
00000100:00100000:1.0:1789760716.928861:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548741632:0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.928888:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548742528
00000100:00100000:3.0:1789760716.928892:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548742528
00000100:00100000:3.0:1789760716.928930:0:9637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269
00000100:00100000:3.0:1789760716.928938:0:9637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548742528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760716.928974:0:9637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548742528:12345-0@lo:400:kworker.0 Request processed in 37us (394us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760716.928982:0:9637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269
00000100:00100000:1.0:1789760716.928992:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd9df6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548742528:0@lo:400:kworker.0
00000100:00100000:2.0:1789760716.929148:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548742016:12345-0@lo:400:kworker.0 Request processed in 2287us (2349us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760716.929155:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268
00000100:00080000:0.0:1789760716.929238:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:0.0:1789760716.929554:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1789760716.929589:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760716.929631:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876699548741248:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.929645:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3454:1876699548741760:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.929657:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd9df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3454:1876699548742272:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.929669:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548741376:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.929679:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3454:1876699548741888:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.929689:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd9df6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3454:1876699548742400:0@lo:400:kworker.0
00000100:00100000:0.0:1789760716.929719:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548742912
00000100:00100000:0.0:1789760716.929724:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548742912
00000100:00100000:0.0:1789760716.929751:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341
00000100:00100000:0.0:1789760716.929789:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548742912:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:0.0:1789760716.929807:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760716.929948:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548742912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (358us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760716.929956:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341
00000100:00100000:0.0:1789760716.930019:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8daba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548742912:0@lo:13:osp-pre-1-0.0
00000100:00100000:3.0:1789760716.931384:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548742016:0@lo:400:kworker.0
00000001:00080000:0.0:1789760716.952608:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972165 is committed
00002000:00010000:2.0:1789760716.952726:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19845120 -> 19849216
00010000:00010000:2.0:1789760716.952741:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760716.952751:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760716.952757:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760716.952762:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760716.952765:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760716.952771:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760716.952785:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760716.952791:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b75c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19845120->19849215] (req 19845120->19849215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760716.952883:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37841us (38689us total) trans 4294972165 rc 0/0
00000100:00100000:2.0:1789760716.952893:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4878
00000100:00100000:2.0:1789760716.952902:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688540659080 time 688601709876 state 0x2 ref 0
00000100:00100000:2.0:1789760716.955818:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760716.956048:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520875648
00000100:00100000:3.0:1789760716.956057:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520875648
00000100:00100000:3.0:1789760716.956110:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688540659080 time 688601709876 state 0x0 ref 1
00000100:00100000:3.0:1789760716.956126:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688601970292 time 688601709876 state 0x1 ref 1
00000100:00100000:3.0:1789760716.956200:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688601970292 time 688642881282 state 0x0 ref 1
00000100:00100000:3.0:1789760716.956213:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760716.956262:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19849216, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:3.0:1789760716.956272:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.956287:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:3.0:1789760716.956291:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760716.956297:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760716.956331:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760716.986551:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972166 is committed
00002000:00010000:1.0:1789760716.986688:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19849216 -> 19853312
00010000:00010000:1.0:1789760716.986704:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.986717:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.986743:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.986750:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760716.986755:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.986772:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.986792:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760716.986801:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b763 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19849216->19853311] (req 19849216->19853311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760716.986899:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30683us (31086us total) trans 4294972166 rc 0/0
00000100:00100000:1.0:1789760716.986909:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4879
00000100:00100000:1.0:1789760716.986918:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688601970292 time 688642881282 state 0x2 ref 0
00000100:00100000:3.0:1789760716.990627:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760716.991101:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520875776
00000100:00100000:0.0:1789760716.991111:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520875776
00000100:00100000:0.0:1789760716.991166:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688601970292 time 688642881282 state 0x0 ref 1
00000100:00100000:0.0:1789760716.991181:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688643141698 time 688642881282 state 0x1 ref 1
00000100:00100000:0.0:1789760716.991263:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688643141698 time 688677945007 state 0x0 ref 1
00000100:00100000:0.0:1789760716.991276:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520875776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760716.991350:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19853312, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:0.0:1789760716.991360:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.991376:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:0.0:1789760716.991381:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760716.991387:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760716.991400:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760717.027943:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972167 is committed
00002000:00010000:0.0:1789760717.028160:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19853312 -> 19857408
00010000:00010000:0.0:1789760717.028175:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.028188:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.028198:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.028207:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760717.028212:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.028221:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.028242:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.028250:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b76a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19853312->19857407] (req 19853312->19857407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760717.028593:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520875776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37314us (37970us total) trans 4294972167 rc 0/0
00000100:00100000:0.0:1789760717.028608:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4880
00000100:00100000:0.0:1789760717.028618:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688643141698 time 688677945007 state 0x2 ref 0
00000100:00100000:2.0:1789760717.035091:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760717.035182:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520875904
00000100:00100000:0.0:1789760717.035191:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520875904
00000100:00100000:0.0:1789760717.035249:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688643141698 time 688677945007 state 0x0 ref 1
00000100:00100000:0.0:1789760717.035265:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688678205423 time 688677945007 state 0x1 ref 1
00000100:00100000:0.0:1789760717.035296:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688678205423 time 688721978793 state 0x0 ref 1
00000100:00100000:0.0:1789760717.035307:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760717.035393:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19857408, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:0.0:1789760717.035403:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.035420:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:0.0:1789760717.035436:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760717.035581:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.035598:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760717.067916:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972168 is committed
00002000:00010000:0.0:1789760717.068024:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19857408 -> 19861504
00010000:00010000:0.0:1789760717.068039:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.068053:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.068063:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.068072:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760717.068077:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.068087:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.068107:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.068116:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b771 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19857408->19861503] (req 19857408->19861503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760717.068203:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520875904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32893us (33117us total) trans 4294972168 rc 0/0
00000100:00100000:0.0:1789760717.068214:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4881
00000100:00100000:0.0:1789760717.068224:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688678205423 time 688721978793 state 0x2 ref 0
00000100:00100000:2.0:1789760717.072838:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760717.072992:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520876032
00000100:00100000:3.0:1789760717.073002:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520876032
00000100:00100000:3.0:1789760717.073060:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688678205423 time 688721978793 state 0x0 ref 1
00000100:00100000:3.0:1789760717.073076:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688722239209 time 688721978793 state 0x1 ref 1
00000100:00100000:3.0:1789760717.073142:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688722239209 time 688759823802 state 0x0 ref 1
00000100:00100000:3.0:1789760717.073156:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760717.073208:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19861504, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:3.0:1789760717.073218:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.073233:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:3.0:1789760717.073237:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760717.073243:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.073257:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760717.121997:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19861504 -> 19865600
00010000:00010000:3.0:1789760717.122016:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.122030:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.122038:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.122046:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760717.122051:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.122060:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.122080:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.122088:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b778 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19861504->19865599] (req 19861504->19865599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760717.122233:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972169 is committed
00000100:00100000:3.0:1789760717.122288:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49129us (49456us total) trans 4294972169 rc 0/0
00000100:00100000:3.0:1789760717.122300:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4882
00000100:00100000:3.0:1789760717.122310:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688722239209 time 688759823802 state 0x2 ref 0
00000100:00100000:1.0:1789760717.127103:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760717.127182:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520876160
00000100:00100000:3.0:1789760717.127192:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520876160
00000100:00100000:3.0:1789760717.127243:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688722239209 time 688759823802 state 0x0 ref 1
00000100:00100000:3.0:1789760717.127258:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688760084218 time 688759823802 state 0x1 ref 1
00000100:00100000:3.0:1789760717.127290:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688760084218 time 688813971624 state 0x0 ref 1
00000100:00100000:3.0:1789760717.127303:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520876160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760717.127385:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19865600, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:3.0:1789760717.127395:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.127411:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:3.0:1789760717.127416:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760717.127422:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.127436:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760717.154906:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972170 is committed
00002000:00010000:1.0:1789760717.154998:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19865600 -> 19869696
00010000:00010000:1.0:1789760717.155013:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.155025:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.155034:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.155041:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760717.155047:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.155056:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.155075:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.155083:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b77f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19865600->19869695] (req 19865600->19869695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760717.155214:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520876160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27908us (28117us total) trans 4294972170 rc 0/0
00000100:00100000:1.0:1789760717.155226:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4883
00000100:00100000:1.0:1789760717.155235:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688760084218 time 688813971624 state 0x2 ref 0
00000100:00100000:0.0:1789760717.159255:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760717.159515:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520876288
00000100:00100000:2.0:1789760717.159526:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520876288
00000100:00100000:2.0:1789760717.159660:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688760084218 time 688813971624 state 0x0 ref 1
00000100:00100000:2.0:1789760717.159673:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688814232040 time 688813971624 state 0x1 ref 1
00000100:00100000:2.0:1789760717.159736:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688814232040 time 688846417447 state 0x0 ref 1
00000100:00100000:2.0:1789760717.159748:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760717.159793:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19869696, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:2.0:1789760717.159801:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.159816:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:2.0:1789760717.159821:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760717.159827:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.159842:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760717.197265:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972171 is committed
00002000:00010000:0.0:1789760717.197432:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19869696 -> 19873792
00010000:00010000:0.0:1789760717.197447:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.197522:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.197532:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.197540:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760717.197544:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.197612:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.197634:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.197643:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b786 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19869696->19873791] (req 19869696->19873791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760717.197819:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38068us (38571us total) trans 4294972171 rc 0/0
00000100:00100000:0.0:1789760717.197830:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4884
00000100:00100000:0.0:1789760717.197840:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688814232040 time 688846417447 state 0x2 ref 0
00000100:00100000:2.0:1789760717.204051:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760717.204162:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520876416
00000100:00100000:0.0:1789760717.204171:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520876416
00000100:00100000:0.0:1789760717.204223:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688814232040 time 688846417447 state 0x0 ref 1
00000100:00100000:0.0:1789760717.204239:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688846677863 time 688846417447 state 0x1 ref 1
00000100:00100000:0.0:1789760717.204346:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688846677863 time 688891027406 state 0x0 ref 1
00000100:00100000:0.0:1789760717.204370:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520876416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760717.204417:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19873792, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:0.0:1789760717.204426:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.204443:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:0.0:1789760717.204447:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760717.204454:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.204468:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760717.237268:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972172 is committed
00002000:00010000:1.0:1789760717.237452:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19873792 -> 19877888
00010000:00010000:1.0:1789760717.237475:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.237493:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.237503:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.237513:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760717.237518:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.237526:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.237549:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.237555:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b78d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19873792->19877887] (req 19873792->19877887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760717.237670:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520876416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33294us (33619us total) trans 4294972172 rc 0/0
00000100:00100000:1.0:1789760717.237689:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4885
00000100:00100000:1.0:1789760717.237701:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688846677863 time 688891027406 state 0x2 ref 0
00000100:00100000:2.0:1789760717.241643:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760717.241781:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520876544
00000100:00100000:0.0:1789760717.241794:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520876544
00000100:00100000:0.0:1789760717.242032:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688846677863 time 688891027406 state 0x0 ref 1
00000100:00100000:0.0:1789760717.242052:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688891287822 time 688891027406 state 0x1 ref 1
00000100:00100000:0.0:1789760717.242088:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688891287822 time 688928770559 state 0x0 ref 1
00000100:00100000:0.0:1789760717.242102:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520876544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760717.242164:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19877888, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:0.0:1789760717.242175:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.242194:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:0.0:1789760717.242200:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760717.242208:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.242225:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760717.288180:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972173 is committed
00002000:00010000:2.0:1789760717.288266:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19877888 -> 19881984
00010000:00010000:2.0:1789760717.288355:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.288370:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.288380:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.288389:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760717.288394:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.288403:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.288424:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.288429:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b794 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19877888->19881983] (req 19877888->19881983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760717.288619:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520876544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46512us (46982us total) trans 4294972173 rc 0/0
00000100:00100000:2.0:1789760717.288636:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4886
00000100:00100000:2.0:1789760717.288709:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688891287822 time 688928770559 state 0x2 ref 0
00000100:00100000:0.0:1789760717.291882:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760717.291962:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520876672
00000100:00100000:1.0:1789760717.291974:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520876672
00000100:00100000:1.0:1789760717.292173:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688891287822 time 688928770559 state 0x0 ref 1
00000100:00100000:1.0:1789760717.292188:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688929030975 time 688928770559 state 0x1 ref 1
00000100:00100000:1.0:1789760717.292225:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688929030975 time 688978907195 state 0x0 ref 1
00000100:00100000:1.0:1789760717.292241:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760717.292397:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19881984, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:1.0:1789760717.292408:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.292427:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=688s v=(0 0)
00010000:00010000:1.0:1789760717.292431:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760717.292437:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.292451:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760717.326052:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19881984 -> 19886080
00010000:00010000:3.0:1789760717.326081:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.326093:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.326103:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.326109:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760717.326113:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.326120:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.326144:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.326153:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b79b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19881984->19886079] (req 19881984->19886079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760717.326264:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520876672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34022us (34388us total) trans 4294972174 rc 0/0
00000100:00100000:3.0:1789760717.326356:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4887
00000100:00100000:3.0:1789760717.326370:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688929030975 time 688978907195 state 0x2 ref 0
00000001:00080000:2.0:1789760717.326471:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972174 is committed
00000100:00100000:1.0:1789760717.338601:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760717.338768:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520876800
00000100:00100000:2.0:1789760717.338781:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520876800
00000100:00100000:2.0:1789760717.338850:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688929030975 time 688978907195 state 0x0 ref 1
00000100:00100000:2.0:1789760717.338880:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688979167611 time 688978907195 state 0x1 ref 1
00000100:00100000:2.0:1789760717.338931:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688979167611 time 689025603889 state 0x0 ref 1
00000100:00100000:2.0:1789760717.338947:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760717.339170:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19886080, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:2.0:1789760717.339182:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.339201:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:2.0:1789760717.339207:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760717.339214:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.339232:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.370881:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760717.421613:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972175 is committed
00002000:00010000:2.0:1789760717.421854:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19886080 -> 19890176
00010000:00010000:2.0:1789760717.421875:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.421889:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.421900:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.421909:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760717.421916:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.421937:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.421960:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.421967:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19886080->19890175] (req 19886080->19890175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760717.422081:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 83132us (83489us total) trans 4294972175 rc 0/0
00000100:00100000:2.0:1789760717.422092:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4888
00000100:00100000:2.0:1789760717.422102:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688979167611 time 689025603889 state 0x2 ref 0
00000100:00100000:0.0:1789760717.431220:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760717.431398:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520876928
00000100:00100000:1.0:1789760717.431412:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520876928
00000100:00100000:1.0:1789760717.431495:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 688979167611 time 689025603889 state 0x0 ref 1
00000100:00100000:1.0:1789760717.431514:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689025864305 time 689025603889 state 0x1 ref 1
00000100:00100000:1.0:1789760717.431550:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689025864305 time 689118232226 state 0x0 ref 1
00000100:00100000:1.0:1789760717.431573:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760717.431640:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19890176, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:1.0:1789760717.431652:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.431672:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:1.0:1789760717.431677:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760717.431685:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.431701:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760717.481373:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972176 is committed
00002000:00010000:3.0:1789760717.483896:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19890176 -> 19894272
00010000:00010000:3.0:1789760717.483934:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.483951:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.483962:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.483972:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760717.483978:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.483990:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.484025:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.484035:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b7a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19890176->19894271] (req 19890176->19894271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760717.484239:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520876928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52658us (53024us total) trans 4294972176 rc 0/0
00000100:00100000:3.0:1789760717.484254:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4889
00000100:00100000:3.0:1789760717.484277:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689025864305 time 689118232226 state 0x2 ref 0
00000100:00100000:0.0:1789760717.490818:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760717.490949:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520877056
00000100:00100000:2.0:1789760717.490962:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520877056
00000100:00100000:2.0:1789760717.491034:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689025864305 time 689118232226 state 0x0 ref 1
00000100:00100000:2.0:1789760717.491054:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689118492642 time 689118232226 state 0x1 ref 1
00000100:00100000:2.0:1789760717.491130:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689118492642 time 689177811341 state 0x0 ref 1
00000100:00100000:2.0:1789760717.491144:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520877056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760717.491211:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19894272, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:2.0:1789760717.491223:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.491245:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:2.0:1789760717.491251:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760717.491259:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.491290:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760717.556785:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972177 is committed
00002000:00010000:0.0:1789760717.556911:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19894272 -> 19898368
00010000:00010000:0.0:1789760717.556941:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.556957:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.556969:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.556978:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760717.556985:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.556994:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.557020:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.557029:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60b7b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19894272->19898367] (req 19894272->19898367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760717.557159:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520877056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66010us (66349us total) trans 4294972177 rc 0/0
00000100:00100000:0.0:1789760717.557173:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4890
00000100:00100000:0.0:1789760717.557187:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689118492642 time 689177811341 state 0x2 ref 0
00000100:00100000:1.0:1789760717.560068:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760717.560182:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520877184
00000100:00100000:3.0:1789760717.560196:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520877184
00000100:00100000:3.0:1789760717.560269:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689118492642 time 689177811341 state 0x0 ref 1
00000100:00100000:3.0:1789760717.560288:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689178071757 time 689177811341 state 0x1 ref 1
00000100:00100000:3.0:1789760717.560395:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689178071757 time 689247075717 state 0x0 ref 1
00000100:00100000:3.0:1789760717.560410:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520877184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760717.560484:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19898368, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:3.0:1789760717.560495:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.560520:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:3.0:1789760717.560526:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760717.560534:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.560659:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760717.622655:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972178 is committed
00002000:00010000:0.0:1789760717.623211:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19898368 -> 19902464
00010000:00010000:0.0:1789760717.623234:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.623251:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.623266:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.623275:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760717.623282:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.623292:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.623337:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.623346:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b7b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19898368->19902463] (req 19898368->19902463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760717.623524:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520877184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63107us (63459us total) trans 4294972178 rc 0/0
00000100:00100000:0.0:1789760717.623538:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4891
00000100:00100000:0.0:1789760717.623561:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689178071757 time 689247075717 state 0x2 ref 0
00000100:00100000:1.0:1789760717.626359:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760717.628228:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520877312
00000100:00100000:0.0:1789760717.628248:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520877312
00000100:00100000:0.0:1789760717.628352:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689178071757 time 689247075717 state 0x0 ref 1
00000100:00100000:0.0:1789760717.628373:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689247336133 time 689247075717 state 0x1 ref 1
00000100:00100000:0.0:1789760717.628417:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689247336133 time 689315099363 state 0x0 ref 1
00000100:00100000:0.0:1789760717.628432:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520877312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760717.628508:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19902464, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:0.0:1789760717.628519:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.628539:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:0.0:1789760717.628544:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760717.628564:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760717.628581:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760717.680634:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972179 is committed
00002000:00010000:2.0:1789760717.680780:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19902464 -> 19906560
00010000:00010000:2.0:1789760717.680800:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.680814:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.680824:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.680833:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760717.680839:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.680849:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.680876:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.680887:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b7be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19902464->19906559] (req 19902464->19906559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760717.681099:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520877312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52594us (54710us total) trans 4294972179 rc 0/0
00000100:00100000:2.0:1789760717.681112:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4892
00000100:00100000:2.0:1789760717.681123:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689247336133 time 689315099363 state 0x2 ref 0
00000100:00100000:2.0:1789760717.684752:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760717.684887:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520877440
00000100:00100000:1.0:1789760717.684910:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520877440
00000100:00100000:1.0:1789760717.685014:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689247336133 time 689315099363 state 0x0 ref 1
00000100:00100000:1.0:1789760717.685115:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689315359779 time 689315099363 state 0x1 ref 1
00000100:00100000:1.0:1789760717.685205:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689315359779 time 689371886994 state 0x0 ref 1
00000100:00100000:1.0:1789760717.685233:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520877440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760717.685360:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19906560, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:1.0:1789760717.685389:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.685414:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:1.0:1789760717.685425:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760717.685433:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760717.685611:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760717.765494:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972180 is committed
00002000:00010000:2.0:1789760717.765750:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19906560 -> 19910656
00010000:00010000:2.0:1789760717.765771:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.765791:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.765801:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.765810:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760717.765817:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.765828:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.765853:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.765863:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b7c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19906560->19910655] (req 19906560->19910655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760717.765996:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520877440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 80759us (81257us total) trans 4294972180 rc 0/0
00000100:00100000:2.0:1789760717.766009:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4893
00000100:00100000:2.0:1789760717.766031:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689315359779 time 689371886994 state 0x2 ref 0
00000100:00100000:1.0:1789760717.769685:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760717.773642:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520877568
00000100:00100000:2.0:1789760717.773667:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520877568
00000100:00100000:3.0:1789760717.773880:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689315359779 time 689371886994 state 0x0 ref 1
00000100:00100000:3.0:1789760717.773901:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689372147410 time 689371886994 state 0x1 ref 1
00000100:00100000:3.0:1789760717.773945:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689372147410 time 689460626528 state 0x0 ref 1
00000100:00100000:3.0:1789760717.773961:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520877568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760717.774534:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19910656, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:3.0:1789760717.774618:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.774641:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:3.0:1789760717.774646:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760717.774654:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.774671:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760717.881833:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972181 is committed
00002000:00010000:2.0:1789760717.883389:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19910656 -> 19914752
00010000:00010000:2.0:1789760717.883415:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.883430:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.883440:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.883449:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760717.883455:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.883464:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.883490:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.883499:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b7cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19910656->19914751] (req 19910656->19914751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760717.883630:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520877568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 109666us (113954us total) trans 4294972181 rc 0/0
00000100:00100000:2.0:1789760717.883643:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4894
00000100:00100000:2.0:1789760717.883655:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689372147410 time 689460626528 state 0x2 ref 0
00000100:00100000:1.0:1789760717.887392:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760717.891946:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520877696
00000100:00100000:3.0:1789760717.891967:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520877696
00000100:00100000:3.0:1789760717.892057:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689372147410 time 689460626528 state 0x0 ref 1
00000100:00100000:3.0:1789760717.892078:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689460886944 time 689460626528 state 0x1 ref 1
00000100:00100000:3.0:1789760717.892120:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689460886944 time 689578801433 state 0x0 ref 1
00000100:00100000:3.0:1789760717.892136:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520877696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760717.892199:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19914752, mtime: 0x6aad94ce, atime: 0x0, ctime: 0x6aad94ce, blocks: 0x9807
00010000:00010000:3.0:1789760717.892210:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.892230:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:3.0:1789760717.892235:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760717.892242:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760717.892257:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760717.964339:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19914752 -> 19918848
00002000:00010000:2.0:1789760717.964347:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760718 -> 1789760719
00002000:00010000:2.0:1789760717.964350:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760718 -> 1789760719
00010000:00010000:2.0:1789760717.964364:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.964377:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.964387:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.964394:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00000001:00080000:0.0:1789760717.964612:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972182 is committed
00010000:00010000:2.0:1789760717.964661:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.964672:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.964693:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.964701:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19914752->19918847] (req 19914752->19918847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760717.965484:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520877696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73344us (78099us total) trans 4294972182 rc 0/0
00000100:00100000:2.0:1789760717.965499:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4895
00000100:00100000:2.0:1789760717.965508:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689460886944 time 689578801433 state 0x2 ref 0
00000100:00100000:0.0:1789760717.969607:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760717.970085:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520877824
00000100:00100000:2.0:1789760717.970096:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520877824
00000100:00100000:2.0:1789760717.970151:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689460886944 time 689578801433 state 0x0 ref 1
00000100:00100000:2.0:1789760717.970166:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689579061849 time 689578801433 state 0x1 ref 1
00000100:00100000:2.0:1789760717.970239:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689579061849 time 689656919890 state 0x0 ref 1
00000100:00100000:2.0:1789760717.970253:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520877824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760717.970304:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19918848, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0x9807
00010000:00010000:2.0:1789760717.970341:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.970360:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:2.0:1789760717.970364:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760717.970370:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760717.970385:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760718.015808:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972183 is committed
00002000:00010000:2.0:1789760718.016061:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19918848 -> 19922944
00010000:00010000:2.0:1789760718.016076:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.016089:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.016100:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.016107:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760718.016112:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.016120:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.016139:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.016146:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b7da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19918848->19922943] (req 19918848->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760718.016235:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520877824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45980us (46632us total) trans 4294972183 rc 0/0
00000100:00100000:2.0:1789760718.016244:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4896
00000100:00100000:2.0:1789760718.016254:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689579061849 time 689656919890 state 0x2 ref 0
00000100:00100000:1.0:1789760718.020528:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760718.021260:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520877952
00000100:00100000:2.0:1789760718.021272:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520877952
00000100:00100000:2.0:1789760718.021594:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689579061849 time 689656919890 state 0x0 ref 1
00000100:00100000:2.0:1789760718.021608:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689657180306 time 689656919890 state 0x1 ref 1
00000100:00100000:3.0:1789760718.021841:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689657180306 time 689708512134 state 0x0 ref 1
00000100:00100000:3.0:1789760718.021874:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520877952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.021963:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19922944, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0x9807
00010000:00010000:3.0:1789760718.021976:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760718.021989:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1789760718.021995:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:3.0:1789760718.022003:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.022012:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.022028:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760718.104485:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19922944 -> 19927040
00002000:00010000:0.0:1789760718.104499:0:14638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 38919 -> 40967
00010000:00010000:0.0:1789760718.104516:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.104533:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760718.104535:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972184 is committed
00010000:00010000:0.0:1789760718.104549:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.104558:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760718.104563:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.104573:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.104598:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.104607:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b7e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19922944->19927039] (req 19922944->19927039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760718.104729:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520877952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 82861us (84203us total) trans 4294972184 rc 0/0
00000100:00100000:0.0:1789760718.104741:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4897
00000100:00100000:0.0:1789760718.104754:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689657180306 time 689708512134 state 0x2 ref 0
00000100:00100000:0.0:1789760718.109425:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760718.109539:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520878080
00000100:00100000:3.0:1789760718.109615:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520878080
00000100:00100000:3.0:1789760718.109688:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689657180306 time 689708512134 state 0x0 ref 1
00000100:00100000:3.0:1789760718.109706:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689708772550 time 689708512134 state 0x1 ref 1
00000100:00100000:3.0:1789760718.109748:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689708772550 time 689796428803 state 0x0 ref 1
00000100:00100000:3.0:1789760718.109762:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.109824:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19927040, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:3.0:1789760718.109835:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.109854:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:3.0:1789760718.109861:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.109869:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.109886:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760718.147865:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972185 is committed
00002000:00010000:2.0:1789760718.148029:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19927040 -> 19931136
00010000:00010000:2.0:1789760718.148049:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.148064:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.148074:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.148082:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760718.148088:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.148098:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.148122:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.148131:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b7e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19927040->19931135] (req 19927040->19931135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760718.148520:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38752us (39100us total) trans 4294972185 rc 0/0
00000100:00100000:2.0:1789760718.148534:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4898
00000100:00100000:2.0:1789760718.148555:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689708772550 time 689796428803 state 0x2 ref 0
00000100:00100000:2.0:1789760718.152424:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760718.152547:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520878208
00000100:00100000:1.0:1789760718.152560:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520878208
00000100:00100000:1.0:1789760718.152635:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689708772550 time 689796428803 state 0x0 ref 1
00000100:00100000:1.0:1789760718.152658:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689796689219 time 689796428803 state 0x1 ref 1
00000100:00100000:1.0:1789760718.152683:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689796689219 time 689839365639 state 0x0 ref 1
00000100:00100000:1.0:1789760718.152698:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520878208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760718.152764:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19931136, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:1.0:1789760718.152776:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.152795:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:1.0:1789760718.152800:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760718.152808:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.152826:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760718.182885:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972186 is committed
00002000:00010000:2.0:1789760718.183002:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19931136 -> 19935232
00010000:00010000:2.0:1789760718.183124:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.183140:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.183149:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.183158:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760718.183164:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.183173:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.183365:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.183381:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60b7ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19931136->19935231] (req 19931136->19935231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760718.183586:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520878208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30876us (31162us total) trans 4294972186 rc 0/0
00000100:00100000:2.0:1789760718.183600:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4899
00000100:00100000:2.0:1789760718.183612:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689796689219 time 689839365639 state 0x2 ref 0
00000100:00100000:1.0:1789760718.187082:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760718.187200:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520878336
00000100:00100000:0.0:1789760718.187215:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520878336
00000100:00100000:0.0:1789760718.187286:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689796689219 time 689839365639 state 0x0 ref 1
00000100:00100000:0.0:1789760718.187307:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689839626055 time 689839365639 state 0x1 ref 1
00000100:00100000:1.0:1789760718.187621:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689839626055 time 689874300748 state 0x0 ref 1
00000100:00100000:1.0:1789760718.187638:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760718.187706:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19935232, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:1.0:1789760718.187718:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.187744:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:1.0:1789760718.187750:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760718.187758:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.187775:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760718.215953:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972187 is committed
00002000:00010000:3.0:1789760718.216016:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19935232 -> 19939328
00010000:00010000:3.0:1789760718.216036:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.216052:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.216062:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.216072:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760718.216078:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.216089:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.216115:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.216124:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60b7f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19935232->19939327] (req 19935232->19939327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760718.216246:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28605us (29172us total) trans 4294972187 rc 0/0
00000100:00100000:3.0:1789760718.216259:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4900
00000100:00100000:3.0:1789760718.216270:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689839626055 time 689874300748 state 0x2 ref 0
00000100:00100000:2.0:1789760718.223419:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760718.225384:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520878464
00000100:00100000:0.0:1789760718.225409:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520878464
00000100:00100000:0.0:1789760718.225505:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689839626055 time 689874300748 state 0x0 ref 1
00000100:00100000:0.0:1789760718.225526:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689874561164 time 689874300748 state 0x1 ref 1
00000100:00100000:0.0:1789760718.225618:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689874561164 time 689912299511 state 0x0 ref 1
00000100:00100000:0.0:1789760718.225636:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760718.225703:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19939328, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:0.0:1789760718.225715:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.225734:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:0.0:1789760718.225740:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760718.225747:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.225763:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760718.268776:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19939328 -> 19943424
00010000:00010000:3.0:1789760718.268806:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.268821:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.268832:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.268840:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760718.268846:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.268856:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.268882:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.268895:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b7fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19939328->19943423] (req 19939328->19943423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760718.269033:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520878464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43393us (45624us total) trans 4294972188 rc 0/0
00000100:00100000:3.0:1789760718.269046:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4901
00000100:00100000:3.0:1789760718.269058:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689874561164 time 689912299511 state 0x2 ref 0
00000001:00080000:1.0:1789760718.269151:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972188 is committed
00000100:00100000:0.0:1789760718.272142:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760718.272256:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520878592
00000100:00100000:2.0:1789760718.272270:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520878592
00000100:00100000:2.0:1789760718.272415:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689874561164 time 689912299511 state 0x0 ref 1
00000100:00100000:2.0:1789760718.272435:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689912559927 time 689912299511 state 0x1 ref 1
00000100:00100000:2.0:1789760718.272622:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689912559927 time 689959302848 state 0x0 ref 1
00000100:00100000:2.0:1789760718.272639:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760718.272709:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19943424, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:2.0:1789760718.272720:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.272740:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:2.0:1789760718.272746:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760718.272754:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.272772:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760718.303295:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19943424 -> 19947520
00010000:00010000:0.0:1789760718.303348:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.303364:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.303374:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.303383:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760718.303389:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.303399:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.303422:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.303430:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60b804 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19943424->19947519] (req 19943424->19947519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760718.303563:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520878592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30921us (31430us total) trans 4294972189 rc 0/0
00000100:00100000:0.0:1789760718.303577:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4902
00000100:00100000:0.0:1789760718.303589:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689912559927 time 689959302848 state 0x2 ref 0
00000100:00100000:0.0:1789760718.306925:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760718.307016:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520878720
00000100:00100000:3.0:1789760718.307029:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520878720
00000100:00100000:3.0:1789760718.307104:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689912559927 time 689959302848 state 0x0 ref 1
00000100:00100000:3.0:1789760718.307123:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689959563264 time 689959302848 state 0x1 ref 1
00000100:00100000:3.0:1789760718.307160:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689959563264 time 689993841883 state 0x0 ref 1
00000100:00100000:3.0:1789760718.307175:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520878720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.307238:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19947520, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:3.0:1789760718.307249:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.307269:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=689s v=(0 0)
00010000:00010000:3.0:1789760718.307274:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.307282:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.307304:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760718.311663:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972189 is committed
00000001:00080000:0.0:1789760718.326233:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972190 is committed
00002000:00010000:3.0:1789760718.326401:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19947520 -> 19951616
00010000:00010000:3.0:1789760718.326421:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.326438:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.326481:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.326491:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760718.326497:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.326507:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.326532:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.326538:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b80b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19947520->19951615] (req 19947520->19951615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760718.326671:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 19492us (19765us total) trans 4294972190 rc 0/0
00000100:00100000:3.0:1789760718.326685:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4903
00000100:00100000:3.0:1789760718.326696:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689959563264 time 689993841883 state 0x2 ref 0
00000100:00100000:2.0:1789760718.329218:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760718.329293:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520878848
00000100:00100000:3.0:1789760718.329305:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520878848
00000100:00100000:3.0:1789760718.329462:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689959563264 time 689993841883 state 0x0 ref 1
00000100:00100000:3.0:1789760718.329481:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689994102299 time 689993841883 state 0x1 ref 1
00000100:00100000:3.0:1789760718.329506:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689994102299 time 690016188481 state 0x0 ref 1
00000100:00100000:3.0:1789760718.329520:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.329591:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19951616, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:3.0:1789760718.329601:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.329621:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:3.0:1789760718.329625:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.329633:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.329649:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760718.357695:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972191 is committed
00002000:00010000:3.0:1789760718.357787:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19951616 -> 19955712
00010000:00010000:3.0:1789760718.357807:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.357822:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.357833:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.357842:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760718.357848:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.357858:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.357882:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.357891:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b812 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19951616->19955711] (req 19951616->19955711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760718.358020:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520878848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28495us (28809us total) trans 4294972191 rc 0/0
00000100:00100000:3.0:1789760718.358032:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4904
00000100:00100000:3.0:1789760718.358045:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689994102299 time 690016188481 state 0x2 ref 0
00000100:00100000:3.0:1789760718.360936:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760718.360988:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520878976
00000100:00100000:3.0:1789760718.361000:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520878976
00000100:00100000:3.0:1789760718.361073:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 689994102299 time 690016188481 state 0x0 ref 1
00000100:00100000:3.0:1789760718.361095:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690016448897 time 690016188481 state 0x1 ref 1
00000100:00100000:3.0:1789760718.361125:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690016448897 time 690047807472 state 0x0 ref 1
00000100:00100000:3.0:1789760718.361139:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520878976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.361199:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19955712, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:3.0:1789760718.361210:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.361228:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:3.0:1789760718.361233:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.361240:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.361257:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.394368:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760718.396166:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972192 is committed
00002000:00010000:0.0:1789760718.396262:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19955712 -> 19959808
00010000:00010000:0.0:1789760718.396281:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.396295:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.396304:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.396311:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760718.396335:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.396346:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.396368:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.396374:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b819 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19955712->19959807] (req 19955712->19959807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760718.396647:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520878976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35503us (35727us total) trans 4294972192 rc 0/0
00000100:00100000:0.0:1789760718.396662:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4905
00000100:00100000:0.0:1789760718.396675:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690016448897 time 690047807472 state 0x2 ref 0
00000100:00100000:3.0:1789760718.399276:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760718.399465:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520879104
00000100:00100000:0.0:1789760718.399479:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520879104
00000100:00100000:0.0:1789760718.399687:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690016448897 time 690047807472 state 0x0 ref 1
00000100:00100000:0.0:1789760718.399890:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690048067888 time 690047807472 state 0x1 ref 1
00000100:00100000:0.0:1789760718.399986:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690048067888 time 690086667033 state 0x0 ref 1
00000100:00100000:0.0:1789760718.400003:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520879104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760718.400069:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19959808, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:0.0:1789760718.400080:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.400101:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:0.0:1789760718.400107:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760718.400116:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.400133:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760718.460288:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972193 is committed
00002000:00010000:2.0:1789760718.460428:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19959808 -> 19963904
00010000:00010000:2.0:1789760718.460450:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.460466:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.460476:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.460485:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760718.460492:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.460503:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.460602:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.460609:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b820 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19959808->19963903] (req 19959808->19963903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760718.460732:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520879104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60723us (61459us total) trans 4294972193 rc 0/0
00000100:00100000:2.0:1789760718.460746:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4906
00000100:00100000:2.0:1789760718.460759:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690048067888 time 690086667033 state 0x2 ref 0
00000100:00100000:2.0:1789760718.466613:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760718.466921:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520879232
00000100:00100000:3.0:1789760718.466934:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520879232
00000100:00100000:3.0:1789760718.467189:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690048067888 time 690086667033 state 0x0 ref 1
00000100:00100000:3.0:1789760718.467209:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690086927449 time 690086667033 state 0x1 ref 1
00000100:00100000:3.0:1789760718.467283:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690086927449 time 690153964236 state 0x0 ref 1
00000100:00100000:3.0:1789760718.467298:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520879232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.467392:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19963904, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:3.0:1789760718.467404:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.467423:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:3.0:1789760718.467428:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.467435:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.467459:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760718.508701:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19963904 -> 19968000
00000001:00080000:1.0:1789760718.508720:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972194 is committed
00010000:00010000:0.0:1789760718.508728:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.508746:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.508756:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.508766:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760718.508771:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.508782:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.508807:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.508814:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b827 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19963904->19967999] (req 19963904->19967999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760718.509105:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520879232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41802us (42496us total) trans 4294972194 rc 0/0
00000100:00100000:0.0:1789760718.509118:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4907
00000100:00100000:0.0:1789760718.509130:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690086927449 time 690153964236 state 0x2 ref 0
00000100:00100000:3.0:1789760718.512349:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760718.512584:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520879360
00000100:00100000:1.0:1789760718.512605:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520879360
00000100:00100000:1.0:1789760718.512676:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690086927449 time 690153964236 state 0x0 ref 1
00000100:00100000:1.0:1789760718.512696:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690154224652 time 690153964236 state 0x1 ref 1
00000100:00100000:1.0:1789760718.512764:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690154224652 time 690199445318 state 0x0 ref 1
00000100:00100000:1.0:1789760718.512778:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520879360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760718.512845:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19968000, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:1.0:1789760718.512856:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.512882:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:1.0:1789760718.512888:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760718.512896:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.512923:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760718.556077:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972195 is committed
00002000:00010000:1.0:1789760718.556175:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19968000 -> 19972096
00010000:00010000:1.0:1789760718.556194:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.556210:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.556221:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.556229:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760718.556235:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.556247:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.556277:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.556287:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60b82e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19968000->19972095] (req 19968000->19972095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760718.556463:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520879360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43679us (44153us total) trans 4294972195 rc 0/0
00000100:00100000:1.0:1789760718.556475:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4908
00000100:00100000:1.0:1789760718.556488:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690154224652 time 690199445318 state 0x2 ref 0
00000100:00100000:3.0:1789760718.559981:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760718.560099:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520879488
00000100:00100000:0.0:1789760718.560116:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520879488
00000100:00100000:0.0:1789760718.560193:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690154224652 time 690199445318 state 0x0 ref 1
00000100:00100000:0.0:1789760718.560212:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690199705734 time 690199445318 state 0x1 ref 1
00000100:00100000:0.0:1789760718.560249:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690199705734 time 690246931323 state 0x0 ref 1
00000100:00100000:0.0:1789760718.560265:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520879488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760718.560617:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19972096, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:0.0:1789760718.560631:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.560650:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:0.0:1789760718.560656:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760718.560664:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.560681:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760718.590636:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972196 is committed
00002000:00010000:0.0:1789760718.590667:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19972096 -> 19976192
00010000:00010000:0.0:1789760718.590686:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.590703:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.590720:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.590728:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760718.590733:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.590743:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.590765:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760718.590772:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b835 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19972096->19976191] (req 19972096->19976191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760718.590897:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520879488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30627us (30924us total) trans 4294972196 rc 0/0
00000100:00100000:0.0:1789760718.590921:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4909
00000100:00100000:0.0:1789760718.590933:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690199705734 time 690246931323 state 0x2 ref 0
00000100:00100000:2.0:1789760718.594138:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760718.594465:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520879616
00000100:00100000:3.0:1789760718.594478:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520879616
00000100:00100000:3.0:1789760718.594685:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690199705734 time 690246931323 state 0x0 ref 1
00000100:00100000:3.0:1789760718.594708:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690247191739 time 690246931323 state 0x1 ref 1
00000100:00100000:3.0:1789760718.594742:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690247191739 time 690281425090 state 0x0 ref 1
00000100:00100000:3.0:1789760718.594756:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520879616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.594813:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19976192, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:3.0:1789760718.594823:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.594842:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:3.0:1789760718.594846:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.594854:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.594869:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760718.643940:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972197 is committed
00002000:00010000:3.0:1789760718.644072:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19976192 -> 19980288
00010000:00010000:3.0:1789760718.644093:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.644109:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.644120:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.644134:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760718.644140:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.644152:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.644176:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.644185:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b83c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19976192->19980287] (req 19976192->19980287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760718.644356:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520879616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49555us (50183us total) trans 4294972197 rc 0/0
00000100:00100000:3.0:1789760718.644369:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4910
00000100:00100000:3.0:1789760718.644382:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690247191739 time 690281425090 state 0x2 ref 0
00000100:00100000:3.0:1789760718.655054:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760718.655197:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520879744
00000100:00100000:0.0:1789760718.655211:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520879744
00000100:00100000:0.0:1789760718.655284:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690247191739 time 690281425090 state 0x0 ref 1
00000100:00100000:0.0:1789760718.655303:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690281685506 time 690281425090 state 0x1 ref 1
00000100:00100000:0.0:1789760718.655383:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690281685506 time 690342064637 state 0x0 ref 1
00000100:00100000:0.0:1789760718.655399:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520879744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760718.655751:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19980288, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:1.0:1789760718.655764:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.655785:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:1.0:1789760718.655791:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760718.655799:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.655815:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760718.700718:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19980288 -> 19984384
00010000:00010000:1.0:1789760718.700748:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.700765:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.700776:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.700785:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760718.700791:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.700803:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.700828:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.700838:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60b843 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19980288->19984383] (req 19980288->19984383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760718.700969:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520879744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45566us (45923us total) trans 4294972198 rc 0/0
00000100:00100000:1.0:1789760718.700982:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4911
00000100:00100000:1.0:1789760718.700994:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690281685506 time 690342064637 state 0x2 ref 0
00000001:00080000:1.0:1789760718.701058:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972198 is committed
00000100:00100000:1.0:1789760718.703997:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760718.704091:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520879872
00000100:00100000:2.0:1789760718.704108:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520879872
00000100:00100000:2.0:1789760718.704178:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690281685506 time 690342064637 state 0x0 ref 1
00000100:00100000:2.0:1789760718.704197:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690342325053 time 690342064637 state 0x1 ref 1
00000100:00100000:2.0:1789760718.704232:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690342325053 time 690390914021 state 0x0 ref 1
00000100:00100000:2.0:1789760718.704246:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520879872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760718.704353:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19984384, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:2.0:1789760718.704364:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.704382:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:2.0:1789760718.704387:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760718.704395:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760718.704416:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760718.735232:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19984384 -> 19988480
00010000:00010000:3.0:1789760718.735256:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.735271:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.735288:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.735296:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760718.735301:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.735335:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.735358:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.735365:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60b84a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19984384->19988479] (req 19984384->19988479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760718.735478:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520879872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31229us (31487us total) trans 4294972199 rc 0/0
00000100:00100000:3.0:1789760718.735490:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4912
00000100:00100000:3.0:1789760718.735501:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690342325053 time 690390914021 state 0x2 ref 0
00000001:00080000:1.0:1789760718.735622:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972199 is committed
00000100:00100000:2.0:1789760718.741690:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760718.741850:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520880000
00000100:00100000:3.0:1789760718.741864:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520880000
00000100:00100000:3.0:1789760718.741959:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690342325053 time 690390914021 state 0x0 ref 1
00000100:00100000:3.0:1789760718.741978:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690391174437 time 690390914021 state 0x1 ref 1
00000100:00100000:3.0:1789760718.742017:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690391174437 time 690428698533 state 0x0 ref 1
00000100:00100000:3.0:1789760718.742032:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520880000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.742094:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19988480, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:3.0:1789760718.742105:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.742125:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:3.0:1789760718.742131:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.742138:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.742161:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760718.786993:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972200 is committed
00002000:00010000:3.0:1789760718.787147:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19988480 -> 19992576
00010000:00010000:3.0:1789760718.787168:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.787184:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.787195:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.787205:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760718.787212:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.787223:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.787247:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.787256:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b851 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19988480->19992575] (req 19988480->19992575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760718.787671:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520880000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45633us (45988us total) trans 4294972200 rc 0/0
00000100:00100000:3.0:1789760718.787685:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4913
00000100:00100000:3.0:1789760718.787698:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690391174437 time 690428698533 state 0x2 ref 0
00000100:00100000:0.0:1789760718.790630:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760718.791084:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520880128
00000100:00100000:3.0:1789760718.791098:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520880128
00000100:00100000:3.0:1789760718.791177:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690391174437 time 690428698533 state 0x0 ref 1
00000100:00100000:3.0:1789760718.791197:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690428958949 time 690428698533 state 0x1 ref 1
00000100:00100000:3.0:1789760718.791288:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690428958949 time 690477968945 state 0x0 ref 1
00000100:00100000:3.0:1789760718.791304:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760718.791414:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19992576, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:3.0:1789760718.791427:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.791457:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:3.0:1789760718.791463:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760718.791471:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.791488:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760718.904066:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972201 is committed
00002000:00010000:3.0:1789760718.904216:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19992576 -> 19996672
00010000:00010000:3.0:1789760718.904235:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.904249:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.904260:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.904270:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760718.904276:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.904287:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.904357:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760718.904368:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b858 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19992576->19996671] (req 19992576->19996671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760718.904503:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 113194us (113877us total) trans 4294972201 rc 0/0
00000100:00100000:3.0:1789760718.904517:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4914
00000100:00100000:3.0:1789760718.904529:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690428958949 time 690477968945 state 0x2 ref 0
00000100:00100000:0.0:1789760718.919895:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760718.920894:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520880256
00000100:00100000:1.0:1789760718.920917:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520880256
00000100:00100000:1.0:1789760718.920995:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690428958949 time 690477968945 state 0x0 ref 1
00000100:00100000:1.0:1789760718.921016:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690478229361 time 690477968945 state 0x1 ref 1
00000100:00100000:1.0:1789760718.921053:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690478229361 time 690607734930 state 0x0 ref 1
00000100:00100000:1.0:1789760718.921067:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760718.921132:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 19996672, mtime: 0x6aad94cf, atime: 0x0, ctime: 0x6aad94cf, blocks: 0xa007
00010000:00010000:1.0:1789760718.921144:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.921164:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:1.0:1789760718.921169:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760718.921177:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760718.921193:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760719.013293:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972202 is committed
00002000:00010000:3.0:1789760719.015703:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 19996672 -> 20000768
00002000:00010000:3.0:1789760719.015716:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760719 -> 1789760720
00002000:00010000:3.0:1789760719.015719:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760719 -> 1789760720
00010000:00010000:3.0:1789760719.015737:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.015753:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.015762:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.015771:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760719.015777:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.015787:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.015811:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.015820:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b85f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [19996672->20000767] (req 19996672->20000767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760719.015969:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 94897us (96084us total) trans 4294972202 rc 0/0
00000100:00100000:3.0:1789760719.015982:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4915
00000100:00100000:3.0:1789760719.015994:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690478229361 time 690607734930 state 0x2 ref 0
00000100:00100000:0.0:1789760719.018603:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760719.018761:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520880384
00000100:00100000:3.0:1789760719.018773:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520880384
00000100:00100000:3.0:1789760719.018829:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690478229361 time 690607734930 state 0x0 ref 1
00000100:00100000:3.0:1789760719.018844:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690607995346 time 690607734930 state 0x1 ref 1
00000100:00100000:3.0:1789760719.018875:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690607995346 time 690705557587 state 0x0 ref 1
00000100:00100000:3.0:1789760719.018888:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520880384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760719.018956:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20000768, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:3.0:1789760719.018966:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.018983:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:3.0:1789760719.018987:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760719.018994:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.019007:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760719.123801:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20000768 -> 20004864
00010000:00010000:0.0:1789760719.123831:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.123846:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.123856:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.123864:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760719.123870:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.123881:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.123917:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.123927:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b866 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20000768->20004863] (req 20000768->20004863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760719.124054:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520880384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 105159us (105451us total) trans 4294972203 rc 0/0
00000100:00100000:0.0:1789760719.124067:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4916
00000100:00100000:0.0:1789760719.124079:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690607995346 time 690705557587 state 0x2 ref 0
00000001:00080000:0.0:1789760719.124131:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972203 is committed
00000100:00100000:0.0:1789760719.133133:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760719.133247:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520880512
00000100:00100000:3.0:1789760719.133261:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520880512
00000100:00100000:3.0:1789760719.133385:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690607995346 time 690705557587 state 0x0 ref 1
00000100:00100000:3.0:1789760719.133405:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690705818003 time 690705557587 state 0x1 ref 1
00000100:00100000:3.0:1789760719.133594:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690705818003 time 690820219056 state 0x0 ref 1
00000100:00100000:3.0:1789760719.133612:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760719.133682:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20004864, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:3.0:1789760719.133694:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.133712:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:3.0:1789760719.133718:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760719.133726:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.133747:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760719.273050:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972204 is committed
00002000:00010000:3.0:1789760719.273225:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20004864 -> 20008960
00010000:00010000:3.0:1789760719.273248:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.273262:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.273272:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.273281:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760719.273287:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.273297:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.273351:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.273361:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b86d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20004864->20008959] (req 20004864->20008959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760719.273508:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 139892us (140381us total) trans 4294972204 rc 0/0
00000100:00100000:3.0:1789760719.273522:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4917
00000100:00100000:3.0:1789760719.273546:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690705818003 time 690820219056 state 0x2 ref 0
00000100:00100000:3.0:1789760719.288819:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760719.291854:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520880640
00000100:00100000:0.0:1789760719.291875:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520880640
00000100:00100000:0.0:1789760719.291977:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690705818003 time 690820219056 state 0x0 ref 1
00000100:00100000:0.0:1789760719.291998:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690820479472 time 690820219056 state 0x1 ref 1
00000100:00100000:0.0:1789760719.292091:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690820479472 time 690978772645 state 0x0 ref 1
00000100:00100000:0.0:1789760719.292106:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520880640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760719.292176:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20008960, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:0.0:1789760719.292186:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.292206:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=690s v=(0 0)
00010000:00010000:0.0:1789760719.292213:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760719.292220:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.292237:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760719.364993:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972205 is committed
00002000:00010000:3.0:1789760719.365005:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20008960 -> 20013056
00010000:00010000:3.0:1789760719.365024:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.365039:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.365050:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.365059:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760719.365064:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.365074:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.365100:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.365113:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b874 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20008960->20013055] (req 20008960->20013055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760719.365237:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520880640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73126us (76425us total) trans 4294972205 rc 0/0
00000100:00100000:3.0:1789760719.365249:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4918
00000100:00100000:3.0:1789760719.365264:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690820479472 time 690978772645 state 0x2 ref 0
00000100:00100000:0.0:1789760719.372243:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760719.375748:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520880768
00000100:00100000:1.0:1789760719.375772:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520880768
00000100:00100000:0.0:1789760719.375955:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690820479472 time 690978772645 state 0x0 ref 1
00000100:00100000:0.0:1789760719.375977:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690979033061 time 690978772645 state 0x1 ref 1
00000100:00100000:0.0:1789760719.376017:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690979033061 time 691062698630 state 0x0 ref 1
00000100:00100000:0.0:1789760719.376038:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760719.376109:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20013056, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:0.0:1789760719.376120:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.376141:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:0.0:1789760719.376146:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760719.376154:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.376171:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760719.420144:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760719.463015:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972206 is committed
00002000:00010000:1.0:1789760719.463156:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20013056 -> 20017152
00010000:00010000:1.0:1789760719.463189:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.463204:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.463214:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.463223:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760719.463228:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.463239:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.463265:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.463273:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60b87b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20013056->20017151] (req 20013056->20017151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760719.463447:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 87396us (91203us total) trans 4294972206 rc 0/0
00000100:00100000:1.0:1789760719.463460:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4919
00000100:00100000:1.0:1789760719.463481:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690979033061 time 691062698630 state 0x2 ref 0
00000100:00100000:0.0:1789760719.469681:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760719.469776:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520880896
00000100:00100000:2.0:1789760719.469790:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520880896
00000100:00100000:2.0:1789760719.469868:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 690979033061 time 691062698630 state 0x0 ref 1
00000100:00100000:2.0:1789760719.469887:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691062959046 time 691062698630 state 0x1 ref 1
00000100:00100000:2.0:1789760719.469928:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691062959046 time 691156610715 state 0x0 ref 1
00000100:00100000:2.0:1789760719.469943:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760719.470010:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20017152, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:2.0:1789760719.470022:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760719.470042:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:2.0:1789760719.470047:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760719.470055:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760719.470072:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760719.486434:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548743040:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1789760719.486552:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760719.486658:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548743040
00000100:00100000:0.0:1789760719.486668:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548743040
00000100:00100000:0.0:1789760719.486730:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409
00000100:00100000:0.0:1789760719.486741:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548743040:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1789760719.486796:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:0.0:1789760719.486852:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548743040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (299us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760719.486859:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409
00000100:00100000:0.0:1789760719.487152:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548743040:0@lo:41:osp-pre-0-1.0
00000001:00080000:1.0:1789760719.579345:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972207 is committed
00002000:00010000:0.0:1789760719.579490:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20017152 -> 20021248
00010000:00010000:0.0:1789760719.579511:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.579528:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.579539:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.579548:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760719.579553:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.579564:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.579590:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.579599:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60b882 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20017152->20021247] (req 20017152->20021247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760719.579765:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520880896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 109818us (110093us total) trans 4294972207 rc 0/0
00000100:00100000:0.0:1789760719.579779:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4920
00000100:00100000:0.0:1789760719.579791:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691062959046 time 691156610715 state 0x2 ref 0
00000100:00100000:0.0:1789760719.582829:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760719.582913:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520881024
00000100:00100000:3.0:1789760719.582927:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520881024
00000100:00100000:3.0:1789760719.583000:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691062959046 time 691156610715 state 0x0 ref 1
00000100:00100000:3.0:1789760719.583019:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691156871131 time 691156610715 state 0x1 ref 1
00000100:00100000:3.0:1789760719.583109:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691156871131 time 691269790109 state 0x0 ref 1
00000100:00100000:3.0:1789760719.583125:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520881024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760719.583193:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20021248, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:3.0:1789760719.583203:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.583223:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:3.0:1789760719.583229:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760719.583236:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.583258:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760719.623216:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972208 is committed
00002000:00010000:1.0:1789760719.623376:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20021248 -> 20025344
00010000:00010000:1.0:1789760719.623396:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.623412:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.623421:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.623428:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760719.623434:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.623444:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.623480:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.623489:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b889 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20021248->20025343] (req 20021248->20025343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760719.623663:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520881024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40535us (40838us total) trans 4294972208 rc 0/0
00000100:00100000:1.0:1789760719.623679:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4921
00000100:00100000:1.0:1789760719.623691:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691156871131 time 691269790109 state 0x2 ref 0
00000100:00100000:1.0:1789760719.627279:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760719.627399:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520881152
00000100:00100000:0.0:1789760719.627412:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520881152
00000100:00100000:0.0:1789760719.627585:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691156871131 time 691269790109 state 0x0 ref 1
00000100:00100000:0.0:1789760719.627606:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691270050525 time 691269790109 state 0x1 ref 1
00000100:00100000:0.0:1789760719.627644:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691270050525 time 691314326715 state 0x0 ref 1
00000100:00100000:0.0:1789760719.627659:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520881152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760719.627718:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20025344, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:0.0:1789760719.627731:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.627750:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:0.0:1789760719.627755:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760719.627762:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.627779:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760719.661271:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972209 is committed
00002000:00010000:1.0:1789760719.661523:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20025344 -> 20029440
00010000:00010000:1.0:1789760719.661602:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.661617:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.661626:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.661636:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760719.661642:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.661652:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.661675:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.661683:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60b890 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20025344->20029439] (req 20025344->20029439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760719.661808:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520881152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34144us (34532us total) trans 4294972209 rc 0/0
00000100:00100000:1.0:1789760719.661820:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4922
00000100:00100000:1.0:1789760719.661832:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691270050525 time 691314326715 state 0x2 ref 0
00000100:00100000:3.0:1789760719.666054:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760719.666211:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520881280
00000100:00100000:1.0:1789760719.666224:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520881280
00000100:00100000:1.0:1789760719.666297:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691270050525 time 691314326715 state 0x0 ref 1
00000100:00100000:1.0:1789760719.666357:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691314587131 time 691314326715 state 0x1 ref 1
00000100:00100000:1.0:1789760719.666393:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691314587131 time 691353075266 state 0x0 ref 1
00000100:00100000:1.0:1789760719.666407:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520881280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760719.666475:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20029440, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:1.0:1789760719.666486:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.666506:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:1.0:1789760719.666511:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760719.666519:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.666544:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760719.709599:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972210 is committed
00002000:00010000:1.0:1789760719.710285:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20029440 -> 20033536
00010000:00010000:1.0:1789760719.710307:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.710345:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.710356:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.710364:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760719.710369:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.710379:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.710406:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.710416:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b897 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20029440->20033535] (req 20029440->20033535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760719.710555:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520881280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44142us (44510us total) trans 4294972210 rc 0/0
00000100:00100000:1.0:1789760719.710571:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4923
00000100:00100000:1.0:1789760719.710584:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691314587131 time 691353075266 state 0x2 ref 0
00000100:00100000:3.0:1789760719.713816:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760719.713953:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520881408
00000100:00100000:2.0:1789760719.713966:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520881408
00000100:00100000:2.0:1789760719.714040:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691314587131 time 691353075266 state 0x0 ref 1
00000100:00100000:2.0:1789760719.714059:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691353335682 time 691353075266 state 0x1 ref 1
00000100:00100000:2.0:1789760719.714098:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691353335682 time 691400779958 state 0x0 ref 1
00000100:00100000:2.0:1789760719.714112:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520881408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760719.714177:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20033536, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:2.0:1789760719.714189:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760719.714210:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:2.0:1789760719.714215:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760719.714224:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760719.714240:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760719.752430:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972211 is committed
00002000:00010000:0.0:1789760719.752614:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20033536 -> 20037632
00010000:00010000:0.0:1789760719.752633:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.752648:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.752658:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.752666:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760719.752672:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.752682:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.752711:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.752718:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60b89e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20033536->20037631] (req 20033536->20037631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760719.752850:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520881408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38733us (39043us total) trans 4294972211 rc 0/0
00000100:00100000:0.0:1789760719.752863:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4924
00000100:00100000:0.0:1789760719.752875:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691353335682 time 691400779958 state 0x2 ref 0
00000100:00100000:0.0:1789760719.759151:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760719.761468:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520881536
00000100:00100000:3.0:1789760719.761481:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520881536
00000100:00100000:3.0:1789760719.761545:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691353335682 time 691400779958 state 0x0 ref 1
00000100:00100000:3.0:1789760719.761561:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691401040374 time 691400779958 state 0x1 ref 1
00000100:00100000:3.0:1789760719.761587:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691401040374 time 691448269745 state 0x0 ref 1
00000100:00100000:3.0:1789760719.761599:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520881536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760719.761660:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20037632, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:3.0:1789760719.761670:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.761686:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:3.0:1789760719.761691:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760719.761698:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.761711:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760719.827824:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972212 is committed
00002000:00010000:3.0:1789760719.828295:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20037632 -> 20041728
00010000:00010000:3.0:1789760719.828340:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.828353:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.828361:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.828369:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760719.828373:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.828384:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.828402:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.828409:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20037632->20041727] (req 20037632->20041727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760719.828572:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520881536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66970us (69431us total) trans 4294972212 rc 0/0
00000100:00100000:3.0:1789760719.828816:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4925
00000100:00100000:3.0:1789760719.828827:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691401040374 time 691448269745 state 0x2 ref 0
00000100:00100000:3.0:1789760719.847775:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760719.848267:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520881664
00000100:00100000:1.0:1789760719.848276:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520881664
00000100:00100000:1.0:1789760719.848354:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691401040374 time 691448269745 state 0x0 ref 1
00000100:00100000:1.0:1789760719.848367:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691448530161 time 691448269745 state 0x1 ref 1
00000100:00100000:1.0:1789760719.848396:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691448530161 time 691535079344 state 0x0 ref 1
00000100:00100000:1.0:1789760719.848409:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520881664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760719.848456:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20041728, mtime: 0x6aad94d0, atime: 0x0, ctime: 0x6aad94d0, blocks: 0xa007
00010000:00010000:1.0:1789760719.848465:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.848480:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:1.0:1789760719.848485:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760719.848491:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760719.848505:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760719.913481:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20041728 -> 20045824
00002000:00010000:0.0:1789760719.913489:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760720 -> 1789760721
00002000:00010000:0.0:1789760719.913492:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760720 -> 1789760721
00010000:00010000:0.0:1789760719.913504:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.913516:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.913524:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.913535:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760719.913539:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.913548:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.913567:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760719.913574:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b8ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20041728->20045823] (req 20041728->20045823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760719.913666:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520881664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65255us (65896us total) trans 4294972213 rc 0/0
00000100:00100000:0.0:1789760719.913675:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4926
00000100:00100000:0.0:1789760719.913684:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691448530161 time 691535079344 state 0x2 ref 0
00000001:00080000:0.0:1789760719.913780:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972213 is committed
00000100:00100000:0.0:1789760719.920675:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760719.920803:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520881792
00000100:00100000:3.0:1789760719.920812:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520881792
00000100:00100000:3.0:1789760719.920863:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691448530161 time 691535079344 state 0x0 ref 1
00000100:00100000:3.0:1789760719.920877:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691535339760 time 691535079344 state 0x1 ref 1
00000100:00100000:3.0:1789760719.920917:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691535339760 time 691607599510 state 0x0 ref 1
00000100:00100000:3.0:1789760719.920929:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520881792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760719.920975:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20045824, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:3.0:1789760719.920984:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.921000:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:3.0:1789760719.921004:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760719.921010:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.921023:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760719.991192:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972214 is committed
00002000:00010000:3.0:1789760719.991375:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20045824 -> 20049920
00010000:00010000:3.0:1789760719.991390:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.991402:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.991411:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.991418:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760719.991422:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.991443:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.991463:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760719.991471:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b8b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20045824->20049919] (req 20045824->20049919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760719.991573:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520881792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70642us (70902us total) trans 4294972214 rc 0/0
00000100:00100000:3.0:1789760719.991583:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4927
00000100:00100000:3.0:1789760719.991593:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691535339760 time 691607599510 state 0x2 ref 0
00000100:00100000:0.0:1789760719.996986:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760719.997077:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520881920
00000100:00100000:2.0:1789760719.997087:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520881920
00000100:00100000:2.0:1789760719.997141:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691535339760 time 691607599510 state 0x0 ref 1
00000100:00100000:2.0:1789760719.997156:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691607859926 time 691607599510 state 0x1 ref 1
00000100:00100000:2.0:1789760719.997186:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691607859926 time 691683868554 state 0x0 ref 1
00000100:00100000:2.0:1789760719.997199:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520881920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760719.997243:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20049920, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:2.0:1789760719.997253:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760719.997268:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:2.0:1789760719.997272:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760719.997278:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760719.997292:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760720.073098:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20049920 -> 20054016
00010000:00010000:2.0:1789760720.073119:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.073133:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.073147:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.073154:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760720.073159:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.073167:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.073187:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.073195:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20049920->20054015] (req 20049920->20054015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760720.073290:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520881920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76088us (76308us total) trans 4294972215 rc 0/0
00000100:00100000:2.0:1789760720.073299:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4928
00000100:00100000:2.0:1789760720.073309:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691607859926 time 691683868554 state 0x2 ref 0
00000001:00080000:0.0:1789760720.073436:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972215 is committed
00000100:00100000:0.0:1789760720.080856:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760720.081103:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520882048
00000100:00100000:1.0:1789760720.081114:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520882048
00000100:00100000:1.0:1789760720.081180:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691607859926 time 691683868554 state 0x0 ref 1
00000100:00100000:1.0:1789760720.081197:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691684128970 time 691683868554 state 0x1 ref 1
00000100:00100000:1.0:1789760720.081230:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691684128970 time 691767913162 state 0x0 ref 1
00000100:00100000:1.0:1789760720.081243:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520882048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760720.081288:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20054016, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:1.0:1789760720.081297:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.081345:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:1.0:1789760720.081350:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760720.081357:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.081371:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760720.081972:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:1.0:1789760720.119072:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20054016 -> 20058112
00010000:00010000:1.0:1789760720.119091:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.119103:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.119112:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.119119:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760720.119124:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.119133:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.119152:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.119160:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b8c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20054016->20058111] (req 20054016->20058111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760720.119242:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520882048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37997us (38391us total) trans 4294972216 rc 0/0
00000100:00100000:1.0:1789760720.119254:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4929
00000100:00100000:1.0:1789760720.119264:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691684128970 time 691767913162 state 0x2 ref 0
00000001:00080000:3.0:1789760720.119362:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972216 is committed
00000100:00100000:3.0:1789760720.123670:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760720.123791:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520882176
00000100:00100000:0.0:1789760720.123802:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520882176
00000100:00100000:0.0:1789760720.123850:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691684128970 time 691767913162 state 0x0 ref 1
00000100:00100000:0.0:1789760720.123866:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691768173578 time 691767913162 state 0x1 ref 1
00000100:00100000:0.0:1789760720.123896:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691768173578 time 691810578416 state 0x0 ref 1
00000100:00100000:0.0:1789760720.123917:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520882176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760720.123969:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20058112, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:0.0:1789760720.123978:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.123993:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:0.0:1789760720.123998:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760720.124004:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.124017:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760720.166393:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972217 is committed
00002000:00010000:0.0:1789760720.166614:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20058112 -> 20062208
00010000:00010000:0.0:1789760720.166697:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.166710:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.166726:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.166734:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760720.166740:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.166749:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.166769:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.166778:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60b8c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20058112->20062207] (req 20058112->20062207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760720.166914:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520882176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42993us (43249us total) trans 4294972217 rc 0/0
00000100:00100000:0.0:1789760720.166926:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4930
00000100:00100000:0.0:1789760720.167003:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691768173578 time 691810578416 state 0x2 ref 0
00000100:00100000:1.0:1789760720.174745:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760720.174913:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520882304
00000100:00100000:2.0:1789760720.174923:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520882304
00000100:00100000:2.0:1789760720.175084:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691768173578 time 691810578416 state 0x0 ref 1
00000100:00100000:2.0:1789760720.175103:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691810838832 time 691810578416 state 0x1 ref 1
00000100:00100000:2.0:1789760720.175131:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691810838832 time 691861814060 state 0x0 ref 1
00000100:00100000:2.0:1789760720.175143:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520882304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760720.175190:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20062208, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:2.0:1789760720.175200:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.175215:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:2.0:1789760720.175219:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760720.175226:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.175239:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760720.233725:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20062208 -> 20066304
00010000:00010000:2.0:1789760720.233745:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.233758:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.233768:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.233781:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760720.233786:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.233797:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.233815:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.233824:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60b8cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20062208->20066303] (req 20062208->20066303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760720.233927:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520882304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58780us (59185us total) trans 4294972218 rc 0/0
00000100:00100000:2.0:1789760720.233938:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4931
00000100:00100000:2.0:1789760720.233948:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691810838832 time 691861814060 state 0x2 ref 0
00000001:00080000:2.0:1789760720.234125:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972218 is committed
00000100:00100000:1.0:1789760720.238758:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760720.238850:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520882432
00000100:00100000:2.0:1789760720.238859:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520882432
00000100:00100000:2.0:1789760720.238922:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691810838832 time 691861814060 state 0x0 ref 1
00000100:00100000:2.0:1789760720.238936:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691862074476 time 691861814060 state 0x1 ref 1
00000100:00100000:2.0:1789760720.238967:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691862074476 time 691925649428 state 0x0 ref 1
00000100:00100000:2.0:1789760720.239097:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520882432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760720.239149:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20066304, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:2.0:1789760720.239159:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.239175:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:2.0:1789760720.239180:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760720.239186:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.239199:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760720.271747:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972219 is committed
00002000:00010000:2.0:1789760720.271910:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20066304 -> 20070400
00010000:00010000:2.0:1789760720.271926:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.271946:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.271955:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.271962:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760720.271966:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.271976:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.271995:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.272002:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20066304->20070399] (req 20066304->20070399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760720.272092:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520882432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33111us (33339us total) trans 4294972219 rc 0/0
00000100:00100000:2.0:1789760720.272103:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4932
00000100:00100000:2.0:1789760720.272112:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691862074476 time 691925649428 state 0x2 ref 0
00000100:00100000:1.0:1789760720.276857:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760720.277746:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520882560
00000100:00100000:2.0:1789760720.277758:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520882560
00000100:00100000:2.0:1789760720.277813:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691862074476 time 691925649428 state 0x0 ref 1
00000100:00100000:2.0:1789760720.277828:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691925909844 time 691925649428 state 0x1 ref 1
00000100:00100000:2.0:1789760720.277857:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691925909844 time 691964539623 state 0x0 ref 1
00000100:00100000:2.0:1789760720.277869:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520882560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760720.278434:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20070400, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:1.0:1789760720.278444:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.278466:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=691s v=(0 0)
00010000:00010000:1.0:1789760720.278471:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760720.278477:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.278491:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760720.315073:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972220 is committed
00002000:00010000:2.0:1789760720.315196:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20070400 -> 20074496
00010000:00010000:2.0:1789760720.315213:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.315226:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.315236:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.315243:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760720.315248:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.315257:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.315279:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.315287:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b8dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20070400->20074495] (req 20070400->20074495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760720.315412:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520882560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37540us (38561us total) trans 4294972220 rc 0/0
00000100:00100000:2.0:1789760720.315424:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4933
00000100:00100000:2.0:1789760720.316632:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691925909844 time 691964539623 state 0x2 ref 0
00000100:00100000:1.0:1789760720.319229:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760720.319299:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520882688
00000100:00100000:0.0:1789760720.319307:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520882688
00000100:00100000:0.0:1789760720.319383:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691925909844 time 691964539623 state 0x0 ref 1
00000100:00100000:0.0:1789760720.319400:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691964800039 time 691964539623 state 0x1 ref 1
00000100:00100000:0.0:1789760720.319423:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691964800039 time 692006105883 state 0x0 ref 1
00000100:00100000:0.0:1789760720.319542:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520882688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760720.319586:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20074496, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:0.0:1789760720.319595:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.319610:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:0.0:1789760720.319615:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760720.319621:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.319635:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760720.368419:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972221 is committed
00002000:00010000:0.0:1789760720.368649:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20074496 -> 20078592
00010000:00010000:0.0:1789760720.368665:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.368678:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.368688:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.368700:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760720.368705:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.368713:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.368733:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.368740:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60b8e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20074496->20078591] (req 20074496->20078591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760720.368836:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520882688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49301us (49612us total) trans 4294972221 rc 0/0
00000100:00100000:0.0:1789760720.368847:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4934
00000100:00100000:0.0:1789760720.368856:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691964800039 time 692006105883 state 0x2 ref 0
00000100:00100000:0.0:1789760720.372275:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760720.372378:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520882816
00000100:00100000:3.0:1789760720.372388:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520882816
00000100:00100000:3.0:1789760720.372450:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 691964800039 time 692006105883 state 0x0 ref 1
00000100:00100000:3.0:1789760720.372464:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692006366299 time 692006105883 state 0x1 ref 1
00000100:00100000:3.0:1789760720.372493:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692006366299 time 692059175965 state 0x0 ref 1
00000100:00100000:3.0:1789760720.372505:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520882816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760720.372564:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20078592, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:3.0:1789760720.372574:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.372589:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:3.0:1789760720.372593:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760720.372599:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.372613:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760720.410530:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972222 is committed
00002000:00010000:2.0:1789760720.410596:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20078592 -> 20082688
00010000:00010000:2.0:1789760720.410610:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.410622:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.410632:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.410639:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760720.410643:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.410651:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.410670:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.410679:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60b8eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20078592->20082687] (req 20078592->20082687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760720.410774:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520882816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38265us (38502us total) trans 4294972222 rc 0/0
00000100:00100000:2.0:1789760720.410784:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4935
00000100:00100000:2.0:1789760720.410793:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692006366299 time 692059175965 state 0x2 ref 0
00000100:00100000:3.0:1789760720.417118:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760720.417375:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520882944
00000100:00100000:2.0:1789760720.417385:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520882944
00000100:00100000:2.0:1789760720.417435:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692006366299 time 692059175965 state 0x0 ref 1
00000100:00100000:2.0:1789760720.417449:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692059436381 time 692059175965 state 0x1 ref 1
00000100:00100000:2.0:1789760720.417468:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692059436381 time 692104150877 state 0x0 ref 1
00000100:00100000:2.0:1789760720.417480:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520882944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760720.417527:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20082688, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:2.0:1789760720.417536:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.417553:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:2.0:1789760720.417557:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760720.417564:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.417578:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.442013:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760720.449147:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972223 is committed
00002000:00010000:2.0:1789760720.449305:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20082688 -> 20086784
00010000:00010000:2.0:1789760720.449338:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.449357:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.449366:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.449536:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760720.449542:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.449552:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.449572:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.449580:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20082688->20086783] (req 20082688->20086783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760720.449665:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520882944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32182us (32550us total) trans 4294972223 rc 0/0
00000100:00100000:2.0:1789760720.449675:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4936
00000100:00100000:2.0:1789760720.449684:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692059436381 time 692104150877 state 0x2 ref 0
00000100:00100000:1.0:1789760720.463434:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760720.463765:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520883072
00000100:00100000:2.0:1789760720.463775:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520883072
00000100:00100000:2.0:1789760720.463831:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692059436381 time 692104150877 state 0x0 ref 1
00000100:00100000:2.0:1789760720.463845:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692104411293 time 692104150877 state 0x1 ref 1
00000100:00100000:2.0:1789760720.463878:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692104411293 time 692150560380 state 0x0 ref 1
00000100:00100000:2.0:1789760720.463891:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520883072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760720.463947:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20086784, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:2.0:1789760720.463955:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.463970:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:2.0:1789760720.463974:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760720.463981:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.463994:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760720.492840:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972224 is committed
00002000:00010000:3.0:1789760720.493033:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20086784 -> 20090880
00010000:00010000:3.0:1789760720.493051:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.493064:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.493075:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.493083:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760720.493089:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.493099:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.493121:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.493130:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b8f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20086784->20090879] (req 20086784->20090879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760720.493279:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520883072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29384us (29850us total) trans 4294972224 rc 0/0
00000100:00100000:3.0:1789760720.493290:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4937
00000100:00100000:3.0:1789760720.493301:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692104411293 time 692150560380 state 0x2 ref 0
00000100:00100000:0.0:1789760720.504965:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760720.505061:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520883200
00000100:00100000:1.0:1789760720.505070:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520883200
00000100:00100000:1.0:1789760720.505123:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692104411293 time 692150560380 state 0x0 ref 1
00000100:00100000:1.0:1789760720.505138:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692150820796 time 692150560380 state 0x1 ref 1
00000100:00100000:1.0:1789760720.505169:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692150820796 time 692191851846 state 0x0 ref 1
00000100:00100000:1.0:1789760720.505181:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520883200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760720.505226:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20090880, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:1.0:1789760720.505236:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.505251:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:1.0:1789760720.505255:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760720.505262:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.505288:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760720.505579:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd9df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548743168:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760720.505639:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760720.505907:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548743168
00000100:00100000:3.0:1789760720.505912:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548743168
00000100:00100000:3.0:1789760720.505965:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410
00000100:00100000:3.0:1789760720.505974:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548743168:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1789760720.506005:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:3.0:1789760720.506065:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548743168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (424us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760720.506072:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410
00000100:00100000:2.0:1789760720.506155:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd9df6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548743168:0@lo:41:osp-pre-1-0.0
00000001:00080000:2.0:1789760720.574306:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972225 is committed
00002000:00010000:3.0:1789760720.574701:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20090880 -> 20094976
00010000:00010000:3.0:1789760720.574718:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.574728:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.574736:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.574743:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760720.574747:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.574755:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.574774:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.574781:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b900 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20090880->20094975] (req 20090880->20094975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760720.574868:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520883200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 69685us (69907us total) trans 4294972225 rc 0/0
00000100:00100000:3.0:1789760720.574878:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4938
00000100:00100000:3.0:1789760720.574888:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692150820796 time 692191851846 state 0x2 ref 0
00000100:00100000:1.0:1789760720.580756:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760720.580805:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520883328
00000100:00100000:3.0:1789760720.580817:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520883328
00000100:00100000:3.0:1789760720.580877:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692150820796 time 692191851846 state 0x0 ref 1
00000100:00100000:3.0:1789760720.580902:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692192112262 time 692191851846 state 0x1 ref 1
00000100:00100000:3.0:1789760720.580940:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692192112262 time 692267621772 state 0x0 ref 1
00000100:00100000:3.0:1789760720.580952:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520883328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760720.580998:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20094976, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:3.0:1789760720.581008:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.581023:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:3.0:1789760720.581028:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760720.581034:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.581051:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760720.628008:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972226 is committed
00002000:00010000:3.0:1789760720.628386:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20094976 -> 20099072
00010000:00010000:3.0:1789760720.628402:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.628414:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.628436:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.628444:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760720.628449:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.628457:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.628478:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.628486:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b907 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20094976->20099071] (req 20094976->20099071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760720.628789:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520883328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47834us (48040us total) trans 4294972226 rc 0/0
00000100:00100000:1.0:1789760720.628801:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4939
00000100:00100000:1.0:1789760720.628811:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692192112262 time 692267621772 state 0x2 ref 0
00000100:00100000:1.0:1789760720.636601:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760720.636768:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520883456
00000100:00100000:2.0:1789760720.636779:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520883456
00000100:00100000:2.0:1789760720.636834:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692192112262 time 692267621772 state 0x0 ref 1
00000100:00100000:2.0:1789760720.636852:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692267882188 time 692267621772 state 0x1 ref 1
00000100:00100000:2.0:1789760720.636881:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692267882188 time 692323564661 state 0x0 ref 1
00000100:00100000:2.0:1789760720.636902:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520883456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760720.636956:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20099072, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:2.0:1789760720.636965:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.636981:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:2.0:1789760720.636986:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760720.636992:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.637005:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760720.692148:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20099072 -> 20103168
00010000:00010000:2.0:1789760720.692167:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.692179:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.692189:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.692202:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760720.692208:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.692216:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.692233:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.692241:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b90e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20099072->20103167] (req 20099072->20103167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760720.692348:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520883456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55422us (55723us total) trans 4294972227 rc 0/0
00000100:00100000:2.0:1789760720.692357:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4940
00000100:00100000:2.0:1789760720.692375:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692267882188 time 692323564661 state 0x2 ref 0
00000001:00080000:2.0:1789760720.692409:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972227 is committed
00000100:00100000:2.0:1789760720.695497:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760720.695826:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520883584
00000100:00100000:3.0:1789760720.695836:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520883584
00000100:00100000:3.0:1789760720.695890:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692267882188 time 692323564661 state 0x0 ref 1
00000100:00100000:3.0:1789760720.695917:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692323825077 time 692323564661 state 0x1 ref 1
00000100:00100000:3.0:1789760720.695982:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692323825077 time 692382664455 state 0x0 ref 1
00000100:00100000:3.0:1789760720.695996:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520883584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760720.696040:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20103168, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:3.0:1789760720.696048:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.696064:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:3.0:1789760720.696069:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760720.696075:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.696087:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760720.725092:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20103168 -> 20107264
00010000:00010000:0.0:1789760720.725111:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.725123:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.725132:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.725140:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760720.725145:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.725154:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.725172:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.725179:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60b915 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20103168->20107263] (req 20103168->20107263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760720.725263:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520883584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29264us (29770us total) trans 4294972228 rc 0/0
00000100:00100000:0.0:1789760720.725273:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4941
00000100:00100000:0.0:1789760720.725283:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692323825077 time 692382664455 state 0x2 ref 0
00000001:00080000:2.0:1789760720.727179:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972228 is committed
00000100:00100000:1.0:1789760720.731240:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760720.731498:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520883712
00000100:00100000:3.0:1789760720.731508:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520883712
00000100:00100000:3.0:1789760720.731623:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692323825077 time 692382664455 state 0x0 ref 1
00000100:00100000:3.0:1789760720.731638:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692382924871 time 692382664455 state 0x1 ref 1
00000100:00100000:3.0:1789760720.731669:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692382924871 time 692418351628 state 0x0 ref 1
00000100:00100000:3.0:1789760720.731681:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520883712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760720.731729:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20107264, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:3.0:1789760720.731739:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.731756:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:3.0:1789760720.731760:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760720.731767:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.731782:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760720.741641:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760720.741684:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760720.741705:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760720.741721:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760720.741739:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760720.741762:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520884096
00000100:00100000:1.0:1789760720.741771:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520884096
00000100:00100000:1.0:1789760720.741824:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520884352
00000100:00100000:1.0:1789760720.741828:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520884352
00000100:00100000:1.0:1789760720.741843:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520883968
00000100:00100000:1.0:1789760720.741845:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520883968
00000100:00100000:1.0:1789760720.741856:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520884224
00000100:00100000:1.0:1789760720.741858:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520884224
00000100:00100000:1.0:1789760720.741873:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 833
00000100:00100000:1.0:1789760720.741882:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520884096:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760720.741964:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520884096:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 82us (278us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760720.741972:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 833
00000100:00100000:1.0:1789760720.741990:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 834
00000100:00100000:1.0:1789760720.741996:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520884352:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760720.742020:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520884352:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (314us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760720.742026:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 834
00000100:00100000:1.0:1789760720.742038:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 835
00000100:00100000:1.0:1789760720.742044:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520883968:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760720.742068:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520883968:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (346us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760720.742074:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 835
00000100:00100000:1.0:1789760720.742085:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 836
00000100:00100000:1.0:1789760720.742090:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520884224:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760720.742113:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520884224:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760720.742119:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 836
00000100:00080000:1.0:1789760720.742143:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:1.0:1789760720.742147:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1789760720.743104:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520883840
00000100:00100000:3.0:1789760720.743112:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520883840
00000100:00100000:3.0:1789760720.743156:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 462
00000100:00100000:3.0:1789760720.743163:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda005a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520883840:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760720.743205:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda005a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520883840:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 42us (1572us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760720.743212:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 462
00000001:00080000:0.0:1789760720.773981:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972229 is committed
00002000:00010000:1.0:1789760720.774088:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20107264 -> 20111360
00010000:00010000:1.0:1789760720.774105:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.774124:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.774134:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.774142:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760720.774147:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.774157:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.774177:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760720.774185:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60b91c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20107264->20111359] (req 20107264->20111359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760720.774276:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520883712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42592us (43041us total) trans 4294972229 rc 0/0
00000100:00100000:1.0:1789760720.774286:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4942
00000100:00100000:1.0:1789760720.774295:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692382924871 time 692418351628 state 0x2 ref 0
00000100:00100000:1.0:1789760720.777729:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760720.777818:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520884480
00000100:00100000:3.0:1789760720.777829:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520884480
00000100:00100000:3.0:1789760720.777886:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692382924871 time 692418351628 state 0x0 ref 1
00000100:00100000:3.0:1789760720.777914:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692418612044 time 692418351628 state 0x1 ref 1
00000100:00100000:3.0:1789760720.777942:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692418612044 time 692464625747 state 0x0 ref 1
00000100:00100000:3.0:1789760720.777954:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520884480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760720.778000:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20111360, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:3.0:1789760720.778009:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.778025:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:3.0:1789760720.778029:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760720.778035:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.778049:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760720.833849:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972230 is committed
00002000:00010000:3.0:1789760720.833962:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20111360 -> 20115456
00010000:00010000:3.0:1789760720.833978:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.833991:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.834002:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.834016:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760720.834021:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.834031:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.834050:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.834058:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b923 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20111360->20115455] (req 20111360->20115455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760720.834149:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520884480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56192us (56426us total) trans 4294972230 rc 0/0
00000100:00100000:3.0:1789760720.834160:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4943
00000100:00100000:3.0:1789760720.834170:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692418612044 time 692464625747 state 0x2 ref 0
00000100:00100000:0.0:1789760720.838788:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760720.838883:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520884608
00000100:00100000:2.0:1789760720.838901:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520884608
00000100:00100000:2.0:1789760720.838963:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692418612044 time 692464625747 state 0x0 ref 1
00000100:00100000:2.0:1789760720.838982:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692464886163 time 692464625747 state 0x1 ref 1
00000100:00100000:2.0:1789760720.839010:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692464886163 time 692525692745 state 0x0 ref 1
00000100:00100000:2.0:1789760720.839022:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520884608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760720.839069:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20115456, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:2.0:1789760720.839079:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.839096:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:2.0:1789760720.839101:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760720.839107:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760720.839122:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760720.895250:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972231 is committed
00002000:00010000:3.0:1789760720.895367:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20115456 -> 20119552
00010000:00010000:3.0:1789760720.895384:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.895396:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.895410:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.895418:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760720.895423:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.895433:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.895452:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.895459:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60b92a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20115456->20119551] (req 20115456->20119551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760720.895598:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520884608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56573us (56815us total) trans 4294972231 rc 0/0
00000100:00100000:3.0:1789760720.895610:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4944
00000100:00100000:3.0:1789760720.895629:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692464886163 time 692525692745 state 0x2 ref 0
00000100:00100000:1.0:1789760720.903872:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760720.904032:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520884736
00000100:00100000:0.0:1789760720.904042:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520884736
00000100:00100000:0.0:1789760720.904098:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692464886163 time 692525692745 state 0x0 ref 1
00000100:00100000:0.0:1789760720.904113:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692525953161 time 692525692745 state 0x1 ref 1
00000100:00100000:0.0:1789760720.904146:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692525953161 time 692590829464 state 0x0 ref 1
00000100:00100000:0.0:1789760720.904160:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520884736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760720.904207:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20119552, mtime: 0x6aad94d1, atime: 0x0, ctime: 0x6aad94d1, blocks: 0xa007
00010000:00010000:0.0:1789760720.904218:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.904233:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:0.0:1789760720.904238:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760720.904243:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.904255:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760720.974538:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972232 is committed
00002000:00010000:0.0:1789760720.974806:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20119552 -> 20123648
00002000:00010000:0.0:1789760720.974810:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760721 -> 1789760722
00002000:00010000:0.0:1789760720.974814:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760721 -> 1789760722
00010000:00010000:0.0:1789760720.974827:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.974839:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.974848:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.974856:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760720.974860:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.974869:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.974888:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760720.974905:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b931 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20119552->20123647] (req 20119552->20123647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760720.975008:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520884736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70847us (71142us total) trans 4294972232 rc 0/0
00000100:00100000:0.0:1789760720.975018:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4945
00000100:00100000:0.0:1789760720.975028:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692525953161 time 692590829464 state 0x2 ref 0
00000100:00100000:1.0:1789760720.978087:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760720.978188:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520884864
00000100:00100000:3.0:1789760720.978199:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520884864
00000100:00100000:3.0:1789760720.978272:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692525953161 time 692590829464 state 0x0 ref 1
00000100:00100000:3.0:1789760720.978289:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692591089880 time 692590829464 state 0x1 ref 1
00000100:00100000:3.0:1789760720.978352:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692591089880 time 692665033976 state 0x0 ref 1
00000100:00100000:3.0:1789760720.978365:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520884864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760720.978412:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20123648, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:3.0:1789760720.978431:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.978447:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:3.0:1789760720.978451:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760720.978458:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760720.978471:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.017742:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1789760721.017766:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548743296:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1789760721.017834:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760721.017912:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548743296
00000100:00100000:0.0:1789760721.017919:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548743296
00000100:00100000:0.0:1789760721.017979:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342
00000100:00100000:0.0:1789760721.017990:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548743296:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1789760721.018012:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528416768 pending 1703936 free 3837788160 avail 3807379456
00000100:00100000:0.0:1789760721.018059:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548743296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (224us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760721.018067:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342
00000100:00080000:0.0:1789760721.018089:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760721.018126:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548743296:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1789760721.024263:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1789760721.024287:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548743424:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1789760721.024371:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760721.024846:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548743424
00000100:00100000:0.0:1789760721.024855:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548743424
00000100:00100000:0.0:1789760721.024919:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343
00000100:00100000:0.0:1789760721.025007:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548743424:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1789760721.025038:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528416768 pending 1703936 free 3837788160 avail 3807379456
00000100:00100000:0.0:1789760721.025094:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548743424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (723us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760721.025101:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343
00000100:00100000:0.0:1789760721.025158:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548743424:0@lo:13:osp-pre-0-0.0
00000100:00080000:2.0:1789760721.025596:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:0.0:1789760721.044111:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20123648 -> 20127744
00010000:00010000:0.0:1789760721.044129:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.044149:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.044159:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.044167:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.044171:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.044182:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.044201:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.044210:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60b938 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20123648->20127743] (req 20123648->20127743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.044308:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520884864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65940us (66228us total) trans 4294972233 rc 0/0
00000100:00100000:0.0:1789760721.044348:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4946
00000100:00100000:0.0:1789760721.044358:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692591089880 time 692665033976 state 0x2 ref 0
00000001:00080000:2.0:1789760721.045339:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972233 is committed
00000100:00100000:2.0:1789760721.051431:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760721.052309:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520884992
00000100:00100000:3.0:1789760721.052353:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520884992
00000100:00100000:3.0:1789760721.052409:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692591089880 time 692665033976 state 0x0 ref 1
00000100:00100000:3.0:1789760721.052435:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692665294392 time 692665033976 state 0x1 ref 1
00000100:00100000:3.0:1789760721.052456:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692665294392 time 692739139326 state 0x0 ref 1
00000100:00100000:3.0:1789760721.052468:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520884992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760721.052516:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20127744, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:3.0:1789760721.052536:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.052552:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:3.0:1789760721.052556:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760721.052562:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.052576:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760721.114793:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972234 is committed
00002000:00010000:0.0:1789760721.115095:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20127744 -> 20131840
00010000:00010000:0.0:1789760721.115110:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.115124:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.115134:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.115142:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.115147:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.115156:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.115177:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.115185:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b93f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20127744->20131839] (req 20127744->20131839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.115283:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520884992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62811us (63866us total) trans 4294972234 rc 0/0
00000100:00100000:0.0:1789760721.115293:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4947
00000100:00100000:0.0:1789760721.115305:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692665294392 time 692739139326 state 0x2 ref 0
00000100:00100000:1.0:1789760721.126591:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760721.126650:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520885120
00000100:00100000:2.0:1789760721.126660:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520885120
00000100:00100000:2.0:1789760721.126717:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692665294392 time 692739139326 state 0x0 ref 1
00000100:00100000:2.0:1789760721.126733:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692739399742 time 692739139326 state 0x1 ref 1
00000100:00100000:2.0:1789760721.126753:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692739399742 time 692813436056 state 0x0 ref 1
00000100:00100000:2.0:1789760721.126765:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520885120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760721.126809:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20131840, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:2.0:1789760721.126818:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.126832:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:2.0:1789760721.126836:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760721.126842:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.126855:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760721.151674:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972235 is committed
00002000:00010000:1.0:1789760721.151762:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20131840 -> 20135936
00010000:00010000:1.0:1789760721.151778:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.151791:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.151801:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.151809:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760721.151814:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.151823:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.151843:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.151850:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b946 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20131840->20135935] (req 20131840->20135935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760721.151954:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520885120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25185us (25366us total) trans 4294972235 rc 0/0
00000100:00100000:1.0:1789760721.151965:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4948
00000100:00100000:1.0:1789760721.151975:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692739399742 time 692813436056 state 0x2 ref 0
00000100:00100000:1.0:1789760721.165260:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760721.166241:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520885248
00000100:00100000:0.0:1789760721.166252:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520885248
00000100:00100000:0.0:1789760721.166442:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692739399742 time 692813436056 state 0x0 ref 1
00000100:00100000:0.0:1789760721.166522:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692813696472 time 692813436056 state 0x1 ref 1
00000100:00100000:3.0:1789760721.166595:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692813696472 time 692853274486 state 0x0 ref 1
00000100:00100000:3.0:1789760721.166609:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520885248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760721.166653:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20135936, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:3.0:1789760721.166661:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.166674:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:3.0:1789760721.166678:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760721.166682:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.166693:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760721.197870:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972236 is committed
00002000:00010000:1.0:1789760721.198035:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20135936 -> 20140032
00010000:00010000:1.0:1789760721.198051:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.198064:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.198073:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.198081:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760721.198085:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.198094:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.198113:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.198120:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60b94d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20135936->20140031] (req 20135936->20140031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760721.198222:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520885248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31610us (32966us total) trans 4294972236 rc 0/0
00000100:00100000:1.0:1789760721.198236:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4949
00000100:00100000:1.0:1789760721.198246:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692813696472 time 692853274486 state 0x2 ref 0
00000100:00100000:2.0:1789760721.205284:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760721.206069:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520885376
00000100:00100000:0.0:1789760721.206080:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520885376
00000100:00100000:0.0:1789760721.206143:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692813696472 time 692853274486 state 0x0 ref 1
00000100:00100000:0.0:1789760721.206161:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692853534902 time 692853274486 state 0x1 ref 1
00000100:00100000:0.0:1789760721.206191:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692853534902 time 692892873732 state 0x0 ref 1
00000100:00100000:0.0:1789760721.206204:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520885376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760721.206253:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20140032, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:0.0:1789760721.206263:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.206278:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:0.0:1789760721.206283:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760721.206289:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.206304:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760721.233194:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972237 is committed
00002000:00010000:0.0:1789760721.233307:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20140032 -> 20144128
00010000:00010000:0.0:1789760721.233355:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.233370:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.233380:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.233388:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.233393:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.233403:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.233517:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.233526:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b954 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20140032->20144127] (req 20140032->20144127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.233626:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520885376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27419us (28345us total) trans 4294972237 rc 0/0
00000100:00100000:0.0:1789760721.233640:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4950
00000100:00100000:0.0:1789760721.233650:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692853534902 time 692892873732 state 0x2 ref 0
00000100:00100000:3.0:1789760721.244681:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760721.244798:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520885504
00000100:00100000:1.0:1789760721.244808:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520885504
00000100:00100000:1.0:1789760721.244977:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692853534902 time 692892873732 state 0x0 ref 1
00000100:00100000:1.0:1789760721.244995:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692893134148 time 692892873732 state 0x1 ref 1
00000100:00100000:1.0:1789760721.245061:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692893134148 time 692931743579 state 0x0 ref 1
00000100:00100000:1.0:1789760721.245075:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520885504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760721.245128:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20144128, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:1.0:1789760721.245138:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.245155:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:1.0:1789760721.245159:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760721.245166:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.245180:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760721.285673:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20144128 -> 20148224
00010000:00010000:0.0:1789760721.285696:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.285712:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.285722:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.285729:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.285734:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.285743:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.285763:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.285771:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b95b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20144128->20148223] (req 20144128->20148223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.285882:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520885504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40802us (41210us total) trans 4294972238 rc 0/0
00000100:00100000:0.0:1789760721.285904:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4951
00000100:00100000:0.0:1789760721.285924:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692893134148 time 692931743579 state 0x2 ref 0
00000001:00080000:1.0:1789760721.286128:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972238 is committed
00000100:00100000:1.0:1789760721.293855:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760721.294234:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520885632
00000100:00100000:2.0:1789760721.294245:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520885632
00000100:00100000:2.0:1789760721.294301:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692893134148 time 692931743579 state 0x0 ref 1
00000100:00100000:2.0:1789760721.294350:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692932003995 time 692931743579 state 0x1 ref 1
00000100:00100000:2.0:1789760721.294373:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692932003995 time 692981056339 state 0x0 ref 1
00000100:00100000:2.0:1789760721.294389:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520885632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760721.294443:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20148224, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:2.0:1789760721.294454:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.294471:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=692s v=(0 0)
00010000:00010000:2.0:1789760721.294476:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760721.294484:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.294499:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760721.322360:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20148224 -> 20152320
00010000:00010000:2.0:1789760721.322379:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.322393:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.322463:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760721.322471:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972239 is committed
00010000:00010000:2.0:1789760721.322472:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760721.322478:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.322488:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.322510:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.322517:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60b962 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20148224->20152319] (req 20148224->20152319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760721.322608:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520885632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28218us (28761us total) trans 4294972239 rc 0/0
00000100:00100000:2.0:1789760721.322619:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4952
00000100:00100000:2.0:1789760721.322629:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692932003995 time 692981056339 state 0x2 ref 0
00000100:00100000:3.0:1789760721.327739:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760721.327955:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520885760
00000100:00100000:1.0:1789760721.327965:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520885760
00000100:00100000:1.0:1789760721.328022:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692932003995 time 692981056339 state 0x0 ref 1
00000100:00100000:1.0:1789760721.328034:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692981316755 time 692981056339 state 0x1 ref 1
00000100:00100000:1.0:1789760721.328058:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692981316755 time 693014741149 state 0x0 ref 1
00000100:00100000:1.0:1789760721.328070:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520885760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760721.328117:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20152320, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:1.0:1789760721.328127:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.328143:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:1.0:1789760721.328148:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760721.328155:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.328170:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760721.358822:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20152320 -> 20156416
00010000:00010000:0.0:1789760721.358842:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.358854:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.358863:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.358870:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.358874:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.358882:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.358915:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.358928:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b969 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20152320->20156415] (req 20152320->20156415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.359881:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520885760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31804us (32142us total) trans 4294972240 rc 0/0
00000100:00100000:0.0:1789760721.359904:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4953
00000100:00100000:0.0:1789760721.359914:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692981316755 time 693014741149 state 0x2 ref 0
00000001:00080000:0.0:1789760721.359962:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972240 is committed
00000100:00100000:3.0:1789760721.366769:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760721.366845:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520885888
00000100:00100000:0.0:1789760721.366860:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520885888
00000100:00100000:0.0:1789760721.367000:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 692981316755 time 693014741149 state 0x0 ref 1
00000100:00100000:0.0:1789760721.367017:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693015001565 time 693014741149 state 0x1 ref 1
00000100:00100000:0.0:1789760721.367048:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693015001565 time 693053730717 state 0x0 ref 1
00000100:00100000:0.0:1789760721.367062:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520885888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760721.367108:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20156416, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:0.0:1789760721.367117:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.367133:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:0.0:1789760721.367137:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760721.367144:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.367159:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760721.404985:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972241 is committed
00002000:00010000:2.0:1789760721.405054:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20156416 -> 20160512
00010000:00010000:2.0:1789760721.405069:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.405083:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.405093:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.405101:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760721.405107:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.405116:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.405136:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.405144:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60b970 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20156416->20160511] (req 20156416->20160511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760721.405273:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520885888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38210us (38515us total) trans 4294972241 rc 0/0
00000100:00100000:2.0:1789760721.405284:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4954
00000100:00100000:2.0:1789760721.405293:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693015001565 time 693053730717 state 0x2 ref 0
00000100:00100000:2.0:1789760721.410837:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760721.410933:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520886016
00000100:00100000:0.0:1789760721.410943:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520886016
00000100:00100000:0.0:1789760721.411046:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693015001565 time 693053730717 state 0x0 ref 1
00000100:00100000:0.0:1789760721.411062:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693053991133 time 693053730717 state 0x1 ref 1
00000100:00100000:0.0:1789760721.411130:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693053991133 time 693097811883 state 0x0 ref 1
00000100:00100000:0.0:1789760721.411143:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520886016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760721.411184:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20160512, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:0.0:1789760721.411191:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.411204:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:0.0:1789760721.411207:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760721.411211:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.411221:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760721.464446:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972242 is committed
00002000:00010000:0.0:1789760721.464576:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20160512 -> 20164608
00010000:00010000:0.0:1789760721.464592:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.464606:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.464616:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.464623:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.464628:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.464638:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.464657:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.464665:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60b977 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20160512->20164607] (req 20160512->20164607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.464881:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520886016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53728us (54039us total) trans 4294972242 rc 0/0
00000100:00100000:0.0:1789760721.464899:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4955
00000100:00100000:0.0:1789760721.464909:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693053991133 time 693097811883 state 0x2 ref 0
00010000:00010000:2.0:1789760721.465501:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789760721.471132:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760721.472064:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520886144
00000100:00100000:1.0:1789760721.472076:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520886144
00000100:00100000:1.0:1789760721.472131:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693053991133 time 693097811883 state 0x0 ref 1
00000100:00100000:1.0:1789760721.472149:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693098072299 time 693097811883 state 0x1 ref 1
00000100:00100000:1.0:1789760721.472218:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693098072299 time 693158900418 state 0x0 ref 1
00000100:00100000:1.0:1789760721.472231:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520886144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760721.472280:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20164608, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:1.0:1789760721.472289:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.472306:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:1.0:1789760721.472429:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760721.472438:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.472454:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760721.513774:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20164608 -> 20168704
00010000:00010000:0.0:1789760721.513796:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.513810:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.513819:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.513828:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.513832:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.513841:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.513860:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.513877:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60b97e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20164608->20168703] (req 20164608->20168703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.513980:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520886144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41744us (42851us total) trans 4294972243 rc 0/0
00000100:00100000:0.0:1789760721.513990:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4956
00000100:00100000:0.0:1789760721.514000:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693098072299 time 693158900418 state 0x2 ref 0
00000001:00080000:1.0:1789760721.514479:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972243 is committed
00000100:00100000:1.0:1789760721.518077:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760721.518232:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520886272
00000100:00100000:3.0:1789760721.518242:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520886272
00000100:00100000:3.0:1789760721.518298:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693098072299 time 693158900418 state 0x0 ref 1
00000100:00100000:3.0:1789760721.518348:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693159160834 time 693158900418 state 0x1 ref 1
00000100:00100000:3.0:1789760721.518371:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693159160834 time 693205054628 state 0x0 ref 1
00000100:00100000:3.0:1789760721.518384:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520886272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760721.518444:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20168704, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:3.0:1789760721.518453:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.518470:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:3.0:1789760721.518475:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760721.518481:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.518494:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760721.571277:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972244 is committed
00002000:00010000:3.0:1789760721.571392:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20168704 -> 20172800
00010000:00010000:3.0:1789760721.571409:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.571495:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.571505:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.571512:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760721.571517:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.571538:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.571559:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.571568:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b985 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20168704->20172799] (req 20168704->20172799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760721.571706:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520886272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53319us (53635us total) trans 4294972244 rc 0/0
00000100:00100000:3.0:1789760721.571730:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4957
00000100:00100000:3.0:1789760721.571740:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693159160834 time 693205054628 state 0x2 ref 0
00000100:00100000:2.0:1789760721.576851:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760721.577095:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520886400
00000100:00100000:0.0:1789760721.577105:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520886400
00000100:00100000:0.0:1789760721.577160:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693159160834 time 693205054628 state 0x0 ref 1
00000100:00100000:0.0:1789760721.577175:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693205315044 time 693205054628 state 0x1 ref 1
00000100:00100000:0.0:1789760721.577210:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693205315044 time 693263892282 state 0x0 ref 1
00000100:00100000:0.0:1789760721.577222:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520886400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760721.577275:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20172800, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:0.0:1789760721.577284:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.577300:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:0.0:1789760721.577305:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760721.577354:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.577369:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760721.617369:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20172800 -> 20176896
00010000:00010000:0.0:1789760721.617392:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.617411:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.617427:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.617436:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.617440:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.617449:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.617468:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.617476:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60b98c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20172800->20176895] (req 20172800->20176895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.617569:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520886400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40343us (40723us total) trans 4294972245 rc 0/0
00000100:00100000:0.0:1789760721.617579:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4958
00000100:00100000:0.0:1789760721.617589:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693205315044 time 693263892282 state 0x2 ref 0
00000001:00080000:0.0:1789760721.617629:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972245 is committed
00000100:00100000:0.0:1789760721.622613:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760721.622741:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520886528
00000100:00100000:1.0:1789760721.622752:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520886528
00000100:00100000:1.0:1789760721.622809:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693205315044 time 693263892282 state 0x0 ref 1
00000100:00100000:1.0:1789760721.622825:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693264152698 time 693263892282 state 0x1 ref 1
00000100:00100000:1.0:1789760721.622859:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693264152698 time 693309540889 state 0x0 ref 1
00000100:00100000:1.0:1789760721.622871:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520886528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760721.622932:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20176896, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:1.0:1789760721.622941:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.622956:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:1.0:1789760721.622960:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760721.622968:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.622981:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760721.649255:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20176896 -> 20180992
00010000:00010000:1.0:1789760721.649277:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.649290:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.649299:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.649306:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760721.649335:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.649346:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.649365:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.649373:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60b993 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20176896->20180991] (req 20176896->20180991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760721.649466:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520886528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26592us (26859us total) trans 4294972246 rc 0/0
00000100:00100000:1.0:1789760721.649476:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4959
00000100:00100000:1.0:1789760721.649485:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693264152698 time 693309540889 state 0x2 ref 0
00000001:00080000:2.0:1789760721.651037:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972246 is committed
00000100:00100000:1.0:1789760721.655541:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760721.655704:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520886656
00000100:00100000:0.0:1789760721.655715:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520886656
00000100:00100000:0.0:1789760721.655766:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693264152698 time 693309540889 state 0x0 ref 1
00000100:00100000:0.0:1789760721.655780:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693309801305 time 693309540889 state 0x1 ref 1
00000100:00100000:0.0:1789760721.655812:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693309801305 time 693342494820 state 0x0 ref 1
00000100:00100000:0.0:1789760721.655823:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520886656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760721.655871:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20180992, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:0.0:1789760721.655880:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.655905:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:0.0:1789760721.655910:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760721.655916:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.655931:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760721.688133:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972247 is committed
00002000:00010000:0.0:1789760721.688213:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20180992 -> 20185088
00010000:00010000:0.0:1789760721.688229:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.688242:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.688251:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.688259:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.688264:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.688272:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.688292:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.688299:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60b99a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20180992->20185087] (req 20180992->20185087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.688426:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520886656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32599us (32898us total) trans 4294972247 rc 0/0
00000100:00100000:0.0:1789760721.688436:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4960
00000100:00100000:0.0:1789760721.688446:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693309801305 time 693342494820 state 0x2 ref 0
00000100:00100000:0.0:1789760721.691341:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760721.691493:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520886784
00000100:00100000:3.0:1789760721.691503:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520886784
00000100:00100000:3.0:1789760721.691611:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693309801305 time 693342494820 state 0x0 ref 1
00000100:00100000:3.0:1789760721.691625:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693342755236 time 693342494820 state 0x1 ref 1
00000100:00100000:3.0:1789760721.691729:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693342755236 time 693378411384 state 0x0 ref 1
00000100:00100000:3.0:1789760721.691740:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520886784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760721.691789:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20185088, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:3.0:1789760721.691799:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.691812:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:3.0:1789760721.691816:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760721.691820:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.691831:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760721.720598:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972248 is committed
00002000:00010000:2.0:1789760721.720710:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20185088 -> 20189184
00010000:00010000:2.0:1789760721.720725:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.720737:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.720746:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.720753:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760721.720757:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.720765:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.720782:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.720789:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60b9a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20185088->20189183] (req 20185088->20189183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760721.720929:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520886784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29185us (29616us total) trans 4294972248 rc 0/0
00000100:00100000:2.0:1789760721.720939:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4961
00000100:00100000:2.0:1789760721.720949:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693342755236 time 693378411384 state 0x2 ref 0
00000100:00100000:2.0:1789760721.725155:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760721.725359:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520886912
00000100:00100000:0.0:1789760721.725369:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520886912
00000100:00100000:0.0:1789760721.725595:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693342755236 time 693378411384 state 0x0 ref 1
00000100:00100000:0.0:1789760721.725613:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693378671800 time 693378411384 state 0x1 ref 1
00000100:00100000:1.0:1789760721.725692:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693378671800 time 693412371589 state 0x0 ref 1
00000100:00100000:1.0:1789760721.725707:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520886912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760721.725754:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20189184, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:1.0:1789760721.725764:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.725786:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:1.0:1789760721.725791:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760721.725797:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.725812:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760721.751413:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972249 is committed
00002000:00010000:0.0:1789760721.751650:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20189184 -> 20193280
00010000:00010000:0.0:1789760721.751666:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.751679:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.751689:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.751697:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.751702:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.751712:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.751731:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.751738:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60b9a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20189184->20193279] (req 20189184->20193279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.751823:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520886912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26115us (26674us total) trans 4294972249 rc 0/0
00000100:00100000:0.0:1789760721.751834:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4962
00000100:00100000:0.0:1789760721.751843:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693378671800 time 693412371589 state 0x2 ref 0
00000100:00100000:1.0:1789760721.756354:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760721.756925:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520887040
00000100:00100000:2.0:1789760721.756935:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520887040
00000100:00100000:2.0:1789760721.756990:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693378671800 time 693412371589 state 0x0 ref 1
00000100:00100000:2.0:1789760721.757008:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693412632005 time 693412371589 state 0x1 ref 1
00000100:00100000:2.0:1789760721.757040:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693412632005 time 693443723065 state 0x0 ref 1
00000100:00100000:2.0:1789760721.757053:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520887040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760721.757103:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20193280, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:2.0:1789760721.757112:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.757127:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:2.0:1789760721.757131:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760721.757137:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.757151:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760721.780801:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972250 is committed
00002000:00010000:2.0:1789760721.780933:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20193280 -> 20197376
00010000:00010000:2.0:1789760721.780957:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.780971:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.780979:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.780992:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760721.780997:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.781006:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.781025:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.781033:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60b9af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20193280->20197375] (req 20193280->20197375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760721.781135:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520887040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24079us (24785us total) trans 4294972250 rc 0/0
00000100:00100000:2.0:1789760721.781147:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4963
00000100:00100000:2.0:1789760721.781157:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693412632005 time 693443723065 state 0x2 ref 0
00000100:00100000:2.0:1789760721.793092:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760721.793152:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520887168
00000100:00100000:1.0:1789760721.793161:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520887168
00000100:00100000:1.0:1789760721.793206:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693412632005 time 693443723065 state 0x0 ref 1
00000100:00100000:1.0:1789760721.793218:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693443983481 time 693443723065 state 0x1 ref 1
00000100:00100000:1.0:1789760721.793243:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693443983481 time 693479927082 state 0x0 ref 1
00000100:00100000:1.0:1789760721.793252:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520887168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760721.793291:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20197376, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:1.0:1789760721.793298:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.793310:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:1.0:1789760721.793336:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760721.793341:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.793352:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760721.825964:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972251 is committed
00002000:00010000:0.0:1789760721.826510:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20197376 -> 20201472
00010000:00010000:0.0:1789760721.826525:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.826539:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.826549:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.826558:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.826563:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.826572:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.826592:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.826600:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60b9b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20197376->20201471] (req 20197376->20201471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.826747:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520887168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33488us (33658us total) trans 4294972251 rc 0/0
00000100:00100000:0.0:1789760721.826757:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4964
00000100:00100000:0.0:1789760721.826766:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693443983481 time 693479927082 state 0x2 ref 0
00000100:00100000:0.0:1789760721.829509:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760721.829566:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520887296
00000100:00100000:3.0:1789760721.829577:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520887296
00000100:00100000:3.0:1789760721.829631:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693443983481 time 693479927082 state 0x0 ref 1
00000100:00100000:3.0:1789760721.829645:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693480187498 time 693479927082 state 0x1 ref 1
00000100:00100000:3.0:1789760721.829676:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693480187498 time 693516359243 state 0x0 ref 1
00000100:00100000:3.0:1789760721.829687:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520887296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760721.829733:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20201472, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:3.0:1789760721.829743:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.829758:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:3.0:1789760721.829763:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760721.829770:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.829783:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760721.863487:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20201472 -> 20205568
00010000:00010000:3.0:1789760721.863507:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.863530:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.863540:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.863548:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760721.863552:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.863561:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.863581:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760721.863588:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20201472->20205567] (req 20201472->20205567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760721.863683:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520887296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33992us (34177us total) trans 4294972252 rc 0/0
00000100:00100000:3.0:1789760721.863695:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4965
00000100:00100000:3.0:1789760721.863704:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693480187498 time 693516359243 state 0x2 ref 0
00000001:00080000:1.0:1789760721.864448:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972252 is committed
00000100:00100000:3.0:1789760721.871840:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760721.871954:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520887424
00000100:00100000:0.0:1789760721.871965:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520887424
00000100:00100000:0.0:1789760721.872018:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693480187498 time 693516359243 state 0x0 ref 1
00000100:00100000:0.0:1789760721.872034:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693516619659 time 693516359243 state 0x1 ref 1
00000100:00100000:0.0:1789760721.872063:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693516619659 time 693558745520 state 0x0 ref 1
00000100:00100000:0.0:1789760721.872076:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520887424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760721.872123:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20205568, mtime: 0x6aad94d2, atime: 0x0, ctime: 0x6aad94d2, blocks: 0xa007
00010000:00010000:0.0:1789760721.872133:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.872149:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:0.0:1789760721.872153:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760721.872159:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.872174:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760721.938182:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972253 is committed
00002000:00010000:0.0:1789760721.938263:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20205568 -> 20209664
00002000:00010000:0.0:1789760721.938268:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760722 -> 1789760723
00002000:00010000:0.0:1789760721.938271:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760722 -> 1789760723
00010000:00010000:0.0:1789760721.938284:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.938297:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.938306:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.938330:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760721.938335:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.938344:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.938363:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760721.938371:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20205568->20209663] (req 20205568->20209663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760721.938477:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520887424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66399us (66642us total) trans 4294972253 rc 0/0
00000100:00100000:0.0:1789760721.938488:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4966
00000100:00100000:0.0:1789760721.938498:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693516619659 time 693558745520 state 0x2 ref 0
00000100:00100000:0.0:1789760721.942843:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760721.942932:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520887552
00000100:00100000:2.0:1789760721.942941:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520887552
00000100:00100000:2.0:1789760721.942989:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693516619659 time 693558745520 state 0x0 ref 1
00000100:00100000:2.0:1789760721.943004:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693559005936 time 693558745520 state 0x1 ref 1
00000100:00100000:2.0:1789760721.943031:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693559005936 time 693629714105 state 0x0 ref 1
00000100:00100000:2.0:1789760721.943045:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520887552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760721.943089:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20209664, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:2.0:1789760721.943098:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.943125:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:2.0:1789760721.943130:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760721.943136:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.943150:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760721.977161:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972254 is committed
00002000:00010000:2.0:1789760721.977777:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20209664 -> 20213760
00010000:00010000:2.0:1789760721.977792:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.977806:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.977814:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.977821:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760721.977825:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.977835:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.977854:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760721.977861:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60b9cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20209664->20213759] (req 20209664->20213759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760721.978049:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520887552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35002us (35210us total) trans 4294972254 rc 0/0
00000100:00100000:2.0:1789760721.978059:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4967
00000100:00100000:2.0:1789760721.978067:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693559005936 time 693629714105 state 0x2 ref 0
00000100:00100000:2.0:1789760721.992239:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760721.992470:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520887680
00000100:00100000:1.0:1789760721.992480:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520887680
00000100:00100000:1.0:1789760721.992530:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693559005936 time 693629714105 state 0x0 ref 1
00000100:00100000:1.0:1789760721.992544:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693629974521 time 693629714105 state 0x1 ref 1
00000100:00100000:1.0:1789760721.992616:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693629974521 time 693679289913 state 0x0 ref 1
00000100:00100000:1.0:1789760721.992629:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520887680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760721.992683:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20213760, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:1.0:1789760721.992693:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.992708:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:1.0:1789760721.992713:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760721.992719:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760721.992732:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760722.037303:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972255 is committed
00002000:00010000:0.0:1789760722.037945:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20213760 -> 20217856
00010000:00010000:0.0:1789760722.037963:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.037975:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.037984:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.037991:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760722.037995:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.038004:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.038022:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.038030:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60b9d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20213760->20217855] (req 20213760->20217855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760722.038125:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520887680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45494us (45891us total) trans 4294972255 rc 0/0
00000100:00100000:0.0:1789760722.038135:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4968
00000100:00100000:0.0:1789760722.038144:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693629974521 time 693679289913 state 0x2 ref 0
00000100:00100000:3.0:1789760722.042482:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760722.042705:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520887808
00000100:00100000:2.0:1789760722.042714:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520887808
00000100:00100000:2.0:1789760722.042830:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693629974521 time 693679289913 state 0x0 ref 1
00000100:00100000:2.0:1789760722.042847:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693679550329 time 693679289913 state 0x1 ref 1
00000100:00100000:2.0:1789760722.042893:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693679550329 time 693729567076 state 0x0 ref 1
00000100:00100000:2.0:1789760722.042907:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520887808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760722.042959:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20217856, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:2.0:1789760722.042970:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.042986:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:2.0:1789760722.042992:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760722.042999:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.043011:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760722.043029:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548743552:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.043082:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.043125:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548744064:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.043745:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.043768:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548744576:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.043792:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.043810:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548745088:0@lo:400:kworker.0
00000100:00080000:3.0:1789760722.043818:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760722.043838:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.043865:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2]
00000100:00100000:0.0:1789760722.043872:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548743680:0@lo:400:kworker.0
00000100:00100000:3.0:1789760722.043879:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548744576
00000100:00100000:3.0:1789760722.043897:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548744576
00000100:00100000:0.0:1789760722.043911:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.043929:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548744192:0@lo:400:kworker.0
00000100:00100000:3.0:1789760722.043935:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548745088
00000100:00100000:3.0:1789760722.043945:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548745088
00000100:00100000:0.0:1789760722.043951:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.043968:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548744704:0@lo:400:kworker.0
00000100:00100000:3.0:1789760722.043979:0:9637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270
00000100:00100000:3.0:1789760722.043989:0:9637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548744576:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.043993:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.044013:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548745216:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760722.044048:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760722.044058:0:9637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548744576:12345-0@lo:400:kworker.0 Request processed in 70us (264us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760722.044068:0:9637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270
00000100:00100000:0.0:1789760722.044084:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548744576:0@lo:400:kworker.0
00000100:00100000:3.0:1789760722.044089:0:9637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271
00000100:00100000:3.0:1789760722.044100:0:9637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc825b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548745088:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.044122:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548743808:0@lo:400:kworker.0
00000100:00100000:3.0:1789760722.044140:0:9637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc825b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548745088:12345-0@lo:400:kworker.0 Request processed in 42us (302us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760722.044147:0:9637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271
00000100:00100000:1.0:1789760722.044280:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548743552
00000100:00100000:1.0:1789760722.044285:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548743552
00000100:00100000:1.0:1789760722.044340:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463
00000100:00100000:1.0:1789760722.044348:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda0059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548743552:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760722.044400:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda0059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548743552:12345-0@lo:400:kworker.0 Request processed in 43us (1307us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760722.044408:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463
00000100:00080000:3.0:1789760722.044420:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789760722.044451:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548743680
00000100:00100000:1.0:1789760722.044456:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548743680
00000100:00100000:1.0:1789760722.044484:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548744192
00000100:00100000:1.0:1789760722.044487:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548744192
00000100:00100000:1.0:1789760722.044511:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548744704
00000100:00100000:1.0:1789760722.044513:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548744704
00000100:00100000:1.0:1789760722.044527:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837
00000100:00100000:1.0:1789760722.044535:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548743680:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760722.044570:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548743680:12345-0@lo:400:kworker.0 Request processed in 36us (658us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760722.044577:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837
00000100:00100000:1.0:1789760722.044591:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838
00000100:00100000:1.0:1789760722.044599:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548744192:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760722.044635:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548744192:12345-0@lo:400:kworker.0 Request processed in 37us (684us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760722.045002:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838
00000100:00100000:3.0:1789760722.045016:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839
00000100:00100000:3.0:1789760722.045028:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548744704:12345-0@lo:400:kworker.0
00000100:00080000:1.0:1789760722.045040:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:3.0:1789760722.045070:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548744704:12345-0@lo:400:kworker.0 Request processed in 44us (1078us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760722.045077:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839
00000100:00100000:0.0:1789760722.045795:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.045833:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3453:1876699548744320:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.045858:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.045876:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3453:1876699548744832:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.045907:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.045933:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548745344:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760722.045956:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.045974:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:0.0:1789760722.045980:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548743936:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.046000:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.046016:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548744448:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.046037:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.046051:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548744960:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.046070:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760722.046102:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548744064
00000100:00100000:0.0:1789760722.046108:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548744064
00000100:00100000:0.0:1789760722.046137:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548743808
00000100:00100000:0.0:1789760722.046140:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548743808
00000100:00100000:0.0:1789760722.046152:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411
00000100:00100000:0.0:1789760722.046158:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548744064:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.046193:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548744064:12345-0@lo:400:kworker.0 Request processed in 36us (2449us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760722.046201:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411
00000100:00100000:0.0:1789760722.046214:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412
00000100:00100000:0.0:1789760722.046220:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548743808:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.046249:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548743808:12345-0@lo:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760722.046255:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412
00000100:00100000:0.0:1789760722.046273:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548745216
00000100:00100000:0.0:1789760722.046276:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548745216
00000100:00100000:0.0:1789760722.046300:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548745344
00000100:00100000:0.0:1789760722.046302:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548745344
00000100:00100000:0.0:1789760722.046334:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344
00000100:00100000:0.0:1789760722.046342:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc19e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548745216:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1789760722.046367:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760722.046399:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc19e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548745216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (2351us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760722.046405:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344
00000100:00100000:0.0:1789760722.046604:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345
00000100:00100000:0.0:1789760722.046611:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548745344:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:0.0:1789760722.046620:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760722.046785:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548744320
00000100:00100000:1.0:1789760722.046790:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548744320
00000100:00100000:1.0:1789760722.046815:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548744832
00000100:00100000:1.0:1789760722.046818:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548744832
00000100:00100000:1.0:1789760722.046834:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548743936
00000100:00100000:1.0:1789760722.046837:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548743936
00000100:00100000:1.0:1789760722.046851:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840
00000100:00100000:1.0:1789760722.046857:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876699548744320:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760722.046902:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876699548744320:12345-0@lo:400:kworker.0 Request processed in 45us (1042us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760722.046907:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840
00000100:00100000:1.0:1789760722.046920:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841
00000100:00100000:1.0:1789760722.046926:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876699548744832:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760722.046951:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876699548744832:12345-0@lo:400:kworker.0 Request processed in 26us (1043us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760722.046957:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841
00000100:00100000:1.0:1789760722.046966:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842
00000100:00100000:1.0:1789760722.046971:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548743936:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760722.046994:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548743936:12345-0@lo:400:kworker.0 Request processed in 23us (993us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760722.047000:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842
00000100:00080000:1.0:1789760722.047036:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1789760722.047040:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1789760722.050754:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548745344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (688us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760722.050947:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345
00000100:00100000:0.0:1789760722.051004:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548744448
00000100:00100000:0.0:1789760722.051013:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548744448
00000100:00100000:0.0:1789760722.051056:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548744960
00000100:00100000:0.0:1789760722.051059:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548744960
00000100:00100000:0.0:1789760722.051081:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272
00000100:00100000:0.0:1789760722.051090:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548744448:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051172:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548744448:12345-0@lo:400:kworker.0 Request processed in 84us (5134us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760722.051179:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272
00000100:00100000:0.0:1789760722.051191:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273
00000100:00100000:0.0:1789760722.051198:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548744960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051226:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548744960:12345-0@lo:400:kworker.0 Request processed in 29us (5155us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760722.051232:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273
00000100:00100000:0.0:1789760722.051297:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548743936:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051310:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548744448:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051351:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548744960:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051370:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548745344:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760722.051383:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548743808:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051394:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3453:1876699548744320:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051405:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3453:1876699548744832:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051470:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548743680:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051481:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548744192:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051491:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548744704:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051503:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548745216:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760722.051513:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548743552:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051523:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548744064:0@lo:400:kworker.0
00000100:00100000:0.0:1789760722.051531:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548745088:0@lo:400:kworker.0
00000001:00080000:0.0:1789760722.090000:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972256 is committed
00002000:00010000:3.0:1789760722.090110:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20217856 -> 20221952
00010000:00010000:3.0:1789760722.090128:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.090140:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.090153:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.090160:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760722.090165:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.090174:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.090194:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.090202:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60b9d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20217856->20221951] (req 20217856->20221951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760722.090359:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520887808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47451us (47882us total) trans 4294972256 rc 0/0
00000100:00100000:3.0:1789760722.090369:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4969
00000100:00100000:3.0:1789760722.090378:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693679550329 time 693729567076 state 0x2 ref 0
00000100:00100000:2.0:1789760722.097139:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760722.097240:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520887936
00000100:00100000:0.0:1789760722.097251:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520887936
00000100:00100000:0.0:1789760722.097305:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693679550329 time 693729567076 state 0x0 ref 1
00000100:00100000:0.0:1789760722.097357:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693729827492 time 693729567076 state 0x1 ref 1
00000100:00100000:0.0:1789760722.097381:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693729827492 time 693784064237 state 0x0 ref 1
00000100:00100000:0.0:1789760722.097392:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520887936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760722.097439:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20221952, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:0.0:1789760722.097447:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.097463:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:0.0:1789760722.097468:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760722.097475:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.097488:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760722.158381:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972257 is committed
00002000:00010000:2.0:1789760722.159306:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20221952 -> 20226048
00010000:00010000:2.0:1789760722.159338:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.159353:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.159363:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.159371:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760722.159376:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.159385:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.159405:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.159479:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60b9e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20221952->20226047] (req 20221952->20226047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760722.160490:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520887936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63092us (63355us total) trans 4294972257 rc 0/0
00000100:00100000:2.0:1789760722.160502:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4970
00000100:00100000:2.0:1789760722.160511:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693729827492 time 693784064237 state 0x2 ref 0
00000100:00100000:2.0:1789760722.166133:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760722.166554:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520888064
00000100:00100000:0.0:1789760722.166564:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520888064
00000100:00100000:0.0:1789760722.166617:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693729827492 time 693784064237 state 0x0 ref 1
00000100:00100000:0.0:1789760722.166633:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693784324653 time 693784064237 state 0x1 ref 1
00000100:00100000:0.0:1789760722.166670:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693784324653 time 693853352075 state 0x0 ref 1
00000100:00100000:0.0:1789760722.166683:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520888064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760722.166732:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20226048, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:0.0:1789760722.166740:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.166755:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:0.0:1789760722.167062:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760722.167069:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.167083:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760722.212865:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20226048 -> 20230144
00010000:00010000:0.0:1789760722.212897:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.212982:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760722.213077:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972258 is committed
00010000:00010000:0.0:1789760722.213120:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.213128:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760722.213132:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.213141:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.213161:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.213168:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60b9e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20226048->20230143] (req 20226048->20230143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760722.213267:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520888064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46583us (47139us total) trans 4294972258 rc 0/0
00000100:00100000:0.0:1789760722.213278:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4971
00000100:00100000:0.0:1789760722.213289:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693784324653 time 693853352075 state 0x2 ref 0
00000100:00100000:3.0:1789760722.221134:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760722.221579:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520888192
00000100:00100000:1.0:1789760722.221592:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520888192
00000100:00100000:1.0:1789760722.221655:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693784324653 time 693853352075 state 0x0 ref 1
00000100:00100000:1.0:1789760722.221673:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693853612491 time 693853352075 state 0x1 ref 1
00000100:00100000:1.0:1789760722.221709:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693853612491 time 693908391713 state 0x0 ref 1
00000100:00100000:1.0:1789760722.221722:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520888192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760722.221772:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20230144, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:1.0:1789760722.222146:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.222165:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:1.0:1789760722.222170:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760722.222177:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.222193:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760722.277303:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972259 is committed
00002000:00010000:3.0:1789760722.277571:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20230144 -> 20234240
00010000:00010000:3.0:1789760722.277586:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.277603:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.277611:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.277617:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760722.277622:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.277630:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.277778:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.277787:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60b9ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20230144->20234239] (req 20230144->20234239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760722.277874:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520888192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56150us (56746us total) trans 4294972259 rc 0/0
00000100:00100000:3.0:1789760722.277894:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4972
00000100:00100000:3.0:1789760722.277904:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693853612491 time 693908391713 state 0x2 ref 0
00000100:00100000:2.0:1789760722.281399:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760722.281478:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520888320
00000100:00100000:3.0:1789760722.281489:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520888320
00000100:00100000:3.0:1789760722.281550:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693853612491 time 693908391713 state 0x0 ref 1
00000100:00100000:3.0:1789760722.281565:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693908652129 time 693908391713 state 0x1 ref 1
00000100:00100000:3.0:1789760722.281596:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693908652129 time 693968278951 state 0x0 ref 1
00000100:00100000:3.0:1789760722.281608:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520888320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760722.281659:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20234240, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:3.0:1789760722.281669:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.281686:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=693s v=(0 0)
00010000:00010000:3.0:1789760722.281690:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760722.281697:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.281712:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760722.333276:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972260 is committed
00002000:00010000:2.0:1789760722.333399:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20234240 -> 20238336
00010000:00010000:2.0:1789760722.333426:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.333440:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.333450:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.333457:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760722.333463:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.333473:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.333494:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.333503:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60b9f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20234240->20238335] (req 20234240->20238335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760722.333611:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520888320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52000us (52292us total) trans 4294972260 rc 0/0
00000100:00100000:2.0:1789760722.333621:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4973
00000100:00100000:2.0:1789760722.333630:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693908652129 time 693968278951 state 0x2 ref 0
00000100:00100000:0.0:1789760722.338452:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760722.338654:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520888448
00000100:00100000:2.0:1789760722.338664:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520888448
00000100:00100000:2.0:1789760722.338717:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693908652129 time 693968278951 state 0x0 ref 1
00000100:00100000:2.0:1789760722.338733:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693968539367 time 693968278951 state 0x1 ref 1
00000100:00100000:2.0:1789760722.338761:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693968539367 time 694025444100 state 0x0 ref 1
00000100:00100000:2.0:1789760722.338773:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520888448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760722.338817:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20238336, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:2.0:1789760722.338825:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.338840:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:2.0:1789760722.338845:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760722.338851:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.338863:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760722.380630:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972261 is committed
00002000:00010000:2.0:1789760722.381891:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20238336 -> 20242432
00010000:00010000:2.0:1789760722.381909:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.381922:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.381932:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.381940:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760722.381944:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.381953:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.381971:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.381979:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60b9fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20238336->20242431] (req 20238336->20242431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760722.382185:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520888448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43407us (43735us total) trans 4294972261 rc 0/0
00000100:00100000:2.0:1789760722.382196:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4974
00000100:00100000:2.0:1789760722.382206:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693968539367 time 694025444100 state 0x2 ref 0
00000100:00100000:1.0:1789760722.389132:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760722.389219:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520888576
00000100:00100000:0.0:1789760722.389231:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520888576
00000100:00100000:0.0:1789760722.389302:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 693968539367 time 694025444100 state 0x0 ref 1
00000100:00100000:0.0:1789760722.390803:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694025704516 time 694025444100 state 0x1 ref 1
00000100:00100000:2.0:1789760722.390928:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694025704516 time 694077608069 state 0x0 ref 1
00000100:00100000:2.0:1789760722.390951:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520888576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760722.391004:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20242432, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:2.0:1789760722.391013:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.391028:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:2.0:1789760722.391033:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760722.391039:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.391052:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760722.424869:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972262 is committed
00002000:00010000:3.0:1789760722.425286:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20242432 -> 20246528
00010000:00010000:3.0:1789760722.425310:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.425343:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.425359:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.425367:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760722.425372:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.425383:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.425403:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.425410:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ba03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20242432->20246527] (req 20242432->20246527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760722.425807:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520888576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34860us (36679us total) trans 4294972262 rc 0/0
00000100:00100000:3.0:1789760722.425819:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4975
00000100:00100000:3.0:1789760722.425829:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694025704516 time 694077608069 state 0x2 ref 0
00000100:00100000:0.0:1789760722.431855:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760722.431918:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520888704
00000100:00100000:3.0:1789760722.431929:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520888704
00000100:00100000:3.0:1789760722.431979:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694025704516 time 694077608069 state 0x0 ref 1
00000100:00100000:3.0:1789760722.431996:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694077868485 time 694077608069 state 0x1 ref 1
00000100:00100000:3.0:1789760722.432031:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694077868485 time 694118714020 state 0x0 ref 1
00000100:00100000:3.0:1789760722.432044:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520888704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760722.432105:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20246528, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:3.0:1789760722.432115:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.432133:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:3.0:1789760722.432138:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760722.432144:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.432157:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760722.467272:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20246528 -> 20250624
00010000:00010000:0.0:1789760722.467291:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.467303:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.467329:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.467339:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760722.467344:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.467354:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.467371:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.467379:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ba0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20246528->20250623] (req 20246528->20250623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760722.467485:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520888704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35438us (35633us total) trans 4294972263 rc 0/0
00000100:00100000:0.0:1789760722.467496:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4976
00000100:00100000:0.0:1789760722.467505:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694077868485 time 694118714020 state 0x2 ref 0
00000100:00100000:3.0:1789760722.471356:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760722.471685:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520888832
00000100:00100000:0.0:1789760722.471696:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520888832
00000100:00100000:0.0:1789760722.471750:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694077868485 time 694118714020 state 0x0 ref 1
00000100:00100000:0.0:1789760722.471764:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694118974436 time 694118714020 state 0x1 ref 1
00000100:00100000:0.0:1789760722.471785:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694118974436 time 694158468950 state 0x0 ref 1
00000100:00100000:0.0:1789760722.471797:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520888832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760722.471847:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20250624, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:0.0:1789760722.471856:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.471871:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:0.0:1789760722.471876:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760722.471890:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.471903:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760722.473024:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972263 is committed
00010000:00010000:0.0:1789760722.489625:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760722.524337:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972264 is committed
00002000:00010000:2.0:1789760722.524460:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20250624 -> 20254720
00010000:00010000:2.0:1789760722.524480:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.524494:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.524503:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.524522:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760722.525030:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.525043:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.525064:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.525071:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60ba11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20250624->20254719] (req 20250624->20254719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760722.525169:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520888832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53369us (53819us total) trans 4294972264 rc 0/0
00000100:00100000:2.0:1789760722.525232:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4977
00000100:00100000:2.0:1789760722.525243:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694118974436 time 694158468950 state 0x2 ref 0
00000100:00100000:3.0:1789760722.529858:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760722.530071:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520888960
00000100:00100000:1.0:1789760722.530081:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520888960
00000100:00100000:1.0:1789760722.530137:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694118974436 time 694158468950 state 0x0 ref 1
00000100:00100000:1.0:1789760722.530153:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694158729366 time 694158468950 state 0x1 ref 1
00000100:00100000:0.0:1789760722.530373:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694158729366 time 694217053369 state 0x0 ref 1
00000100:00100000:0.0:1789760722.530603:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520888960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760722.530770:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20254720, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:0.0:1789760722.530781:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.530798:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:0.0:1789760722.530802:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760722.530809:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.530824:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760722.597740:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972265 is committed
00002000:00010000:3.0:1789760722.597828:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20254720 -> 20258816
00010000:00010000:3.0:1789760722.597844:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.597857:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.597866:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.597874:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760722.597891:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.597900:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.597919:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.597927:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60ba18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20254720->20258815] (req 20254720->20258815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760722.598049:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520888960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67447us (68195us total) trans 4294972265 rc 0/0
00000100:00100000:3.0:1789760722.598058:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4978
00000100:00100000:3.0:1789760722.598065:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694158729366 time 694217053369 state 0x2 ref 0
00000100:00100000:0.0:1789760722.604239:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760722.604362:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520889088
00000100:00100000:3.0:1789760722.604373:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520889088
00000100:00100000:3.0:1789760722.604439:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694158729366 time 694217053369 state 0x0 ref 1
00000100:00100000:3.0:1789760722.604454:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694217313785 time 694217053369 state 0x1 ref 1
00000100:00100000:3.0:1789760722.604485:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694217313785 time 694291167698 state 0x0 ref 1
00000100:00100000:3.0:1789760722.604500:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520889088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760722.604553:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20258816, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:3.0:1789760722.604563:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.604578:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:3.0:1789760722.604581:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760722.604587:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.604599:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760722.647529:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972266 is committed
00002000:00010000:3.0:1789760722.647730:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20258816 -> 20262912
00010000:00010000:3.0:1789760722.647745:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.647757:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.647766:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.647773:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760722.647779:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.647787:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.647805:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.647813:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20258816->20262911] (req 20258816->20262911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760722.647917:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520889088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43414us (43683us total) trans 4294972266 rc 0/0
00000100:00100000:3.0:1789760722.647928:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4979
00000100:00100000:3.0:1789760722.647938:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694217313785 time 694291167698 state 0x2 ref 0
00000100:00100000:2.0:1789760722.655712:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760722.655999:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520889216
00000100:00100000:1.0:1789760722.656010:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520889216
00000100:00100000:1.0:1789760722.656067:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694217313785 time 694291167698 state 0x0 ref 1
00000100:00100000:1.0:1789760722.656085:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694291428114 time 694291167698 state 0x1 ref 1
00000100:00100000:1.0:1789760722.656191:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694291428114 time 694342871444 state 0x0 ref 1
00000100:00100000:1.0:1789760722.656206:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520889216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760722.656262:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20262912, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:1.0:1789760722.656271:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.656288:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:1.0:1789760722.656293:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760722.656301:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.656336:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760722.697864:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20262912 -> 20267008
00010000:00010000:1.0:1789760722.697892:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.697905:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.697915:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.697922:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760722.697928:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.697937:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.697956:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.697972:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20262912->20267007] (req 20262912->20267007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760722.698056:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520889216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41849us (42598us total) trans 4294972267 rc 0/0
00000100:00100000:1.0:1789760722.698066:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4980
00000100:00100000:1.0:1789760722.698076:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694291428114 time 694342871444 state 0x2 ref 0
00000100:00100000:3.0:1789760722.701063:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760722.701151:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520889344
00000100:00100000:2.0:1789760722.701160:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520889344
00000100:00100000:2.0:1789760722.701211:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694291428114 time 694342871444 state 0x0 ref 1
00000100:00100000:2.0:1789760722.701225:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694343131860 time 694342871444 state 0x1 ref 1
00000100:00100000:2.0:1789760722.701253:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694343131860 time 694387935826 state 0x0 ref 1
00000100:00100000:2.0:1789760722.701264:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520889344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760722.701308:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20267008, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:2.0:1789760722.701347:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.701363:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:2.0:1789760722.701367:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760722.701374:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.701387:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760722.704426:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972267 is committed
00000001:00080000:0.0:1789760722.723722:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972268 is committed
00002000:00010000:2.0:1789760722.723830:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20267008 -> 20271104
00010000:00010000:2.0:1789760722.723846:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.723863:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.723871:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.723889:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760722.723895:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.723904:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.723923:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.723930:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ba2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20267008->20271103] (req 20267008->20271103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760722.724024:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520889344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 22756us (22965us total) trans 4294972268 rc 0/0
00000100:00100000:2.0:1789760722.724034:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4981
00000100:00100000:2.0:1789760722.724044:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694343131860 time 694387935826 state 0x2 ref 0
00000100:00100000:2.0:1789760722.727728:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760722.727806:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520889472
00000100:00100000:3.0:1789760722.727816:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520889472
00000100:00100000:3.0:1789760722.727870:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694343131860 time 694387935826 state 0x0 ref 1
00000100:00100000:3.0:1789760722.727895:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694388196242 time 694387935826 state 0x1 ref 1
00000100:00100000:3.0:1789760722.727926:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694388196242 time 694414608362 state 0x0 ref 1
00000100:00100000:3.0:1789760722.727936:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520889472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760722.727985:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20271104, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:3.0:1789760722.727994:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.728010:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:3.0:1789760722.728014:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760722.728020:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.728035:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760722.757214:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972269 is committed
00002000:00010000:3.0:1789760722.757344:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20271104 -> 20275200
00010000:00010000:3.0:1789760722.757361:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.757373:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.757380:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.757387:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760722.757391:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.757401:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.757436:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760722.757444:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ba34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20271104->20275199] (req 20271104->20275199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760722.757699:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520889472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29756us (29975us total) trans 4294972269 rc 0/0
00000100:00100000:3.0:1789760722.757711:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4982
00000100:00100000:3.0:1789760722.757723:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694388196242 time 694414608362 state 0x2 ref 0
00000100:00100000:3.0:1789760722.761288:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760722.761508:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520889600
00000100:00100000:0.0:1789760722.761578:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520889600
00000100:00100000:0.0:1789760722.761638:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694388196242 time 694414608362 state 0x0 ref 1
00000100:00100000:0.0:1789760722.761655:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694414868778 time 694414608362 state 0x1 ref 1
00000100:00100000:0.0:1789760722.761727:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694414868778 time 694448408681 state 0x0 ref 1
00000100:00100000:0.0:1789760722.761740:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520889600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760722.761791:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20275200, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:0.0:1789760722.761801:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.761816:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:0.0:1789760722.761820:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760722.761827:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.761840:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760722.793002:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20275200 -> 20279296
00010000:00010000:1.0:1789760722.793021:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.793040:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.793049:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.793057:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760722.793062:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.793071:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.793090:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.793098:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ba3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20275200->20279295] (req 20275200->20279295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760722.793194:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520889600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31452us (31910us total) trans 4294972270 rc 0/0
00000100:00100000:1.0:1789760722.793204:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4983
00000100:00100000:1.0:1789760722.793213:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694414868778 time 694448408681 state 0x2 ref 0
00000100:00100000:3.0:1789760722.796572:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760722.796697:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520889728
00000100:00100000:1.0:1789760722.796707:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520889728
00000100:00100000:1.0:1789760722.796755:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694414868778 time 694448408681 state 0x0 ref 1
00000100:00100000:1.0:1789760722.796769:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694448669097 time 694448408681 state 0x1 ref 1
00000100:00100000:1.0:1789760722.796788:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694448669097 time 694483470965 state 0x0 ref 1
00000100:00100000:1.0:1789760722.796798:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520889728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760722.796842:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20279296, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:1.0:1789760722.796851:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.796865:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:1.0:1789760722.796869:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760722.796875:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.796899:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760722.801200:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972270 is committed
00000001:00080000:3.0:1789760722.845762:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972271 is committed
00002000:00010000:1.0:1789760722.846141:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20279296 -> 20283392
00010000:00010000:1.0:1789760722.846157:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.846170:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.846184:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.846192:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760722.846197:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.846206:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.846224:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.846231:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20279296->20283391] (req 20279296->20283391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760722.846445:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520889728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49642us (49875us total) trans 4294972271 rc 0/0
00000100:00100000:1.0:1789760722.846455:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4984
00000100:00100000:1.0:1789760722.846464:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694448669097 time 694483470965 state 0x2 ref 0
00000100:00100000:3.0:1789760722.851145:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760722.852714:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520889856
00000100:00100000:2.0:1789760722.852730:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520889856
00000100:00100000:2.0:1789760722.852801:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694448669097 time 694483470965 state 0x0 ref 1
00000100:00100000:2.0:1789760722.852818:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694483731381 time 694483470965 state 0x1 ref 1
00000100:00100000:2.0:1789760722.852841:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694483731381 time 694539523961 state 0x0 ref 1
00000100:00100000:2.0:1789760722.852853:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520889856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760722.852911:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20283392, mtime: 0x6aad94d3, atime: 0x0, ctime: 0x6aad94d3, blocks: 0xa007
00010000:00010000:2.0:1789760722.852921:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.852936:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:2.0:1789760722.852941:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760722.852947:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.852961:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760722.896496:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972272 is committed
00002000:00010000:2.0:1789760722.896642:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20283392 -> 20287488
00002000:00010000:2.0:1789760722.896647:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760723 -> 1789760724
00002000:00010000:2.0:1789760722.896650:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760723 -> 1789760724
00010000:00010000:2.0:1789760722.896662:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.896680:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.896688:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.896695:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760722.896700:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.896709:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.896728:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.896735:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60ba49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20283392->20287487] (req 20283392->20287487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760722.896837:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520889856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43980us (45974us total) trans 4294972272 rc 0/0
00000100:00100000:2.0:1789760722.896847:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4985
00000100:00100000:2.0:1789760722.896856:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694483731381 time 694539523961 state 0x2 ref 0
00000100:00100000:3.0:1789760722.900186:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760722.900266:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520889984
00000100:00100000:0.0:1789760722.900276:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520889984
00000100:00100000:0.0:1789760722.900703:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694483731381 time 694539523961 state 0x0 ref 1
00000100:00100000:0.0:1789760722.900718:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694539784377 time 694539523961 state 0x1 ref 1
00000100:00100000:0.0:1789760722.900748:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694539784377 time 694587430733 state 0x0 ref 1
00000100:00100000:0.0:1789760722.900821:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520889984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760722.900870:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20287488, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:0.0:1789760722.900890:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.900907:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:0.0:1789760722.900912:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760722.900919:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.900933:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760722.933042:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972273 is committed
00002000:00010000:1.0:1789760722.933154:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20287488 -> 20291584
00010000:00010000:1.0:1789760722.933169:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.933185:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.933194:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.933201:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760722.933206:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.933215:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.933234:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.933242:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ba50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20287488->20291583] (req 20287488->20291583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760722.933416:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520889984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32587us (33227us total) trans 4294972273 rc 0/0
00000100:00100000:1.0:1789760722.933427:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4986
00000100:00100000:1.0:1789760722.933436:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694539784377 time 694587430733 state 0x2 ref 0
00000100:00100000:2.0:1789760722.938715:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760722.938799:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520890112
00000100:00100000:0.0:1789760722.938808:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520890112
00000100:00100000:0.0:1789760722.938860:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694539784377 time 694587430733 state 0x0 ref 1
00000100:00100000:0.0:1789760722.938895:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694587691149 time 694587430733 state 0x1 ref 1
00000100:00100000:0.0:1789760722.938925:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694587691149 time 694625606971 state 0x0 ref 1
00000100:00100000:0.0:1789760722.938938:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520890112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760722.938984:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20291584, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:0.0:1789760722.938993:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.939008:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:0.0:1789760722.939012:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760722.939019:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760722.939034:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760722.959369:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972274 is committed
00002000:00010000:1.0:1789760722.959572:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20291584 -> 20295680
00010000:00010000:1.0:1789760722.959589:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.959601:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.959610:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.959617:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760722.959622:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.959630:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.959650:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.959659:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60ba57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20291584->20295679] (req 20291584->20295679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760722.959747:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520890112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 20807us (21036us total) trans 4294972274 rc 0/0
00000100:00100000:1.0:1789760722.959757:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4987
00000100:00100000:1.0:1789760722.959767:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694587691149 time 694625606971 state 0x2 ref 0
00000100:00100000:3.0:1789760722.962893:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760722.962970:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520890240
00000100:00100000:1.0:1789760722.962980:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520890240
00000100:00100000:1.0:1789760722.963033:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694587691149 time 694625606971 state 0x0 ref 1
00000100:00100000:1.0:1789760722.963051:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694625867387 time 694625606971 state 0x1 ref 1
00000100:00100000:1.0:1789760722.963086:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694625867387 time 694649768729 state 0x0 ref 1
00000100:00100000:1.0:1789760722.963099:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520890240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760722.963144:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20295680, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760722.963153:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.963170:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:1.0:1789760722.963175:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760722.963181:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.963194:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760722.991992:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972275 is committed
00002000:00010000:1.0:1789760722.992138:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20295680 -> 20299776
00010000:00010000:1.0:1789760722.992154:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.992168:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.992177:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.992185:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760722.992190:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.992199:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.992219:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760722.992227:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20295680->20299775] (req 20295680->20299775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760722.992391:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520890240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29290us (29512us total) trans 4294972275 rc 0/0
00000100:00100000:1.0:1789760722.992402:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4988
00000100:00100000:1.0:1789760722.992419:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694625867387 time 694649768729 state 0x2 ref 0
00000100:00100000:3.0:1789760722.996005:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760722.996204:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520890368
00000100:00100000:2.0:1789760722.996213:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520890368
00000100:00100000:2.0:1789760722.996266:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694625867387 time 694649768729 state 0x0 ref 1
00000100:00100000:2.0:1789760722.996280:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694650029145 time 694649768729 state 0x1 ref 1
00000100:00100000:2.0:1789760722.996353:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694650029145 time 694682995458 state 0x0 ref 1
00000100:00100000:2.0:1789760722.996367:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520890368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760722.996412:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20299776, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:2.0:1789760722.996421:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.996438:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:2.0:1789760722.996441:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760722.996447:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760722.996460:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760723.023683:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972276 is committed
00002000:00010000:1.0:1789760723.023860:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20299776 -> 20303872
00010000:00010000:1.0:1789760723.023884:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.023903:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.023912:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.023919:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.023924:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.023933:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.023953:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.023960:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ba65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20299776->20303871] (req 20299776->20303871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.024051:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520890368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27682us (28051us total) trans 4294972276 rc 0/0
00000100:00100000:1.0:1789760723.024061:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4989
00000100:00100000:1.0:1789760723.024071:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694650029145 time 694682995458 state 0x2 ref 0
00000100:00100000:3.0:1789760723.027271:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.027419:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520890496
00000100:00100000:1.0:1789760723.027429:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520890496
00000100:00100000:1.0:1789760723.027481:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694650029145 time 694682995458 state 0x0 ref 1
00000100:00100000:1.0:1789760723.027496:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694683255874 time 694682995458 state 0x1 ref 1
00000100:00100000:1.0:1789760723.027528:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694683255874 time 694714210186 state 0x0 ref 1
00000100:00100000:1.0:1789760723.027540:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520890496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.027587:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20303872, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.027596:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.027611:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:1.0:1789760723.027616:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.027623:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.027637:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760723.059947:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972277 is committed
00002000:00010000:1.0:1789760723.060095:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20303872 -> 20307968
00010000:00010000:1.0:1789760723.060114:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.060127:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.060142:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.060150:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.060155:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.060165:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.060188:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.064654:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20303872->20307967] (req 20303872->20307967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.066358:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520890496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38811us (39088us total) trans 4294972277 rc 0/0
00000100:00100000:1.0:1789760723.066373:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4990
00000100:00100000:1.0:1789760723.066382:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694683255874 time 694714210186 state 0x2 ref 0
00000100:00100000:3.0:1789760723.075184:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.075266:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520890624
00000100:00100000:1.0:1789760723.075275:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520890624
00000100:00100000:1.0:1789760723.075359:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694683255874 time 694714210186 state 0x0 ref 1
00000100:00100000:1.0:1789760723.075373:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694714470602 time 694714210186 state 0x1 ref 1
00000100:00100000:1.0:1789760723.075443:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694714470602 time 694762125816 state 0x0 ref 1
00000100:00100000:1.0:1789760723.075456:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520890624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.075501:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20307968, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.075511:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.075526:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:1.0:1789760723.075531:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.075537:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.075550:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760723.139776:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20307968 -> 20312064
00010000:00010000:1.0:1789760723.139795:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.139808:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.139818:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.139826:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.139831:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.139841:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.139861:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.139869:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20307968->20312063] (req 20307968->20312063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.139970:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520890624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64512us (64792us total) trans 4294972278 rc 0/0
00000100:00100000:1.0:1789760723.139981:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4991
00000100:00100000:1.0:1789760723.139990:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694714470602 time 694762125816 state 0x2 ref 0
00000001:00080000:2.0:1789760723.141049:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972278 is committed
00000100:00100000:3.0:1789760723.143171:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.143259:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520890752
00000100:00100000:1.0:1789760723.143268:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520890752
00000100:00100000:1.0:1789760723.143366:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694714470602 time 694762125816 state 0x0 ref 1
00000100:00100000:1.0:1789760723.143381:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694762386232 time 694762125816 state 0x1 ref 1
00000100:00100000:1.0:1789760723.143401:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694762386232 time 694830084560 state 0x0 ref 1
00000100:00100000:1.0:1789760723.143422:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520890752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.143465:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20312064, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.143475:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.143491:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:1.0:1789760723.143495:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.143501:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.143609:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760723.172135:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20312064 -> 20316160
00010000:00010000:1.0:1789760723.172153:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.172167:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.172177:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.172186:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.172191:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.172200:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.172225:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.172233:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20312064->20316159] (req 20312064->20316159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.172347:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520890752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28931us (29179us total) trans 4294972279 rc 0/0
00000100:00100000:1.0:1789760723.172358:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4992
00000100:00100000:1.0:1789760723.172369:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694762386232 time 694830084560 state 0x2 ref 0
00000001:00080000:3.0:1789760723.172800:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972279 is committed
00000100:00100000:0.0:1789760723.176080:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760723.176575:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520890880
00000100:00100000:3.0:1789760723.176586:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520890880
00000100:00100000:2.0:1789760723.176788:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694762386232 time 694830084560 state 0x0 ref 1
00000100:00100000:2.0:1789760723.176807:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694830344976 time 694830084560 state 0x1 ref 1
00000100:00100000:2.0:1789760723.176872:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694830344976 time 694863553786 state 0x0 ref 1
00000100:00100000:2.0:1789760723.176894:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520890880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760723.176941:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20316160, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:2.0:1789760723.176950:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.176965:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:2.0:1789760723.176969:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760723.176975:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.176988:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760723.194893:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972280 is committed
00002000:00010000:1.0:1789760723.194927:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20316160 -> 20320256
00010000:00010000:1.0:1789760723.194943:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.194956:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.194965:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.194972:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.194976:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.194991:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.195010:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.195018:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20316160->20320255] (req 20316160->20320255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.195119:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520890880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 18223us (19040us total) trans 4294972280 rc 0/0
00000100:00100000:1.0:1789760723.195130:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4993
00000100:00100000:1.0:1789760723.195139:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694830344976 time 694863553786 state 0x2 ref 0
00000100:00100000:0.0:1789760723.198423:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.198491:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520891008
00000100:00100000:1.0:1789760723.198501:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520891008
00000100:00100000:1.0:1789760723.198558:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694830344976 time 694863553786 state 0x0 ref 1
00000100:00100000:1.0:1789760723.198573:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694863814202 time 694863553786 state 0x1 ref 1
00000100:00100000:1.0:1789760723.198613:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694863814202 time 694885295495 state 0x0 ref 1
00000100:00100000:1.0:1789760723.198626:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520891008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.198675:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20320256, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.198685:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.198706:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:1.0:1789760723.198710:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.198717:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.198733:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760723.225989:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972281 is committed
00002000:00010000:1.0:1789760723.226086:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20320256 -> 20324352
00010000:00010000:1.0:1789760723.226100:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.226113:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.226122:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.226131:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.226136:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.226144:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.226165:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.226173:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60ba88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20320256->20324351] (req 20320256->20324351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.226264:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520891008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27636us (27846us total) trans 4294972281 rc 0/0
00000100:00100000:1.0:1789760723.226274:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4994
00000100:00100000:1.0:1789760723.226283:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694863814202 time 694885295495 state 0x2 ref 0
00000100:00100000:3.0:1789760723.230033:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.230149:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520891136
00000100:00100000:1.0:1789760723.230160:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520891136
00000100:00100000:1.0:1789760723.230220:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694863814202 time 694885295495 state 0x0 ref 1
00000100:00100000:1.0:1789760723.230235:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694885555911 time 694885295495 state 0x1 ref 1
00000100:00100000:1.0:1789760723.230267:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694885555911 time 694916949593 state 0x0 ref 1
00000100:00100000:1.0:1789760723.230280:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520891136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.230369:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20324352, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.230379:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.230395:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:1.0:1789760723.230399:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.230406:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.230426:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760723.265473:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972282 is committed
00002000:00010000:2.0:1789760723.266720:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20324352 -> 20328448
00010000:00010000:2.0:1789760723.266737:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.266749:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.266759:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.266771:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760723.266776:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.266786:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.266807:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.266815:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ba8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20324352->20328447] (req 20324352->20328447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760723.266935:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520891136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36653us (36947us total) trans 4294972282 rc 0/0
00000100:00100000:2.0:1789760723.266945:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4995
00000100:00100000:2.0:1789760723.266955:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694885555911 time 694916949593 state 0x2 ref 0
00000100:00100000:2.0:1789760723.272535:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760723.273843:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520891264
00000100:00100000:3.0:1789760723.273857:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520891264
00000100:00100000:3.0:1789760723.274683:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694885555911 time 694916949593 state 0x0 ref 1
00000100:00100000:3.0:1789760723.274699:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694917210009 time 694916949593 state 0x1 ref 1
00000100:00100000:3.0:1789760723.274732:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694917210009 time 694961415027 state 0x0 ref 1
00000100:00100000:3.0:1789760723.274748:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520891264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760723.274796:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20328448, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:3.0:1789760723.274806:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.274832:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=694s v=(0 0)
00010000:00010000:3.0:1789760723.274843:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760723.274850:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.274864:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760723.329922:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972283 is committed
00002000:00010000:1.0:1789760723.330034:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20328448 -> 20332544
00010000:00010000:1.0:1789760723.330052:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.330066:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.330076:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.330084:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.330089:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.330099:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.330121:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.330130:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ba96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20328448->20332543] (req 20328448->20332543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.330234:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520891264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55486us (57702us total) trans 4294972283 rc 0/0
00000100:00100000:1.0:1789760723.330246:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4996
00000100:00100000:1.0:1789760723.330256:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694917210009 time 694961415027 state 0x2 ref 0
00000100:00100000:0.0:1789760723.333305:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760723.333464:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520891392
00000100:00100000:2.0:1789760723.333474:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520891392
00000100:00100000:2.0:1789760723.333531:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694917210009 time 694961415027 state 0x0 ref 1
00000100:00100000:2.0:1789760723.333605:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694961675443 time 694961415027 state 0x1 ref 1
00000100:00100000:2.0:1789760723.333670:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694961675443 time 695020350096 state 0x0 ref 1
00000100:00100000:2.0:1789760723.333682:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520891392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760723.333728:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20332544, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:2.0:1789760723.333738:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.333763:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:2.0:1789760723.333770:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760723.333776:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.333791:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760723.372136:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972284 is committed
00002000:00010000:2.0:1789760723.372207:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20332544 -> 20336640
00010000:00010000:2.0:1789760723.372222:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.372233:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.372243:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.372255:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760723.372259:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.372268:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.372286:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.372295:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ba9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20332544->20336639] (req 20332544->20336639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760723.372412:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520891392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38722us (39107us total) trans 4294972284 rc 0/0
00000100:00100000:2.0:1789760723.372423:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4997
00000100:00100000:2.0:1789760723.372433:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694961675443 time 695020350096 state 0x2 ref 0
00000100:00100000:2.0:1789760723.375543:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.375684:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520891520
00000100:00100000:1.0:1789760723.375693:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520891520
00000100:00100000:1.0:1789760723.376645:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 694961675443 time 695020350096 state 0x0 ref 1
00000100:00100000:1.0:1789760723.376668:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695020610512 time 695020350096 state 0x1 ref 1
00000100:00100000:1.0:1789760723.376735:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695020610512 time 695063417811 state 0x0 ref 1
00000100:00100000:1.0:1789760723.376749:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520891520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.376791:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20336640, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.376799:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.376811:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:1.0:1789760723.376815:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.376819:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.376829:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760723.407012:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972285 is committed
00002000:00010000:1.0:1789760723.407279:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20336640 -> 20340736
00010000:00010000:1.0:1789760723.407293:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.407307:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.407342:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.407351:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.407356:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.407365:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.407385:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.407394:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20336640->20340735] (req 20336640->20340735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.407484:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520891520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30734us (31946us total) trans 4294972285 rc 0/0
00000100:00100000:1.0:1789760723.407499:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4998
00000100:00100000:1.0:1789760723.407517:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695020610512 time 695063417811 state 0x2 ref 0
00000100:00100000:2.0:1789760723.417470:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.417549:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520891648
00000100:00100000:1.0:1789760723.417560:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520891648
00000100:00100000:1.0:1789760723.417736:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695020610512 time 695063417811 state 0x0 ref 1
00000100:00100000:1.0:1789760723.417753:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695063678227 time 695063417811 state 0x1 ref 1
00000100:00100000:1.0:1789760723.417789:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695063678227 time 695104470971 state 0x0 ref 1
00000100:00100000:1.0:1789760723.417803:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520891648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.417860:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20340736, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.417869:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.417898:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:1.0:1789760723.417903:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.417914:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.417928:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760723.478204:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972286 is committed
00002000:00010000:1.0:1789760723.478522:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20340736 -> 20344832
00010000:00010000:1.0:1789760723.478539:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.478554:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.478564:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.478571:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.478576:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.478585:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.478604:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.478610:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20340736->20344831] (req 20340736->20344831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.478740:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520891648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60934us (61279us total) trans 4294972286 rc 0/0
00000100:00100000:1.0:1789760723.478752:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 4999
00000100:00100000:1.0:1789760723.478763:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695063678227 time 695104470971 state 0x2 ref 0
00000100:00100000:1.0:1789760723.487698:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760723.487819:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520891776
00000100:00100000:3.0:1789760723.487830:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520891776
00000100:00100000:3.0:1789760723.487953:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695063678227 time 695104470971 state 0x0 ref 1
00000100:00100000:3.0:1789760723.487968:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695104731387 time 695104470971 state 0x1 ref 1
00000100:00100000:3.0:1789760723.488037:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695104731387 time 695174718896 state 0x0 ref 1
00000100:00100000:3.0:1789760723.488050:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520891776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760723.488096:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20344832, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:3.0:1789760723.488106:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.488121:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:3.0:1789760723.488125:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760723.488132:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.488146:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.514488:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760723.522144:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972287 is committed
00002000:00010000:1.0:1789760723.522299:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20344832 -> 20348928
00010000:00010000:1.0:1789760723.522344:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.522358:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.522367:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.522375:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.522380:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.522389:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.522408:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.522416:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bab2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20344832->20348927] (req 20344832->20348927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.522693:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520891776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34640us (35000us total) trans 4294972287 rc 0/0
00000100:00100000:1.0:1789760723.522705:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5000
00000100:00100000:1.0:1789760723.522714:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695104731387 time 695174718896 state 0x2 ref 0
00000100:00100000:2.0:1789760723.534093:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760723.534202:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520891904
00000100:00100000:0.0:1789760723.534213:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520891904
00000100:00100000:0.0:1789760723.534281:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695104731387 time 695174718896 state 0x0 ref 1
00000100:00100000:0.0:1789760723.534295:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695174979312 time 695174718896 state 0x1 ref 1
00000100:00100000:0.0:1789760723.534359:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695174979312 time 695221041843 state 0x0 ref 1
00000100:00100000:0.0:1789760723.534372:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520891904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760723.534424:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20348928, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:0.0:1789760723.534433:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.534450:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:0.0:1789760723.534454:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760723.534460:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.534479:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760723.606231:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972288 is committed
00002000:00010000:1.0:1789760723.606600:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20348928 -> 20353024
00010000:00010000:1.0:1789760723.606616:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.606629:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.606638:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.606646:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.606651:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.606659:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.606679:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.606687:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bab9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20348928->20353023] (req 20348928->20353023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.606784:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520891904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 72408us (72696us total) trans 4294972288 rc 0/0
00000100:00100000:1.0:1789760723.606794:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5001
00000100:00100000:1.0:1789760723.606806:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695174979312 time 695221041843 state 0x2 ref 0
00000100:00100000:3.0:1789760723.615251:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.615414:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520892032
00000100:00100000:1.0:1789760723.615424:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520892032
00000100:00100000:1.0:1789760723.615485:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695174979312 time 695221041843 state 0x0 ref 1
00000100:00100000:1.0:1789760723.615499:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695221302259 time 695221041843 state 0x1 ref 1
00000100:00100000:1.0:1789760723.615535:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695221302259 time 695302218161 state 0x0 ref 1
00000100:00100000:1.0:1789760723.615548:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520892032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.615592:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20353024, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.615601:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.615616:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:1.0:1789760723.615620:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.615625:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.615638:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760723.656634:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972289 is committed
00002000:00010000:2.0:1789760723.656811:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20353024 -> 20357120
00010000:00010000:2.0:1789760723.656827:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.656839:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.656848:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.656855:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760723.656860:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.656869:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.656899:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.656907:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bac0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20353024->20357119] (req 20353024->20357119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760723.657008:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520892032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41457us (41760us total) trans 4294972289 rc 0/0
00000100:00100000:2.0:1789760723.657018:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5002
00000100:00100000:2.0:1789760723.657027:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695221302259 time 695302218161 state 0x2 ref 0
00000100:00100000:3.0:1789760723.660549:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760723.660857:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520892160
00000100:00100000:2.0:1789760723.660866:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520892160
00000100:00100000:2.0:1789760723.660927:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695221302259 time 695302218161 state 0x0 ref 1
00000100:00100000:2.0:1789760723.660951:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695302478577 time 695302218161 state 0x1 ref 1
00000100:00100000:2.0:1789760723.660984:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695302478577 time 695347666559 state 0x0 ref 1
00000100:00100000:2.0:1789760723.660996:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520892160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760723.661041:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20357120, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:2.0:1789760723.661050:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.661064:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:2.0:1789760723.661068:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760723.661075:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.661088:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760723.707364:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20357120 -> 20361216
00010000:00010000:2.0:1789760723.707383:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.707396:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.707421:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.707428:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760723.707433:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.707442:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.707462:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.707470:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bac7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20357120->20361215] (req 20357120->20361215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760723.707854:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520892160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46853us (47308us total) trans 4294972290 rc 0/0
00000100:00100000:2.0:1789760723.707865:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5003
00000100:00100000:2.0:1789760723.707886:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695302478577 time 695347666559 state 0x2 ref 0
00000001:00080000:1.0:1789760723.709497:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972290 is committed
00000100:00100000:3.0:1789760723.710456:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.710626:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520892288
00000100:00100000:1.0:1789760723.710645:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520892288
00000100:00100000:1.0:1789760723.710699:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695302478577 time 695347666559 state 0x0 ref 1
00000100:00100000:1.0:1789760723.710716:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695347926975 time 695347666559 state 0x1 ref 1
00000100:00100000:1.0:1789760723.710739:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695347926975 time 695397421350 state 0x0 ref 1
00000100:00100000:1.0:1789760723.710751:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520892288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.710796:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20361216, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.710805:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.710820:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:1.0:1789760723.710835:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.710842:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.710856:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760723.748367:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972291 is committed
00002000:00010000:2.0:1789760723.748564:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20361216 -> 20365312
00010000:00010000:2.0:1789760723.748581:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.748600:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.748610:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.748616:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760723.748621:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.748753:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.748775:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.748783:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bace lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20361216->20365311] (req 20361216->20365311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760723.748989:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520892288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38235us (38532us total) trans 4294972291 rc 0/0
00000100:00100000:2.0:1789760723.749000:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5004
00000100:00100000:2.0:1789760723.749010:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695347926975 time 695397421350 state 0x2 ref 0
00000100:00100000:3.0:1789760723.756046:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.756221:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520892416
00000100:00100000:1.0:1789760723.756230:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520892416
00000100:00100000:1.0:1789760723.756289:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695347926975 time 695397421350 state 0x0 ref 1
00000100:00100000:1.0:1789760723.756305:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695397681766 time 695397421350 state 0x1 ref 1
00000100:00100000:2.0:1789760723.756408:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695397681766 time 695443078803 state 0x0 ref 1
00000100:00100000:2.0:1789760723.756425:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520892416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760723.756473:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20365312, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:2.0:1789760723.756482:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.756497:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:2.0:1789760723.756501:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760723.756507:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.756530:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760723.795668:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972292 is committed
00002000:00010000:2.0:1789760723.795774:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20365312 -> 20369408
00010000:00010000:2.0:1789760723.795789:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.795802:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.795810:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.795817:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760723.795822:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.795831:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.795851:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760723.795858:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60bad5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20365312->20369407] (req 20365312->20369407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760723.795992:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520892416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39566us (39949us total) trans 4294972292 rc 0/0
00000100:00100000:2.0:1789760723.796002:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5005
00000100:00100000:2.0:1789760723.796011:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695397681766 time 695443078803 state 0x2 ref 0
00000100:00100000:1.0:1789760723.800778:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760723.800861:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520892544
00000100:00100000:3.0:1789760723.800880:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520892544
00000100:00100000:3.0:1789760723.800937:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695397681766 time 695443078803 state 0x0 ref 1
00000100:00100000:3.0:1789760723.800953:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695443339219 time 695443078803 state 0x1 ref 1
00000100:00100000:3.0:1789760723.800982:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695443339219 time 695487664898 state 0x0 ref 1
00000100:00100000:3.0:1789760723.800995:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520892544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760723.801042:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20369408, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:3.0:1789760723.801052:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.801067:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:3.0:1789760723.801071:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760723.801077:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.801090:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760723.839264:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20369408 -> 20373504
00010000:00010000:3.0:1789760723.839284:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.839297:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.839307:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.839380:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760723.839384:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.839394:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.839480:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.839488:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60badc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20369408->20373503] (req 20369408->20373503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760723.839725:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972293 is committed
00000100:00100000:2.0:1789760723.839849:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520892544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38851us (39076us total) trans 4294972293 rc 0/0
00000100:00100000:2.0:1789760723.839860:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5006
00000100:00100000:2.0:1789760723.839878:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695443339219 time 695487664898 state 0x2 ref 0
00000100:00100000:1.0:1789760723.846794:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760723.846918:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520892672
00000100:00100000:0.0:1789760723.846928:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520892672
00000100:00100000:0.0:1789760723.846980:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695443339219 time 695487664898 state 0x0 ref 1
00000100:00100000:0.0:1789760723.846994:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695487925314 time 695487664898 state 0x1 ref 1
00000100:00100000:0.0:1789760723.847073:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695487925314 time 695533754968 state 0x0 ref 1
00000100:00100000:0.0:1789760723.847085:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520892672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760723.847131:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20373504, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:0.0:1789760723.847141:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.847158:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:0.0:1789760723.847162:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760723.847167:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.847181:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760723.881070:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972294 is committed
00002000:00010000:0.0:1789760723.881092:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20373504 -> 20377600
00010000:00010000:0.0:1789760723.881108:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.881121:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.881131:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.881139:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760723.881144:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.881154:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.881173:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.881181:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bae3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20373504->20377599] (req 20373504->20377599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760723.881268:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520892672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34180us (34480us total) trans 4294972294 rc 0/0
00000100:00100000:0.0:1789760723.881282:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5007
00000100:00100000:0.0:1789760723.881292:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695487925314 time 695533754968 state 0x2 ref 0
00000100:00100000:2.0:1789760723.886285:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760723.887022:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520892800
00000100:00100000:1.0:1789760723.887033:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520892800
00000100:00100000:1.0:1789760723.887153:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695487925314 time 695533754968 state 0x0 ref 1
00000100:00100000:1.0:1789760723.887222:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695534015384 time 695533754968 state 0x1 ref 1
00000100:00100000:1.0:1789760723.887254:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695534015384 time 695573936282 state 0x0 ref 1
00000100:00100000:1.0:1789760723.887267:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520892800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760723.887341:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20377600, mtime: 0x6aad94d4, atime: 0x0, ctime: 0x6aad94d4, blocks: 0xa007
00010000:00010000:1.0:1789760723.887350:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.887368:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:1.0:1789760723.887372:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760723.887379:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.887394:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760723.927275:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972295 is committed
00002000:00010000:1.0:1789760723.927592:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20377600 -> 20381696
00002000:00010000:1.0:1789760723.927597:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760724 -> 1789760725
00002000:00010000:1.0:1789760723.927600:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760724 -> 1789760725
00010000:00010000:1.0:1789760723.927615:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.927634:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.927644:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.927652:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.927657:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.927666:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.927685:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.927692:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60baea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20377600->20381695] (req 20377600->20381695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.927824:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520892800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40554us (41545us total) trans 4294972295 rc 0/0
00000100:00100000:1.0:1789760723.927835:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5008
00000100:00100000:1.0:1789760723.927844:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695534015384 time 695573936282 state 0x2 ref 0
00000100:00100000:2.0:1789760723.931895:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760723.931972:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520892928
00000100:00100000:3.0:1789760723.931982:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520892928
00000100:00100000:3.0:1789760723.932035:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695534015384 time 695573936282 state 0x0 ref 1
00000100:00100000:3.0:1789760723.932049:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695574196698 time 695573936282 state 0x1 ref 1
00000100:00100000:3.0:1789760723.932078:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695574196698 time 695618760858 state 0x0 ref 1
00000100:00100000:3.0:1789760723.932091:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520892928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760723.932135:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20381696, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:3.0:1789760723.932143:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.932165:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:3.0:1789760723.932169:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760723.932175:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760723.932188:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760723.956612:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972296 is committed
00002000:00010000:1.0:1789760723.956731:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20381696 -> 20385792
00010000:00010000:1.0:1789760723.956746:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.956759:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.956768:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.956775:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.956780:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.956789:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.956808:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.956816:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60baf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20381696->20385791] (req 20381696->20385791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760723.956911:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520892928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24818us (25022us total) trans 4294972296 rc 0/0
00000100:00100000:1.0:1789760723.956922:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5009
00000100:00100000:1.0:1789760723.956931:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695574196698 time 695618760858 state 0x2 ref 0
00000100:00100000:2.0:1789760723.960095:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760723.960406:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520893056
00000100:00100000:0.0:1789760723.960416:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520893056
00000100:00100000:0.0:1789760723.960471:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695574196698 time 695618760858 state 0x0 ref 1
00000100:00100000:0.0:1789760723.960486:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695619021274 time 695618760858 state 0x1 ref 1
00000100:00100000:0.0:1789760723.960516:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695619021274 time 695647198809 state 0x0 ref 1
00000100:00100000:0.0:1789760723.960528:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520893056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760723.960573:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20385792, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:0.0:1789760723.960582:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.960598:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:0.0:1789760723.960602:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760723.960608:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760723.960622:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760723.996336:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20385792 -> 20389888
00010000:00010000:1.0:1789760723.996368:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.996382:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.996391:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.996398:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760723.996403:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.996411:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.996432:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760723.996439:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60baf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20385792->20389887] (req 20385792->20389887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760723.996530:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972297 is committed
00000100:00100000:1.0:1789760723.996978:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520893056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36447us (36889us total) trans 4294972297 rc 0/0
00000100:00100000:1.0:1789760723.996987:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5010
00000100:00100000:1.0:1789760723.996998:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695619021274 time 695647198809 state 0x2 ref 0
00000100:00100000:2.0:1789760724.000390:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760724.000726:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520893184
00000100:00100000:0.0:1789760724.000737:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520893184
00000100:00100000:0.0:1789760724.000806:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695619021274 time 695647198809 state 0x0 ref 1
00000100:00100000:0.0:1789760724.000821:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695647459225 time 695647198809 state 0x1 ref 1
00000100:00100000:0.0:1789760724.000854:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695647459225 time 695687536639 state 0x0 ref 1
00000100:00100000:0.0:1789760724.000867:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520893184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760724.000925:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20389888, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:0.0:1789760724.000934:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.000949:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:0.0:1789760724.000953:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760724.000960:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.000974:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760724.002630:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760724.023265:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972298 is committed
00002000:00010000:0.0:1789760724.023339:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20389888 -> 20393984
00010000:00010000:0.0:1789760724.023353:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.023364:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.023373:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.023392:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760724.023500:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.023512:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.023531:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.023539:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60baff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20389888->20393983] (req 20389888->20393983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760724.023624:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520893184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 22754us (23248us total) trans 4294972298 rc 0/0
00000100:00100000:0.0:1789760724.023636:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5011
00000100:00100000:0.0:1789760724.023645:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695647459225 time 695687536639 state 0x2 ref 0
00000100:00100000:2.0:1789760724.029483:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760724.029673:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520893312
00000100:00100000:1.0:1789760724.029683:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520893312
00000100:00100000:1.0:1789760724.029735:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695647459225 time 695687536639 state 0x0 ref 1
00000100:00100000:1.0:1789760724.029751:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695687797055 time 695687536639 state 0x1 ref 1
00000100:00100000:1.0:1789760724.029782:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695687797055 time 695716464608 state 0x0 ref 1
00000100:00100000:1.0:1789760724.029795:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520893312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760724.029844:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20393984, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:1.0:1789760724.029854:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760724.029879:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:1.0:1789760724.029884:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760724.029890:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760724.029904:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760724.058789:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20393984 -> 20398080
00010000:00010000:3.0:1789760724.058811:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.058824:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.058832:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.058839:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760724.058844:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.058854:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.058885:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.058894:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bb06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20393984->20398079] (req 20393984->20398079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760724.058914:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972299 is committed
00000100:00100000:3.0:1789760724.058981:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520893312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29184us (29502us total) trans 4294972299 rc 0/0
00000100:00100000:3.0:1789760724.058992:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5012
00000100:00100000:3.0:1789760724.059009:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695687797055 time 695716464608 state 0x2 ref 0
00000100:00100000:0.0:1789760724.063146:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760724.064649:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520893440
00000100:00100000:3.0:1789760724.064662:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520893440
00000100:00100000:3.0:1789760724.064724:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695687797055 time 695716464608 state 0x0 ref 1
00000100:00100000:3.0:1789760724.064740:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695716725024 time 695716464608 state 0x1 ref 1
00000100:00100000:3.0:1789760724.064762:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695716725024 time 695751444923 state 0x0 ref 1
00000100:00100000:3.0:1789760724.064773:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520893440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760724.064822:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20398080, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:3.0:1789760724.064832:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.064850:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:3.0:1789760724.064855:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760724.064862:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.064895:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760724.099261:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972300 is committed
00002000:00010000:2.0:1789760724.099368:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20398080 -> 20402176
00010000:00010000:2.0:1789760724.099383:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.099395:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.099413:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.099420:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760724.099425:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.099433:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.099453:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.099460:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20398080->20402175] (req 20398080->20402175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760724.099563:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520893440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34786us (36420us total) trans 4294972300 rc 0/0
00000100:00100000:2.0:1789760724.099573:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5013
00000100:00100000:2.0:1789760724.099582:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695716725024 time 695751444923 state 0x2 ref 0
00000100:00100000:2.0:1789760724.104277:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760724.104374:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520893568
00000100:00100000:0.0:1789760724.104383:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520893568
00000100:00100000:0.0:1789760724.104444:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695716725024 time 695751444923 state 0x0 ref 1
00000100:00100000:0.0:1789760724.104459:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695751705339 time 695751444923 state 0x1 ref 1
00000100:00100000:0.0:1789760724.104491:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695751705339 time 695791173763 state 0x0 ref 1
00000100:00100000:0.0:1789760724.104512:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520893568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760724.104559:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20402176, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:0.0:1789760724.104568:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.104584:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:0.0:1789760724.104588:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760724.104594:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.104607:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760724.160985:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972301 is committed
00002000:00010000:0.0:1789760724.161086:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20402176 -> 20406272
00010000:00010000:0.0:1789760724.161101:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.161115:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.161125:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.161132:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760724.161137:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.161147:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.161166:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.161175:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20402176->20406271] (req 20402176->20406271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760724.161268:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520893568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56762us (56998us total) trans 4294972301 rc 0/0
00000100:00100000:0.0:1789760724.161279:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5014
00000100:00100000:0.0:1789760724.161288:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695751705339 time 695791173763 state 0x2 ref 0
00000100:00100000:1.0:1789760724.171618:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760724.171715:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520893696
00000100:00100000:0.0:1789760724.171726:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520893696
00000100:00100000:0.0:1789760724.171782:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695751705339 time 695791173763 state 0x0 ref 1
00000100:00100000:0.0:1789760724.171799:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695791434179 time 695791173763 state 0x1 ref 1
00000100:00100000:0.0:1789760724.171833:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695791434179 time 695858515066 state 0x0 ref 1
00000100:00100000:0.0:1789760724.171849:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520893696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760724.171909:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20406272, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:0.0:1789760724.171918:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.171934:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:0.0:1789760724.171938:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760724.171944:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.172086:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760724.203147:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972302 is committed
00002000:00010000:0.0:1789760724.203177:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20406272 -> 20410368
00010000:00010000:0.0:1789760724.203195:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.203207:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.203214:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.203219:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760724.203223:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.203231:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.203251:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.203259:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bb1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20406272->20410367] (req 20406272->20410367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760724.203492:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520893696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31640us (31877us total) trans 4294972302 rc 0/0
00000100:00100000:0.0:1789760724.203508:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5015
00000100:00100000:0.0:1789760724.203518:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695791434179 time 695858515066 state 0x2 ref 0
00000100:00100000:2.0:1789760724.208942:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760724.209027:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520893824
00000100:00100000:3.0:1789760724.209037:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520893824
00000100:00100000:3.0:1789760724.209091:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695791434179 time 695858515066 state 0x0 ref 1
00000100:00100000:3.0:1789760724.209106:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695858775482 time 695858515066 state 0x1 ref 1
00000100:00100000:3.0:1789760724.209135:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695858775482 time 695895817186 state 0x0 ref 1
00000100:00100000:3.0:1789760724.209148:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520893824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760724.209197:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20410368, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:3.0:1789760724.209206:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.209221:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:3.0:1789760724.209226:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760724.209232:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.209246:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760724.264726:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972303 is committed
00002000:00010000:0.0:1789760724.264812:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20410368 -> 20414464
00010000:00010000:0.0:1789760724.264826:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.264839:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.264848:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.264855:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760724.264861:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.264881:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.264901:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.264910:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bb22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20410368->20414463] (req 20410368->20414463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760724.265108:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520893824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55957us (56170us total) trans 4294972303 rc 0/0
00000100:00100000:0.0:1789760724.265119:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5016
00000100:00100000:0.0:1789760724.265128:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695858775482 time 695895817186 state 0x2 ref 0
00000100:00100000:2.0:1789760724.275784:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760724.276987:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520893952
00000100:00100000:3.0:1789760724.277002:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520893952
00000100:00100000:3.0:1789760724.277069:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695858775482 time 695895817186 state 0x0 ref 1
00000100:00100000:3.0:1789760724.277085:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695896077602 time 695895817186 state 0x1 ref 1
00000100:00100000:3.0:1789760724.277177:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695896077602 time 695963859164 state 0x0 ref 1
00000100:00100000:3.0:1789760724.277192:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520893952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760724.277252:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20414464, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:3.0:1789760724.277261:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.277278:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=695s v=(0 0)
00010000:00010000:3.0:1789760724.277282:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760724.277288:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.277301:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760724.327419:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972304 is committed
00002000:00010000:3.0:1789760724.327686:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20414464 -> 20418560
00010000:00010000:3.0:1789760724.327702:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.327716:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.327730:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.327738:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760724.327742:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.327751:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.327773:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.327779:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20414464->20418559] (req 20414464->20418559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760724.327887:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520893952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50693us (52106us total) trans 4294972304 rc 0/0
00000100:00100000:3.0:1789760724.327899:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5017
00000100:00100000:3.0:1789760724.327909:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695896077602 time 695963859164 state 0x2 ref 0
00000100:00100000:1.0:1789760724.331946:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760724.332097:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520894080
00000100:00100000:0.0:1789760724.332106:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520894080
00000100:00100000:0.0:1789760724.332160:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695896077602 time 695963859164 state 0x0 ref 1
00000100:00100000:0.0:1789760724.332175:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695964119580 time 695963859164 state 0x1 ref 1
00000100:00100000:0.0:1789760724.332237:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695964119580 time 696018918565 state 0x0 ref 1
00000100:00100000:0.0:1789760724.332249:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520894080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760724.332303:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20418560, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:0.0:1789760724.332342:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.332358:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:0.0:1789760724.332363:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760724.332369:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.332383:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760724.380341:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972305 is committed
00002000:00010000:0.0:1789760724.380749:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20418560 -> 20422656
00010000:00010000:0.0:1789760724.380765:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.380778:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.380789:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.380797:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760724.380802:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.380812:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.380832:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.380840:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20418560->20422655] (req 20418560->20422655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760724.381026:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520894080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48774us (49084us total) trans 4294972305 rc 0/0
00000100:00100000:0.0:1789760724.381037:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5018
00000100:00100000:0.0:1789760724.381045:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695964119580 time 696018918565 state 0x2 ref 0
00000100:00100000:0.0:1789760724.389513:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760724.389812:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520894208
00000100:00100000:2.0:1789760724.389823:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520894208
00000100:00100000:2.0:1789760724.389887:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 695964119580 time 696018918565 state 0x0 ref 1
00000100:00100000:2.0:1789760724.389902:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696019178981 time 696018918565 state 0x1 ref 1
00000100:00100000:2.0:1789760724.389932:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696019178981 time 696076614861 state 0x0 ref 1
00000100:00100000:2.0:1789760724.389945:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520894208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760724.389993:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20422656, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:2.0:1789760724.390002:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.390018:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:2.0:1789760724.390023:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760724.390029:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.390044:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760724.415108:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972306 is committed
00002000:00010000:2.0:1789760724.415205:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20422656 -> 20426752
00010000:00010000:2.0:1789760724.415222:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.415235:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.415244:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.415251:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760724.415256:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.415266:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.415284:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.415292:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bb37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20422656->20426751] (req 20422656->20426751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760724.415864:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520894208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25915us (26354us total) trans 4294972306 rc 0/0
00000100:00100000:2.0:1789760724.415884:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5019
00000100:00100000:2.0:1789760724.415895:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696019178981 time 696076614861 state 0x2 ref 0
00000100:00100000:3.0:1789760724.420076:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760724.420287:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520894336
00000100:00100000:0.0:1789760724.420296:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520894336
00000100:00100000:0.0:1789760724.420380:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696019178981 time 696076614861 state 0x0 ref 1
00000100:00100000:0.0:1789760724.420395:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696076875277 time 696076614861 state 0x1 ref 1
00000100:00100000:0.0:1789760724.420422:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696076875277 time 696107105202 state 0x0 ref 1
00000100:00100000:0.0:1789760724.420433:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520894336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760724.420478:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20426752, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:0.0:1789760724.420487:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.420519:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:0.0:1789760724.420524:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760724.420531:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.420546:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760724.454015:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972307 is committed
00002000:00010000:0.0:1789760724.454131:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20426752 -> 20430848
00010000:00010000:0.0:1789760724.454216:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.454230:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.454239:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.454246:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760724.454250:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.454259:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.454279:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.454288:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bb3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20426752->20430847] (req 20426752->20430847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760724.454780:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520894336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34342us (34707us total) trans 4294972307 rc 0/0
00000100:00100000:0.0:1789760724.454793:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5020
00000100:00100000:0.0:1789760724.454804:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696076875277 time 696107105202 state 0x2 ref 0
00000100:00100000:0.0:1789760724.458914:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760724.459034:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520894464
00000100:00100000:3.0:1789760724.459044:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520894464
00000100:00100000:3.0:1789760724.459103:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696076875277 time 696107105202 state 0x0 ref 1
00000100:00100000:3.0:1789760724.459119:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696107365618 time 696107105202 state 0x1 ref 1
00000100:00100000:3.0:1789760724.459156:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696107365618 time 696145838527 state 0x0 ref 1
00000100:00100000:3.0:1789760724.459168:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520894464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760724.459211:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20430848, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:3.0:1789760724.459221:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.459236:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:3.0:1789760724.459240:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760724.459246:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.459259:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760724.502757:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972308 is committed
00002000:00010000:2.0:1789760724.502849:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20430848 -> 20434944
00010000:00010000:2.0:1789760724.502877:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.502892:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.502904:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.502912:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760724.502917:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.502926:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.502954:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.502968:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bb45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20430848->20434943] (req 20430848->20434943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760724.503066:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520894464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43891us (44152us total) trans 4294972308 rc 0/0
00000100:00100000:2.0:1789760724.503084:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5021
00000100:00100000:2.0:1789760724.503093:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696107365618 time 696145838527 state 0x2 ref 0
00000100:00100000:2.0:1789760724.506772:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760724.506910:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520894592
00000100:00100000:1.0:1789760724.506919:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520894592
00000100:00100000:1.0:1789760724.506970:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696107365618 time 696145838527 state 0x0 ref 1
00000100:00100000:1.0:1789760724.506986:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696146098943 time 696145838527 state 0x1 ref 1
00000100:00100000:1.0:1789760724.507013:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696146098943 time 696193696242 state 0x0 ref 1
00000100:00100000:1.0:1789760724.507027:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520894592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760724.507076:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20434944, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:1.0:1789760724.507086:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760724.507102:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:1.0:1789760724.507107:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760724.507114:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760724.507128:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.538714:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760724.551716:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972309 is committed
00002000:00010000:3.0:1789760724.551784:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20434944 -> 20439040
00010000:00010000:3.0:1789760724.551799:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.551811:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.551826:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.551834:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760724.551839:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.551848:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.551881:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.551889:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bb4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20434944->20439039] (req 20434944->20439039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760724.552030:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520894592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45000us (45262us total) trans 4294972309 rc 0/0
00000100:00100000:3.0:1789760724.552042:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5022
00000100:00100000:3.0:1789760724.552052:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696146098943 time 696193696242 state 0x2 ref 0
00000100:00100000:3.0:1789760724.556550:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760724.556852:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520894720
00000100:00100000:2.0:1789760724.556863:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520894720
00000100:00100000:2.0:1789760724.557423:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696146098943 time 696193696242 state 0x0 ref 1
00000100:00100000:2.0:1789760724.557443:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696193956658 time 696193696242 state 0x1 ref 1
00000100:00100000:2.0:1789760724.557556:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696193956658 time 696244237238 state 0x0 ref 1
00000100:00100000:2.0:1789760724.557571:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520894720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760724.557618:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20439040, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:2.0:1789760724.557627:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.557643:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:2.0:1789760724.557648:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760724.558108:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.558125:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760724.601646:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1789760724.601674:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548745472:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1789760724.601750:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760724.601842:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548745472
00000100:00100000:0.0:1789760724.601851:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548745472
00000100:00100000:0.0:1789760724.601922:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413
00000100:00100000:0.0:1789760724.601932:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548745472:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1789760724.601984:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:0.0:1789760724.602035:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548745472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (284us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760724.602042:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413
00000100:00100000:2.0:1789760724.602224:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548745472:0@lo:41:osp-pre-0-1.0
00000001:00080000:2.0:1789760724.625355:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972310 is committed
00002000:00010000:3.0:1789760724.625377:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20439040 -> 20443136
00010000:00010000:3.0:1789760724.625404:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.625423:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.625436:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.625443:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760724.625448:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.625457:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.625476:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.625483:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bb53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20439040->20443135] (req 20439040->20443135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760724.625572:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520894720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68000us (69028us total) trans 4294972310 rc 0/0
00000100:00100000:3.0:1789760724.625582:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5023
00000100:00100000:3.0:1789760724.625592:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696193956658 time 696244237238 state 0x2 ref 0
00000100:00100000:0.0:1789760724.629951:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760724.630037:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520894848
00000100:00100000:3.0:1789760724.630047:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520894848
00000100:00100000:3.0:1789760724.630100:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696193956658 time 696244237238 state 0x0 ref 1
00000100:00100000:3.0:1789760724.630116:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696244497654 time 696244237238 state 0x1 ref 1
00000100:00100000:3.0:1789760724.630149:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696244497654 time 696316832024 state 0x0 ref 1
00000100:00100000:3.0:1789760724.630176:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520894848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760724.630225:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20443136, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:3.0:1789760724.630234:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.630249:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:3.0:1789760724.630254:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760724.630261:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.630274:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760724.686872:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20443136 -> 20447232
00010000:00010000:3.0:1789760724.686895:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760724.686897:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972311 is committed
00010000:00010000:3.0:1789760724.686907:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.686922:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.686930:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760724.686935:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.686944:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.687009:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.687018:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20443136->20447231] (req 20443136->20447231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760724.687148:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520894848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56983us (57202us total) trans 4294972311 rc 0/0
00000100:00100000:3.0:1789760724.687158:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5024
00000100:00100000:3.0:1789760724.687168:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696244497654 time 696316832024 state 0x2 ref 0
00000100:00100000:2.0:1789760724.696710:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760724.696833:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520894976
00000100:00100000:3.0:1789760724.696844:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520894976
00000100:00100000:3.0:1789760724.696911:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696244497654 time 696316832024 state 0x0 ref 1
00000100:00100000:3.0:1789760724.696928:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696317092440 time 696316832024 state 0x1 ref 1
00000100:00100000:3.0:1789760724.696963:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696317092440 time 696383645033 state 0x0 ref 1
00000100:00100000:3.0:1789760724.697244:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520894976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760724.697298:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20447232, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:3.0:1789760724.697307:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.697822:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:3.0:1789760724.697827:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760724.697834:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.697849:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760724.737564:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972312 is committed
00002000:00010000:3.0:1789760724.737668:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20447232 -> 20451328
00010000:00010000:3.0:1789760724.737685:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.737698:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.737708:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.737716:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760724.737722:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.737731:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.737750:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.737757:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20447232->20451327] (req 20447232->20451327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760724.737849:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520894976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40605us (41144us total) trans 4294972312 rc 0/0
00000100:00100000:3.0:1789760724.737859:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5025
00000100:00100000:3.0:1789760724.737878:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696317092440 time 696383645033 state 0x2 ref 0
00000100:00100000:2.0:1789760724.741877:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760724.742022:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520895104
00000100:00100000:1.0:1789760724.742032:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520895104
00000100:00100000:1.0:1789760724.742087:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696317092440 time 696383645033 state 0x0 ref 1
00000100:00100000:1.0:1789760724.742102:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696383905449 time 696383645033 state 0x1 ref 1
00000100:00100000:1.0:1789760724.742130:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696383905449 time 696428813691 state 0x0 ref 1
00000100:00100000:1.0:1789760724.742142:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520895104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760724.742197:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20451328, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:1.0:1789760724.742206:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760724.742221:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:1.0:1789760724.742226:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760724.742232:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760724.742244:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760724.800624:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972313 is committed
00002000:00010000:3.0:1789760724.800886:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20451328 -> 20455424
00010000:00010000:3.0:1789760724.800902:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.800914:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.800923:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.800936:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760724.800941:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.800950:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.800969:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.800976:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bb68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20451328->20455423] (req 20451328->20455423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760724.801149:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520895104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59004us (59289us total) trans 4294972313 rc 0/0
00000100:00100000:3.0:1789760724.801160:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5026
00000100:00100000:3.0:1789760724.801169:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696383905449 time 696428813691 state 0x2 ref 0
00000100:00100000:0.0:1789760724.812751:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760724.812809:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520895232
00000100:00100000:3.0:1789760724.812819:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520895232
00000100:00100000:3.0:1789760724.812887:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696383905449 time 696428813691 state 0x0 ref 1
00000100:00100000:3.0:1789760724.812903:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696429074107 time 696428813691 state 0x1 ref 1
00000100:00100000:3.0:1789760724.812936:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696429074107 time 696499618665 state 0x0 ref 1
00000100:00100000:3.0:1789760724.812952:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520895232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760724.812998:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20455424, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:3.0:1789760724.813007:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.813023:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:3.0:1789760724.813028:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760724.813035:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760724.813049:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760724.856935:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972314 is committed
00002000:00010000:2.0:1789760724.857024:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20455424 -> 20459520
00010000:00010000:2.0:1789760724.857040:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.857053:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.857063:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.857071:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760724.857077:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.857087:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.857110:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.857118:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bb6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20455424->20459519] (req 20455424->20459519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760724.857252:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520895232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44298us (44504us total) trans 4294972314 rc 0/0
00000100:00100000:2.0:1789760724.857262:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5027
00000100:00100000:2.0:1789760724.857272:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696429074107 time 696499618665 state 0x2 ref 0
00000100:00100000:3.0:1789760724.860918:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760724.861065:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520895360
00000100:00100000:0.0:1789760724.861077:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520895360
00000100:00100000:0.0:1789760724.861134:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696429074107 time 696499618665 state 0x0 ref 1
00000100:00100000:0.0:1789760724.861149:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696499879081 time 696499618665 state 0x1 ref 1
00000100:00100000:0.0:1789760724.861173:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696499879081 time 696547855992 state 0x0 ref 1
00000100:00100000:0.0:1789760724.861186:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520895360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760724.861243:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20459520, mtime: 0x6aad94d5, atime: 0x0, ctime: 0x6aad94d5, blocks: 0xa007
00010000:00010000:0.0:1789760724.861253:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.861268:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:0.0:1789760724.861272:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760724.861278:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.861290:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760724.901454:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20459520 -> 20463616
00002000:00010000:2.0:1789760724.901462:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760725 -> 1789760726
00002000:00010000:2.0:1789760724.901464:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760725 -> 1789760726
00010000:00010000:2.0:1789760724.901478:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.901492:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.901501:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.901509:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760724.901514:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.902412:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.902435:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.902444:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bb76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20459520->20463615] (req 20459520->20463615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760724.902533:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972315 is committed
00000100:00100000:3.0:1789760724.902717:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520895360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41526us (41801us total) trans 4294972315 rc 0/0
00000100:00100000:3.0:1789760724.902730:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5028
00000100:00100000:3.0:1789760724.902742:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696499879081 time 696547855992 state 0x2 ref 0
00000100:00100000:2.0:1789760724.907782:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760724.907902:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520895488
00000100:00100000:0.0:1789760724.907913:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520895488
00000100:00100000:0.0:1789760724.907970:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696499879081 time 696547855992 state 0x0 ref 1
00000100:00100000:0.0:1789760724.907986:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696548116408 time 696547855992 state 0x1 ref 1
00000100:00100000:0.0:1789760724.908045:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696548116408 time 696594728110 state 0x0 ref 1
00000100:00100000:0.0:1789760724.908060:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520895488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760724.908109:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20463616, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:0.0:1789760724.908118:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.908135:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:0.0:1789760724.908150:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760724.908156:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760724.908171:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760724.965821:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972316 is committed
00002000:00010000:2.0:1789760724.965948:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20463616 -> 20467712
00010000:00010000:2.0:1789760724.965965:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.965978:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.965987:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.965993:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760724.965998:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.966005:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.966025:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760724.966031:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bb7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20463616->20467711] (req 20463616->20467711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760724.966127:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520895488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58063us (58349us total) trans 4294972316 rc 0/0
00000100:00100000:2.0:1789760724.966138:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5029
00000100:00100000:2.0:1789760724.966148:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696548116408 time 696594728110 state 0x2 ref 0
00000100:00100000:0.0:1789760724.971634:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760724.973071:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520895616
00000100:00100000:1.0:1789760724.973084:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520895616
00000100:00100000:1.0:1789760724.973141:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696548116408 time 696594728110 state 0x0 ref 1
00000100:00100000:1.0:1789760724.973156:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696594988526 time 696594728110 state 0x1 ref 1
00000100:00100000:1.0:1789760724.973187:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696594988526 time 696659870482 state 0x0 ref 1
00000100:00100000:1.0:1789760724.973200:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520895616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760724.973248:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20467712, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:1.0:1789760724.973257:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760724.973277:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:1.0:1789760724.973281:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760724.973288:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760724.973301:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760725.057293:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20467712 -> 20471808
00010000:00010000:2.0:1789760725.057345:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.057358:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.057367:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.057374:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760725.057379:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.057393:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.057412:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.057419:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bb84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20467712->20471807] (req 20467712->20471807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760725.057496:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520895616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 84293us (85866us total) trans 4294972317 rc 0/0
00000100:00100000:2.0:1789760725.057506:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5030
00000100:00100000:2.0:1789760725.057515:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696594988526 time 696659870482 state 0x2 ref 0
00000001:00080000:0.0:1789760725.058012:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972317 is committed
00000100:00100000:3.0:1789760725.063242:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.063508:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520895744
00000100:00100000:2.0:1789760725.063519:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520895744
00000100:00100000:2.0:1789760725.063586:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696594988526 time 696659870482 state 0x0 ref 1
00000100:00100000:2.0:1789760725.063601:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696660130898 time 696659870482 state 0x1 ref 1
00000100:00100000:2.0:1789760725.063631:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696660130898 time 696750313514 state 0x0 ref 1
00000100:00100000:2.0:1789760725.063646:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520895744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.063692:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20471808, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.063701:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.063717:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:2.0:1789760725.063721:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.063727:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.063750:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760725.143057:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972318 is committed
00002000:00010000:2.0:1789760725.143201:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20471808 -> 20475904
00010000:00010000:2.0:1789760725.143217:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.143230:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.143240:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.143248:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760725.143254:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.143264:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.143285:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.143293:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bb8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20471808->20475903] (req 20471808->20475903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760725.143712:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520895744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 80066us (80473us total) trans 4294972318 rc 0/0
00000100:00100000:2.0:1789760725.143724:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5031
00000100:00100000:2.0:1789760725.143733:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696660130898 time 696750313514 state 0x2 ref 0
00000100:00100000:3.0:1789760725.149614:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760725.149788:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520895872
00000100:00100000:0.0:1789760725.149798:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520895872
00000100:00100000:0.0:1789760725.149853:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696660130898 time 696750313514 state 0x0 ref 1
00000100:00100000:0.0:1789760725.149881:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696750573930 time 696750313514 state 0x1 ref 1
00000100:00100000:0.0:1789760725.149911:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696750573930 time 696836593898 state 0x0 ref 1
00000100:00100000:0.0:1789760725.149923:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520895872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760725.149970:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20475904, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:0.0:1789760725.149980:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.149997:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:0.0:1789760725.150002:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760725.150009:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.150023:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760725.195464:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20475904 -> 20480000
00010000:00010000:3.0:1789760725.195482:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.195504:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.195515:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.195522:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760725.195527:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.195534:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.195551:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.195558:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bb92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20475904->20479999] (req 20475904->20479999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.195644:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520895872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45718us (46035us total) trans 4294972319 rc 0/0
00000100:00100000:3.0:1789760725.195654:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5032
00000100:00100000:3.0:1789760725.195664:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696750573930 time 696836593898 state 0x2 ref 0
00000100:00100000:0.0:1789760725.198995:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.199076:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520896000
00000100:00100000:3.0:1789760725.199086:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520896000
00000100:00100000:3.0:1789760725.199141:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696750573930 time 696836593898 state 0x0 ref 1
00000100:00100000:3.0:1789760725.199156:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696836854314 time 696836593898 state 0x1 ref 1
00000100:00100000:3.0:1789760725.199188:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696836854314 time 696885870493 state 0x0 ref 1
00000100:00100000:3.0:1789760725.199201:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520896000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760725.199248:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20480000, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:3.0:1789760725.199256:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.199271:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:3.0:1789760725.199275:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760725.199281:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.199295:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760725.199936:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972319 is committed
00002000:00010000:3.0:1789760725.238619:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20480000 -> 20484096
00010000:00010000:3.0:1789760725.238637:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.238649:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.238657:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.238664:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760725.238669:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.238678:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.238697:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.238705:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bb99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20480000->20484095] (req 20480000->20484095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.238801:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520896000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39598us (39812us total) trans 4294972320 rc 0/0
00000100:00100000:3.0:1789760725.238811:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5033
00000100:00100000:3.0:1789760725.238820:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696836854314 time 696885870493 state 0x2 ref 0
00000001:00080000:2.0:1789760725.240742:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972320 is committed
00000100:00100000:0.0:1789760725.246241:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.246432:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520896128
00000100:00100000:2.0:1789760725.246547:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520896128
00000100:00100000:2.0:1789760725.246667:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696836854314 time 696885870493 state 0x0 ref 1
00000100:00100000:2.0:1789760725.246682:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696886130909 time 696885870493 state 0x1 ref 1
00000100:00100000:2.0:1789760725.246750:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696886130909 time 696933431796 state 0x0 ref 1
00000100:00100000:2.0:1789760725.246765:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.246811:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20484096, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.246820:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.246836:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:2.0:1789760725.246841:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.246848:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.246873:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760725.294075:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972321 is committed
00002000:00010000:2.0:1789760725.294705:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20484096 -> 20488192
00010000:00010000:2.0:1789760725.294723:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.294736:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.294745:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.294753:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760725.294757:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.294765:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.294783:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.294787:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bba0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20484096->20488191] (req 20484096->20488191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760725.294905:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48139us (48669us total) trans 4294972321 rc 0/0
00000100:00100000:2.0:1789760725.294917:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5034
00000100:00100000:2.0:1789760725.294927:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696886130909 time 696933431796 state 0x2 ref 0
00000100:00100000:0.0:1789760725.299268:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.299455:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520896256
00000100:00100000:2.0:1789760725.299465:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520896256
00000100:00100000:2.0:1789760725.299648:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696886130909 time 696933431796 state 0x0 ref 1
00000100:00100000:2.0:1789760725.299664:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696933692212 time 696933431796 state 0x1 ref 1
00000100:00100000:2.0:1789760725.299728:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696933692212 time 696986409402 state 0x0 ref 1
00000100:00100000:2.0:1789760725.299740:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.299787:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20488192, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.299795:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.299810:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=696s v=(0 0)
00010000:00010000:2.0:1789760725.299815:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.299821:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.299835:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760725.336300:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972322 is committed
00002000:00010000:2.0:1789760725.336420:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20488192 -> 20492288
00010000:00010000:2.0:1789760725.336434:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.336447:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.336457:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.336464:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760725.336468:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.336477:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.336499:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.336507:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bba7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20488192->20492287] (req 20488192->20492287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760725.336611:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36868us (37348us total) trans 4294972322 rc 0/0
00000100:00100000:2.0:1789760725.336623:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5035
00000100:00100000:2.0:1789760725.336633:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696933692212 time 696986409402 state 0x2 ref 0
00000100:00100000:0.0:1789760725.340991:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.341115:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520896384
00000100:00100000:3.0:1789760725.341126:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520896384
00000100:00100000:3.0:1789760725.341176:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696933692212 time 696986409402 state 0x0 ref 1
00000100:00100000:3.0:1789760725.341188:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696986669818 time 696986409402 state 0x1 ref 1
00000100:00100000:3.0:1789760725.341215:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696986669818 time 697027897753 state 0x0 ref 1
00000100:00100000:3.0:1789760725.341227:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760725.341275:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20492288, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:3.0:1789760725.341284:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.341298:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:3.0:1789760725.341302:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760725.341306:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.341348:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760725.379794:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972323 is committed
00002000:00010000:0.0:1789760725.379905:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20492288 -> 20496384
00010000:00010000:0.0:1789760725.379921:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.379934:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.379942:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.379949:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760725.379954:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.379963:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.379982:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.379989:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bbae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20492288->20496383] (req 20492288->20496383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760725.380093:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38863us (39105us total) trans 4294972323 rc 0/0
00000100:00100000:0.0:1789760725.380104:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5036
00000100:00100000:0.0:1789760725.380112:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696986669818 time 697027897753 state 0x2 ref 0
00000100:00100000:0.0:1789760725.387098:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.387268:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520896512
00000100:00100000:3.0:1789760725.387277:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520896512
00000100:00100000:3.0:1789760725.387350:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 696986669818 time 697027897753 state 0x0 ref 1
00000100:00100000:3.0:1789760725.387366:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697028158169 time 697027897753 state 0x1 ref 1
00000100:00100000:3.0:1789760725.387397:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697028158169 time 697074079377 state 0x0 ref 1
00000100:00100000:3.0:1789760725.387410:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760725.387458:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20496384, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:3.0:1789760725.387467:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.387483:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:3.0:1789760725.387488:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760725.387494:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.387509:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760725.414411:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972324 is committed
00002000:00010000:3.0:1789760725.414631:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20496384 -> 20500480
00010000:00010000:3.0:1789760725.414647:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.414658:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.414667:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.414674:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760725.414679:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.414687:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.414706:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.414714:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bbb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20496384->20500479] (req 20496384->20500479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.414811:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27397us (27716us total) trans 4294972324 rc 0/0
00000100:00100000:3.0:1789760725.414823:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5037
00000100:00100000:3.0:1789760725.414832:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697028158169 time 697074079377 state 0x2 ref 0
00000100:00100000:3.0:1789760725.418388:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.418565:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520896640
00000100:00100000:2.0:1789760725.418825:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520896640
00000100:00100000:2.0:1789760725.418898:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697028158169 time 697074079377 state 0x0 ref 1
00000100:00100000:2.0:1789760725.418914:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697074339793 time 697074079377 state 0x1 ref 1
00000100:00100000:2.0:1789760725.418948:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697074339793 time 697105630772 state 0x0 ref 1
00000100:00100000:2.0:1789760725.418963:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520896640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.419016:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20500480, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.419025:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.419040:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760725.419046:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.419052:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.419067:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760725.465427:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972325 is committed
00002000:00010000:0.0:1789760725.465656:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20500480 -> 20504576
00010000:00010000:0.0:1789760725.465671:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.465685:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.465694:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.465707:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760725.465712:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.465720:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.465739:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.465746:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20500480->20504575] (req 20500480->20504575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760725.465879:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520896640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46915us (47501us total) trans 4294972325 rc 0/0
00000100:00100000:0.0:1789760725.465890:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5038
00000100:00100000:0.0:1789760725.465900:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697074339793 time 697105630772 state 0x2 ref 0
00000100:00100000:0.0:1789760725.469476:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.469923:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520896768
00000100:00100000:2.0:1789760725.469933:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520896768
00000100:00100000:2.0:1789760725.469986:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697074339793 time 697105630772 state 0x0 ref 1
00000100:00100000:2.0:1789760725.470001:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697105891188 time 697105630772 state 0x1 ref 1
00000100:00100000:2.0:1789760725.470031:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697105891188 time 697156713211 state 0x0 ref 1
00000100:00100000:2.0:1789760725.470042:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.470090:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20504576, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.470099:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.470113:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760725.470118:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.470126:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.470141:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760725.510578:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20504576 -> 20508672
00010000:00010000:3.0:1789760725.510598:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.510611:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.510620:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.510627:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760725.510632:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.510640:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.510659:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.510668:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bbc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20504576->20508671] (req 20504576->20508671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.510757:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520896768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40711us (41284us total) trans 4294972326 rc 0/0
00000100:00100000:3.0:1789760725.510769:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5039
00000100:00100000:3.0:1789760725.510778:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697105891188 time 697156713211 state 0x2 ref 0
00000001:00080000:3.0:1789760725.510813:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972326 is committed
00000100:00100000:2.0:1789760725.514988:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760725.515186:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520896896
00000100:00100000:0.0:1789760725.515197:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520896896
00000100:00100000:0.0:1789760725.515247:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697105891188 time 697156713211 state 0x0 ref 1
00000100:00100000:0.0:1789760725.515261:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697156973627 time 697156713211 state 0x1 ref 1
00000100:00100000:0.0:1789760725.515292:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697156973627 time 697201974702 state 0x0 ref 1
00000100:00100000:0.0:1789760725.515304:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760725.515385:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20508672, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:0.0:1789760725.515401:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.515415:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:0.0:1789760725.515420:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760725.515426:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.515438:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760725.554267:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972327 is committed
00002000:00010000:0.0:1789760725.554393:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20508672 -> 20512768
00010000:00010000:0.0:1789760725.554412:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.554427:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.554450:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.554457:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760725.554461:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.554473:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.554504:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.554515:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bbca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20508672->20512767] (req 20508672->20512767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760725.554620:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520896896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39314us (39638us total) trans 4294972327 rc 0/0
00000100:00100000:0.0:1789760725.554633:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5040
00000100:00100000:0.0:1789760725.554648:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697156973627 time 697201974702 state 0x2 ref 0
00010000:00010000:2.0:1789760725.562352:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789760725.562478:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.562589:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520897024
00000100:00100000:3.0:1789760725.562599:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520897024
00000100:00100000:3.0:1789760725.562651:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697156973627 time 697201974702 state 0x0 ref 1
00000100:00100000:3.0:1789760725.562665:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697202235118 time 697201974702 state 0x1 ref 1
00000100:00100000:3.0:1789760725.562704:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697202235118 time 697249386185 state 0x0 ref 1
00000100:00100000:3.0:1789760725.562716:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520897024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760725.562763:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20512768, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:3.0:1789760725.562771:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.562786:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:3.0:1789760725.562789:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760725.562795:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.562807:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760725.599355:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20512768 -> 20516864
00010000:00010000:3.0:1789760725.599374:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.599398:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.599409:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.599417:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760725.599422:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.599431:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.599450:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.599457:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20512768->20516863] (req 20512768->20516863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.599556:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520897024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36837us (37077us total) trans 4294972328 rc 0/0
00000100:00100000:3.0:1789760725.599567:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5041
00000100:00100000:3.0:1789760725.599577:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697202235118 time 697249386185 state 0x2 ref 0
00000001:00080000:3.0:1789760725.599615:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972328 is committed
00000100:00100000:3.0:1789760725.609922:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.610021:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520897152
00000100:00100000:2.0:1789760725.610030:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520897152
00000100:00100000:2.0:1789760725.610085:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697202235118 time 697249386185 state 0x0 ref 1
00000100:00100000:2.0:1789760725.610101:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697249646601 time 697249386185 state 0x1 ref 1
00000100:00100000:2.0:1789760725.610135:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697249646601 time 697296817804 state 0x0 ref 1
00000100:00100000:2.0:1789760725.610148:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520897152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.610194:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20516864, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.610203:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.610219:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760725.610224:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.610230:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.610245:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.625448:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1789760725.625471:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548745600:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1789760725.625544:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760725.625633:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548745600
00000100:00100000:3.0:1789760725.625642:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548745600
00000100:00100000:3.0:1789760725.625701:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414
00000100:00100000:3.0:1789760725.625713:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548745600:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1789760725.625754:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:3.0:1789760725.625808:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548745600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (266us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760725.625817:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414
00000100:00100000:3.0:1789760725.626684:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548745600:0@lo:41:osp-pre-1-0.0
00002000:00010000:3.0:1789760725.642435:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20516864 -> 20520960
00010000:00010000:3.0:1789760725.642454:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.642468:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.642483:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.642491:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760725.642495:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.642504:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.642524:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.642532:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bbd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20516864->20520959] (req 20516864->20520959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.642655:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520897152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32504us (33181us total) trans 4294972329 rc 0/0
00000100:00100000:3.0:1789760725.642667:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5042
00000100:00100000:3.0:1789760725.642676:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697249646601 time 697296817804 state 0x2 ref 0
00000001:00080000:3.0:1789760725.642714:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972329 is committed
00000100:00100000:3.0:1789760725.647464:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.647565:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520897280
00000100:00100000:2.0:1789760725.647574:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520897280
00000100:00100000:2.0:1789760725.647631:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697249646601 time 697296817804 state 0x0 ref 1
00000100:00100000:2.0:1789760725.647645:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697297078220 time 697296817804 state 0x1 ref 1
00000100:00100000:2.0:1789760725.647674:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697297078220 time 697334356927 state 0x0 ref 1
00000100:00100000:2.0:1789760725.647686:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520897280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.647733:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20520960, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.647742:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.647758:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760725.647762:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.647768:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.647782:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760725.681468:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972330 is committed
00002000:00010000:3.0:1789760725.683086:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20520960 -> 20525056
00010000:00010000:3.0:1789760725.683112:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.683136:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.683146:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.683153:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760725.683158:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.683167:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.683187:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.683194:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60bbdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20520960->20525055] (req 20520960->20525055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.683301:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520897280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35611us (35839us total) trans 4294972330 rc 0/0
00000100:00100000:3.0:1789760725.683357:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5043
00000100:00100000:3.0:1789760725.683369:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697297078220 time 697334356927 state 0x2 ref 0
00000100:00100000:0.0:1789760725.692306:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.692521:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520897408
00000100:00100000:2.0:1789760725.692531:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520897408
00000100:00100000:2.0:1789760725.692586:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697297078220 time 697334356927 state 0x0 ref 1
00000100:00100000:2.0:1789760725.692602:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697334617343 time 697334356927 state 0x1 ref 1
00000100:00100000:2.0:1789760725.692636:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697334617343 time 697379318506 state 0x0 ref 1
00000100:00100000:2.0:1789760725.692649:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520897408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.692696:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20525056, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.692706:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.692727:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760725.692732:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.692739:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.692753:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760725.739715:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972331 is committed
00002000:00010000:2.0:1789760725.739921:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20525056 -> 20529152
00010000:00010000:2.0:1789760725.739937:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.739952:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.739960:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.739968:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760725.739972:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.739981:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.740002:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.740010:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbe6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20525056->20529151] (req 20525056->20529151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760725.740101:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520897408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47451us (47801us total) trans 4294972331 rc 0/0
00000100:00100000:2.0:1789760725.740111:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5044
00000100:00100000:2.0:1789760725.740120:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697334617343 time 697379318506 state 0x2 ref 0
00000100:00100000:2.0:1789760725.743373:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.743474:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520897536
00000100:00100000:3.0:1789760725.743484:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520897536
00000100:00100000:3.0:1789760725.743595:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697334617343 time 697379318506 state 0x0 ref 1
00000100:00100000:3.0:1789760725.743609:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697379578922 time 697379318506 state 0x1 ref 1
00000100:00100000:3.0:1789760725.743671:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697379578922 time 697430353387 state 0x0 ref 1
00000100:00100000:3.0:1789760725.743682:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520897536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760725.743739:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20529152, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:3.0:1789760725.743748:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.743765:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:3.0:1789760725.743769:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760725.743776:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.743793:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760725.767895:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972332 is committed
00002000:00010000:0.0:1789760725.768022:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20529152 -> 20533248
00010000:00010000:0.0:1789760725.768036:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.768049:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.768057:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.768066:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760725.768070:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.768076:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.768091:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.768098:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bbed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20529152->20533247] (req 20529152->20533247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760725.768221:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520897536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24536us (24854us total) trans 4294972332 rc 0/0
00000100:00100000:0.0:1789760725.768232:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5045
00000100:00100000:0.0:1789760725.768240:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697379578922 time 697430353387 state 0x2 ref 0
00000100:00100000:3.0:1789760725.773561:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.774583:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520897664
00000100:00100000:2.0:1789760725.774595:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520897664
00000100:00100000:2.0:1789760725.774722:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697379578922 time 697430353387 state 0x0 ref 1
00000100:00100000:2.0:1789760725.774738:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697430613803 time 697430353387 state 0x1 ref 1
00000100:00100000:2.0:1789760725.774809:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697430613803 time 697461490313 state 0x0 ref 1
00000100:00100000:2.0:1789760725.774822:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520897664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.774882:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20533248, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.774891:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.774907:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760725.774911:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.774918:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.774932:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760725.805972:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20533248 -> 20537344
00010000:00010000:2.0:1789760725.805993:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.806007:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.806016:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.806025:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760725.806030:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.806039:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.806061:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.806069:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bbf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20533248->20537343] (req 20533248->20537343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760725.806166:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520897664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31341us (32610us total) trans 4294972333 rc 0/0
00000100:00100000:2.0:1789760725.806176:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5046
00000100:00100000:2.0:1789760725.806187:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697430613803 time 697461490313 state 0x2 ref 0
00000001:00080000:0.0:1789760725.807959:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972333 is committed
00000100:00100000:0.0:1789760725.813736:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.813834:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520897792
00000100:00100000:2.0:1789760725.813844:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520897792
00000100:00100000:2.0:1789760725.814027:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697430613803 time 697461490313 state 0x0 ref 1
00000100:00100000:2.0:1789760725.814047:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697461750729 time 697461490313 state 0x1 ref 1
00000100:00100000:2.0:1789760725.814113:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697461750729 time 697500794677 state 0x0 ref 1
00000100:00100000:2.0:1789760725.814126:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520897792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.814186:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20537344, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:2.0:1789760725.814486:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.814504:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760725.814508:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.814515:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.814528:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760725.853102:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.853134:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.853175:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.853197:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.853219:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.853248:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520897920
00000100:00100000:3.0:1789760725.853257:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520897920
00000100:00100000:3.0:1789760725.853306:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 464
00000100:00100000:3.0:1789760725.853393:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda0058450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520897920:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760725.853459:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda0058450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520897920:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 145us (283us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760725.853467:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 464
00000100:00100000:3.0:1789760725.853509:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520898048
00000100:00100000:3.0:1789760725.853513:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520898048
00000100:00100000:3.0:1789760725.853544:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520898304
00000100:00100000:3.0:1789760725.853547:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520898304
00000100:00100000:3.0:1789760725.853559:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520898176
00000100:00100000:3.0:1789760725.853561:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520898176
00000100:00100000:3.0:1789760725.853571:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520898432
00000100:00100000:3.0:1789760725.853573:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520898432
00000100:00100000:3.0:1789760725.853585:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 843
00000100:00100000:3.0:1789760725.853899:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520898048:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760725.853933:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520898048:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 342us (841us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760725.853940:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 843
00000100:00100000:3.0:1789760725.853954:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 844
00000100:00100000:3.0:1789760725.853960:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520898304:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760725.853980:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520898304:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (846us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760725.853986:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 844
00000100:00100000:3.0:1789760725.853996:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 845
00000100:00100000:3.0:1789760725.854002:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520898176:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760725.854025:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520898176:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (827us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760725.854031:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 845
00000100:00100000:3.0:1789760725.854040:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 846
00000100:00100000:3.0:1789760725.854045:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520898432:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760725.854063:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520898432:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 18us (844us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760725.854069:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 846
00000100:00080000:3.0:1789760725.854173:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1789760725.854177:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00002000:00010000:0.0:1789760725.871072:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20537344 -> 20541440
00010000:00010000:0.0:1789760725.871091:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.871104:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.871113:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.871120:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760725.871125:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.871134:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.871154:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.871163:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bbfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20537344->20541439] (req 20537344->20541439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760725.871257:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520897792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57128us (57525us total) trans 4294972334 rc 0/0
00000100:00100000:0.0:1789760725.871268:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5047
00000100:00100000:0.0:1789760725.871277:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697461750729 time 697500794677 state 0x2 ref 0
00000001:00080000:1.0:1789760725.872588:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972334 is committed
00000100:00100000:2.0:1789760725.875590:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760725.875676:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520898560
00000100:00100000:0.0:1789760725.875685:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520898560
00000100:00100000:0.0:1789760725.875738:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697461750729 time 697500794677 state 0x0 ref 1
00000100:00100000:0.0:1789760725.875753:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697501055093 time 697500794677 state 0x1 ref 1
00000100:00100000:0.0:1789760725.875823:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697501055093 time 697562505578 state 0x0 ref 1
00000100:00100000:0.0:1789760725.875836:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520898560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760725.875891:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20541440, mtime: 0x6aad94d6, atime: 0x0, ctime: 0x6aad94d6, blocks: 0xa007
00010000:00010000:0.0:1789760725.875899:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.875913:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:0.0:1789760725.875917:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760725.875923:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.875936:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760725.903144:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972335 is committed
00002000:00010000:0.0:1789760725.903275:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20541440 -> 20545536
00002000:00010000:0.0:1789760725.903280:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760726 -> 1789760727
00002000:00010000:0.0:1789760725.903283:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760726 -> 1789760727
00010000:00010000:0.0:1789760725.903296:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.903309:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.903345:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.903355:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760725.903359:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.903369:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.903397:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.903406:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20541440->20545535] (req 20541440->20545535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760725.903484:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520898560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27646us (27899us total) trans 4294972335 rc 0/0
00000100:00100000:0.0:1789760725.904399:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5048
00000100:00100000:0.0:1789760725.904409:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697501055093 time 697562505578 state 0x2 ref 0
00000100:00100000:0.0:1789760725.907736:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760725.907816:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520898688
00000100:00100000:3.0:1789760725.907824:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520898688
00000100:00100000:3.0:1789760725.907883:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697501055093 time 697562505578 state 0x0 ref 1
00000100:00100000:3.0:1789760725.907897:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697562765994 time 697562505578 state 0x1 ref 1
00000100:00100000:3.0:1789760725.907927:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697562765994 time 697594609895 state 0x0 ref 1
00000100:00100000:3.0:1789760725.907938:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520898688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760725.907980:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20545536, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:3.0:1789760725.907989:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.908005:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:3.0:1789760725.908009:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760725.908016:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760725.908030:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760725.943852:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20545536 -> 20549632
00010000:00010000:0.0:1789760725.943880:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.943893:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.943909:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.943917:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760725.943921:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.943931:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.943950:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.943958:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20545536->20549631] (req 20545536->20549631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760725.944053:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520898688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36112us (36320us total) trans 4294972336 rc 0/0
00000100:00100000:0.0:1789760725.944064:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5049
00000100:00100000:0.0:1789760725.944073:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697562765994 time 697594609895 state 0x2 ref 0
00000100:00100000:3.0:1789760725.947972:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760725.948119:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520898816
00000100:00100000:2.0:1789760725.948129:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520898816
00000100:00100000:2.0:1789760725.948185:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697562765994 time 697594609895 state 0x0 ref 1
00000100:00100000:2.0:1789760725.948201:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697594870311 time 697594609895 state 0x1 ref 1
00000100:00100000:2.0:1789760725.948230:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697594870311 time 697634912508 state 0x0 ref 1
00000100:00100000:2.0:1789760725.948242:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520898816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760725.948292:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20549632, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760725.948302:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.948349:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760725.948354:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760725.948361:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.948375:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760725.954477:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972336 is committed
00000001:00080000:3.0:1789760725.973121:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972337 is committed
00002000:00010000:2.0:1789760725.973217:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20549632 -> 20553728
00010000:00010000:2.0:1789760725.973232:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.973251:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.973260:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.973267:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760725.973272:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.973281:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.973299:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760725.973307:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20549632->20553727] (req 20549632->20553727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760725.973427:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520898816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25181us (25460us total) trans 4294972337 rc 0/0
00000100:00100000:2.0:1789760725.973437:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5050
00000100:00100000:2.0:1789760725.973447:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697594870311 time 697634912508 state 0x2 ref 0
00000100:00100000:2.0:1789760725.978054:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760725.978298:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520898944
00000100:00100000:0.0:1789760725.978308:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520898944
00000100:00100000:0.0:1789760725.978401:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697594870311 time 697634912508 state 0x0 ref 1
00000100:00100000:0.0:1789760725.978416:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697635172924 time 697634912508 state 0x1 ref 1
00000100:00100000:0.0:1789760725.978442:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697635172924 time 697665125137 state 0x0 ref 1
00000100:00100000:0.0:1789760725.978454:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520898944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760725.978500:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20553728, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:0.0:1789760725.978510:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.978525:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:0.0:1789760725.978529:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760725.978536:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760725.978549:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760726.003509:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972338 is committed
00002000:00010000:1.0:1789760726.003601:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20553728 -> 20557824
00010000:00010000:1.0:1789760726.003617:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.003630:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.003639:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.003646:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760726.003651:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.003665:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.003684:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.003691:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60bc17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20553728->20557823] (req 20553728->20557823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760726.003826:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520898944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25367us (25777us total) trans 4294972338 rc 0/0
00000100:00100000:1.0:1789760726.003837:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5051
00000100:00100000:1.0:1789760726.003846:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697635172924 time 697665125137 state 0x2 ref 0
00000100:00100000:3.0:1789760726.008097:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760726.008193:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520899072
00000100:00100000:0.0:1789760726.008203:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520899072
00000100:00100000:0.0:1789760726.008269:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697635172924 time 697665125137 state 0x0 ref 1
00000100:00100000:0.0:1789760726.008283:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697665385553 time 697665125137 state 0x1 ref 1
00000100:00100000:0.0:1789760726.008338:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697665385553 time 697694996323 state 0x0 ref 1
00000100:00100000:0.0:1789760726.008350:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760726.008411:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20557824, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:0.0:1789760726.008421:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.008436:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:0.0:1789760726.008440:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760726.008446:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.008460:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760726.010109:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760726.043012:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972339 is committed
00002000:00010000:2.0:1789760726.043366:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20557824 -> 20561920
00010000:00010000:2.0:1789760726.043381:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.043447:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.043457:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.043465:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760726.043470:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.043478:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.043563:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.043572:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60bc1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20557824->20561919] (req 20557824->20561919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760726.043659:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35306us (35567us total) trans 4294972339 rc 0/0
00000100:00100000:2.0:1789760726.043670:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5052
00000100:00100000:2.0:1789760726.043680:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697665385553 time 697694996323 state 0x2 ref 0
00000100:00100000:3.0:1789760726.047102:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760726.047167:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520899200
00000100:00100000:0.0:1789760726.047178:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520899200
00000100:00100000:0.0:1789760726.047231:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697665385553 time 697694996323 state 0x0 ref 1
00000100:00100000:0.0:1789760726.047247:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697695256739 time 697694996323 state 0x1 ref 1
00000100:00100000:0.0:1789760726.047280:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697695256739 time 697733961896 state 0x0 ref 1
00000100:00100000:0.0:1789760726.047292:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520899200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760726.047362:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20561920, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:0.0:1789760726.047371:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.047390:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:0.0:1789760726.047394:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760726.047401:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.047415:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760726.077179:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20561920 -> 20566016
00010000:00010000:0.0:1789760726.077198:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.077209:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.077217:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.077224:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760726.077228:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.077237:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.077255:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.077262:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60bc25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20561920->20566015] (req 20561920->20566015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760726.077431:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520899200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30088us (30284us total) trans 4294972340 rc 0/0
00000100:00100000:0.0:1789760726.077444:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5053
00000100:00100000:0.0:1789760726.077454:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697695256739 time 697733961896 state 0x2 ref 0
00000001:00080000:3.0:1789760726.077698:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972340 is committed
00000100:00100000:1.0:1789760726.082470:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760726.082702:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520899328
00000100:00100000:2.0:1789760726.082712:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520899328
00000100:00100000:2.0:1789760726.082765:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697695256739 time 697733961896 state 0x0 ref 1
00000100:00100000:2.0:1789760726.082780:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697734222312 time 697733961896 state 0x1 ref 1
00000100:00100000:2.0:1789760726.082885:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697734222312 time 697769565989 state 0x0 ref 1
00000100:00100000:2.0:1789760726.082899:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520899328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.082944:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20566016, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760726.082953:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.082969:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760726.082974:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.082981:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.082994:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760726.116048:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972341 is committed
00002000:00010000:3.0:1789760726.116168:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20566016 -> 20570112
00010000:00010000:3.0:1789760726.116184:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.116198:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.116207:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.116215:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.116220:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.116234:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.116252:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.116259:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bc2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20566016->20570111] (req 20566016->20570111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.116368:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520899328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33468us (33903us total) trans 4294972341 rc 0/0
00000100:00100000:3.0:1789760726.116378:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5054
00000100:00100000:3.0:1789760726.116552:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697734222312 time 697769565989 state 0x2 ref 0
00000100:00100000:3.0:1789760726.120113:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760726.120238:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520899456
00000100:00100000:2.0:1789760726.120248:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520899456
00000100:00100000:2.0:1789760726.120301:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697734222312 time 697769565989 state 0x0 ref 1
00000100:00100000:2.0:1789760726.120333:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697769826405 time 697769565989 state 0x1 ref 1
00000100:00100000:2.0:1789760726.120367:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697769826405 time 697807050175 state 0x0 ref 1
00000100:00100000:2.0:1789760726.120380:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.120436:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20570112, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760726.120446:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.120461:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760726.120465:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.120472:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.120640:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.138538:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548745728:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760726.138607:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760726.140268:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548745728
00000100:00100000:3.0:1789760726.140279:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548745728
00000100:00100000:3.0:1789760726.140351:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346
00000100:00100000:3.0:1789760726.140361:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548745728:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1789760726.140385:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528285696 pending 1703936 free 3837788160 avail 3815768064
00000100:00100000:3.0:1789760726.140449:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548745728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1842us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760726.140456:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346
00000100:00080000:3.0:1789760726.140548:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760726.140588:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548745728:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760726.140682:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1789760726.140694:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548745856:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1789760726.140730:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760726.140773:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548745856
00000100:00100000:3.0:1789760726.140777:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548745856
00000100:00100000:3.0:1789760726.140817:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347
00000100:00100000:3.0:1789760726.140824:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548745856:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1789760726.140835:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528285696 pending 1703936 free 3837788160 avail 3815768064
00000100:00100000:3.0:1789760726.140879:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548745856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (147us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760726.140885:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347
00000100:00080000:3.0:1789760726.140898:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760726.140924:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548745856:0@lo:13:osp-pre-0-1.0
00002000:00010000:1.0:1789760726.153076:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20570112 -> 20574208
00000001:00080000:3.0:1789760726.153090:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972342 is committed
00010000:00010000:1.0:1789760726.153098:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.153112:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.153121:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.153136:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760726.153141:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.153151:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.153172:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.153177:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bc33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20570112->20574207] (req 20570112->20574207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760726.153261:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32879us (33155us total) trans 4294972342 rc 0/0
00000100:00100000:1.0:1789760726.153272:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5055
00000100:00100000:1.0:1789760726.153282:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697769826405 time 697807050175 state 0x2 ref 0
00000100:00100000:0.0:1789760726.162250:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760726.162344:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520899584
00000100:00100000:2.0:1789760726.162353:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520899584
00000100:00100000:2.0:1789760726.162419:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697769826405 time 697807050175 state 0x0 ref 1
00000100:00100000:2.0:1789760726.162434:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697807310591 time 697807050175 state 0x1 ref 1
00000100:00100000:2.0:1789760726.162461:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697807310591 time 697849143846 state 0x0 ref 1
00000100:00100000:2.0:1789760726.162472:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.162756:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20574208, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760726.162766:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.162782:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760726.162787:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.162793:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.162817:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760726.203096:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972343 is committed
00002000:00010000:3.0:1789760726.203164:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20574208 -> 20578304
00010000:00010000:3.0:1789760726.203178:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.203187:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.203194:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.203201:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.203207:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.203216:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.203234:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.203242:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bc3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20574208->20578303] (req 20574208->20578303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.203386:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40909us (41140us total) trans 4294972343 rc 0/0
00000100:00100000:3.0:1789760726.203397:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5056
00000100:00100000:3.0:1789760726.203405:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697807310591 time 697849143846 state 0x2 ref 0
00000100:00100000:3.0:1789760726.206630:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760726.206800:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520899712
00000100:00100000:1.0:1789760726.206930:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520899712
00000100:00100000:1.0:1789760726.206981:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697807310591 time 697849143846 state 0x0 ref 1
00000100:00100000:1.0:1789760726.206998:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697849404262 time 697849143846 state 0x1 ref 1
00000100:00100000:1.0:1789760726.207028:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697849404262 time 697893710921 state 0x0 ref 1
00000100:00100000:1.0:1789760726.207040:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760726.207082:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20578304, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:1.0:1789760726.207091:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.207106:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:1.0:1789760726.207110:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760726.207116:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.207130:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760726.243238:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972344 is committed
00002000:00010000:3.0:1789760726.243390:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20578304 -> 20582400
00010000:00010000:3.0:1789760726.243407:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.243420:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.243429:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.243486:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.243492:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.243501:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.243520:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.243527:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60bc41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20578304->20582399] (req 20578304->20582399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.243619:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36573us (36992us total) trans 4294972344 rc 0/0
00000100:00100000:3.0:1789760726.243629:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5057
00000100:00100000:3.0:1789760726.243639:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697849404262 time 697893710921 state 0x2 ref 0
00000100:00100000:2.0:1789760726.250458:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760726.250544:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520899840
00000100:00100000:3.0:1789760726.250555:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520899840
00000100:00100000:3.0:1789760726.250609:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697849404262 time 697893710921 state 0x0 ref 1
00000100:00100000:3.0:1789760726.250625:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697893971337 time 697893710921 state 0x1 ref 1
00000100:00100000:3.0:1789760726.250656:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697893971337 time 697937339213 state 0x0 ref 1
00000100:00100000:3.0:1789760726.250672:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760726.250725:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20582400, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:3.0:1789760726.250734:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.250752:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:3.0:1789760726.250756:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760726.250763:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.250789:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760726.279051:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972345 is committed
00002000:00010000:3.0:1789760726.279203:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20582400 -> 20586496
00010000:00010000:3.0:1789760726.279220:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.279233:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.279242:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.279250:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.279255:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.279264:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.279283:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.279290:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20582400->20586495] (req 20582400->20586495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.279433:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520899840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28758us (28980us total) trans 4294972345 rc 0/0
00000100:00100000:3.0:1789760726.279443:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5058
00000100:00100000:3.0:1789760726.279453:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697893971337 time 697937339213 state 0x2 ref 0
00000100:00100000:0.0:1789760726.283678:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760726.283951:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520899968
00000100:00100000:2.0:1789760726.283961:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520899968
00000100:00100000:2.0:1789760726.284013:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697893971337 time 697937339213 state 0x0 ref 1
00000100:00100000:2.0:1789760726.284028:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697937599629 time 697937339213 state 0x1 ref 1
00000100:00100000:2.0:1789760726.284059:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697937599629 time 697970740753 state 0x0 ref 1
00000100:00100000:2.0:1789760726.284072:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520899968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.284131:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20586496, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760726.284140:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.284156:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=697s v=(0 0)
00010000:00010000:2.0:1789760726.284161:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.284168:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.284184:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760726.339826:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972346 is committed
00002000:00010000:0.0:1789760726.339979:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20586496 -> 20590592
00010000:00010000:0.0:1789760726.339997:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.340011:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.340020:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.340027:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760726.340032:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.340041:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.340066:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.340074:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bc4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20586496->20590591] (req 20586496->20590591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760726.340160:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520899968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56086us (56488us total) trans 4294972346 rc 0/0
00000100:00100000:0.0:1789760726.340171:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5059
00000100:00100000:0.0:1789760726.340180:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697937599629 time 697970740753 state 0x2 ref 0
00000100:00100000:0.0:1789760726.346861:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760726.347994:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520900096
00000100:00100000:2.0:1789760726.348006:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520900096
00000100:00100000:2.0:1789760726.348063:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697937599629 time 697970740753 state 0x0 ref 1
00000100:00100000:2.0:1789760726.348078:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697971001169 time 697970740753 state 0x1 ref 1
00000100:00100000:2.0:1789760726.348150:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697971001169 time 698034832849 state 0x0 ref 1
00000100:00100000:2.0:1789760726.348164:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520900096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.348211:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20590592, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760726.348230:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.348245:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:2.0:1789760726.348249:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.348255:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.348268:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760726.392828:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972347 is committed
00002000:00010000:3.0:1789760726.392911:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20590592 -> 20594688
00010000:00010000:3.0:1789760726.392927:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.392940:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.392949:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.392962:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.392967:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.392976:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.392996:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.393003:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bc56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20590592->20594687] (req 20590592->20594687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.393101:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520900096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44934us (46254us total) trans 4294972347 rc 0/0
00000100:00100000:3.0:1789760726.393111:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5060
00000100:00100000:3.0:1789760726.393121:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697971001169 time 698034832849 state 0x2 ref 0
00000100:00100000:0.0:1789760726.396799:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760726.396945:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520900224
00000100:00100000:3.0:1789760726.396955:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520900224
00000100:00100000:3.0:1789760726.397008:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 697971001169 time 698034832849 state 0x0 ref 1
00000100:00100000:3.0:1789760726.397024:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698035093265 time 698034832849 state 0x1 ref 1
00000100:00100000:3.0:1789760726.397054:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698035093265 time 698083737292 state 0x0 ref 1
00000100:00100000:3.0:1789760726.397069:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520900224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760726.397116:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20594688, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:3.0:1789760726.397125:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.397141:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760726.397145:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760726.397150:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.397164:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760726.435662:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972348 is committed
00002000:00010000:0.0:1789760726.435841:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20594688 -> 20598784
00010000:00010000:0.0:1789760726.435866:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.435880:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.435947:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.435955:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760726.435960:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.435971:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.435990:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.435998:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bc5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20594688->20598783] (req 20594688->20598783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760726.436115:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520900224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39043us (39322us total) trans 4294972348 rc 0/0
00000100:00100000:0.0:1789760726.436125:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5061
00000100:00100000:0.0:1789760726.436135:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698035093265 time 698083737292 state 0x2 ref 0
00000100:00100000:0.0:1789760726.442876:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760726.442996:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520900352
00000100:00100000:3.0:1789760726.443007:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520900352
00000100:00100000:3.0:1789760726.443067:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698035093265 time 698083737292 state 0x0 ref 1
00000100:00100000:3.0:1789760726.443083:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698083997708 time 698083737292 state 0x1 ref 1
00000100:00100000:3.0:1789760726.443113:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698083997708 time 698129796181 state 0x0 ref 1
00000100:00100000:3.0:1789760726.443124:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520900352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760726.443173:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20598784, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:3.0:1789760726.443182:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.443204:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760726.443209:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760726.443217:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.443233:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760726.485062:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972349 is committed
00002000:00010000:1.0:1789760726.485303:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20598784 -> 20602880
00010000:00010000:1.0:1789760726.485507:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.485521:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.485530:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.485538:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760726.485543:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.485550:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.485569:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760726.485576:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bc64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20598784->20602879] (req 20598784->20602879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760726.486043:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520900352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42913us (43170us total) trans 4294972349 rc 0/0
00000100:00100000:2.0:1789760726.486055:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5062
00000100:00100000:2.0:1789760726.486064:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698083997708 time 698129796181 state 0x2 ref 0
00000100:00100000:3.0:1789760726.490521:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760726.490810:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520900480
00000100:00100000:0.0:1789760726.490819:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520900480
00000100:00100000:0.0:1789760726.491836:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698083997708 time 698129796181 state 0x0 ref 1
00000100:00100000:0.0:1789760726.491864:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698130056597 time 698129796181 state 0x1 ref 1
00000100:00100000:0.0:1789760726.492502:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698130056597 time 698179180870 state 0x0 ref 1
00000100:00100000:0.0:1789760726.492519:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520900480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760726.492578:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20602880, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:0.0:1789760726.492587:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.492604:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:0.0:1789760726.492609:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760726.492615:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.492630:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760726.531898:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972350 is committed
00002000:00010000:0.0:1789760726.532010:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20602880 -> 20606976
00010000:00010000:0.0:1789760726.532025:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.532039:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.532048:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.532055:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760726.532061:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.532071:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.532091:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.532099:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bc6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20602880->20606975] (req 20602880->20606975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760726.532395:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520900480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39798us (41801us total) trans 4294972350 rc 0/0
00000100:00100000:0.0:1789760726.532406:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5063
00000100:00100000:0.0:1789760726.532415:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698130056597 time 698179180870 state 0x2 ref 0
00000100:00100000:0.0:1789760726.543210:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760726.544118:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520900608
00000100:00100000:2.0:1789760726.544133:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520900608
00000100:00100000:2.0:1789760726.544202:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698130056597 time 698179180870 state 0x0 ref 1
00000100:00100000:2.0:1789760726.544217:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698179441286 time 698179180870 state 0x1 ref 1
00000100:00100000:2.0:1789760726.544250:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698179441286 time 698230932993 state 0x0 ref 1
00000100:00100000:2.0:1789760726.544263:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520900608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.544352:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20606976, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760726.544363:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.544379:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:2.0:1789760726.544383:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.544390:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.544404:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760726.577625:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972351 is committed
00002000:00010000:2.0:1789760726.577733:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20606976 -> 20611072
00010000:00010000:2.0:1789760726.577815:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.577829:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.577838:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.577846:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760726.577860:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.577869:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.577888:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.577896:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20606976->20611071] (req 20606976->20611071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760726.577982:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520900608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33716us (34777us total) trans 4294972351 rc 0/0
00000100:00100000:2.0:1789760726.577996:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5064
00000100:00100000:2.0:1789760726.578005:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698179441286 time 698230932993 state 0x2 ref 0
00000100:00100000:0.0:1789760726.583592:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760726.583706:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520900736
00000100:00100000:3.0:1789760726.583716:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520900736
00000100:00100000:3.0:1789760726.583847:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698179441286 time 698230932993 state 0x0 ref 1
00000100:00100000:3.0:1789760726.584053:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698231193409 time 698230932993 state 0x1 ref 1
00000100:00100000:3.0:1789760726.584119:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698231193409 time 698270802115 state 0x0 ref 1
00000100:00100000:3.0:1789760726.584133:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520900736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760726.584180:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20611072, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:3.0:1789760726.584188:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.584205:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760726.584209:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760726.584215:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.584230:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.586296:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760726.625099:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972352 is committed
00002000:00010000:0.0:1789760726.625550:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20611072 -> 20615168
00010000:00010000:0.0:1789760726.625565:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.625577:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.625586:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.625593:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760726.625597:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.625606:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.625624:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.625631:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bc79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20611072->20615167] (req 20611072->20615167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760726.625829:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520900736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41694us (42241us total) trans 4294972352 rc 0/0
00000100:00100000:0.0:1789760726.625839:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5065
00000100:00100000:0.0:1789760726.625848:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698231193409 time 698270802115 state 0x2 ref 0
00000100:00100000:0.0:1789760726.629708:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760726.629873:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520900864
00000100:00100000:3.0:1789760726.629882:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520900864
00000100:00100000:3.0:1789760726.629933:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698231193409 time 698270802115 state 0x0 ref 1
00000100:00100000:3.0:1789760726.629947:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698271062531 time 698270802115 state 0x1 ref 1
00000100:00100000:3.0:1789760726.630022:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698271062531 time 698316703751 state 0x0 ref 1
00000100:00100000:3.0:1789760726.630035:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520900864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760726.630080:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20615168, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:3.0:1789760726.630090:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.630105:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760726.630110:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760726.630116:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.630130:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760726.663412:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972353 is committed
00002000:00010000:3.0:1789760726.663601:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20615168 -> 20619264
00010000:00010000:3.0:1789760726.663616:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.663629:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.663638:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.663645:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.663650:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.663659:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.663678:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.663686:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20615168->20619263] (req 20615168->20619263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.663775:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520900864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33738us (34071us total) trans 4294972353 rc 0/0
00000100:00100000:3.0:1789760726.663786:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5066
00000100:00100000:3.0:1789760726.663794:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698271062531 time 698316703751 state 0x2 ref 0
00000100:00100000:2.0:1789760726.667735:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760726.667831:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520900992
00000100:00100000:0.0:1789760726.667841:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520900992
00000100:00100000:0.0:1789760726.667903:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698271062531 time 698316703751 state 0x0 ref 1
00000100:00100000:0.0:1789760726.667918:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698316964167 time 698316703751 state 0x1 ref 1
00000100:00100000:0.0:1789760726.667948:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698316964167 time 698354630898 state 0x0 ref 1
00000100:00100000:0.0:1789760726.667960:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520900992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760726.668008:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20619264, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:0.0:1789760726.668017:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.668032:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:0.0:1789760726.668037:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760726.668042:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.668055:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760726.709270:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972354 is committed
00002000:00010000:0.0:1789760726.709606:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20619264 -> 20623360
00010000:00010000:0.0:1789760726.709620:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.709633:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.709643:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.709649:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760726.709654:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.709661:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.709679:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.709685:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60bc87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20619264->20623359] (req 20619264->20623359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760726.709776:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520900992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41812us (42046us total) trans 4294972354 rc 0/0
00000100:00100000:0.0:1789760726.709786:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5067
00000100:00100000:0.0:1789760726.709794:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698316964167 time 698354630898 state 0x2 ref 0
00000100:00100000:0.0:1789760726.713069:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760726.713154:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520901120
00000100:00100000:2.0:1789760726.713164:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520901120
00000100:00100000:2.0:1789760726.713217:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698316964167 time 698354630898 state 0x0 ref 1
00000100:00100000:2.0:1789760726.713232:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698354891314 time 698354630898 state 0x1 ref 1
00000100:00100000:2.0:1789760726.713258:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698354891314 time 698399941556 state 0x0 ref 1
00000100:00100000:2.0:1789760726.713270:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520901120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.713341:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20623360, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760726.713350:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.713374:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:2.0:1789760726.713571:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.713579:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.713593:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760726.749118:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20623360 -> 20627456
00010000:00010000:0.0:1789760726.749138:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.749152:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.749160:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.749167:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760726.749173:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.749187:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760726.749362:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972355 is committed
00010000:00010000:0.0:1789760726.749484:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760726.749493:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60bc8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20623360->20627455] (req 20623360->20627455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760726.749584:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520901120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36308us (36518us total) trans 4294972355 rc 0/0
00000100:00100000:0.0:1789760726.749594:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5068
00000100:00100000:0.0:1789760726.749603:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698354891314 time 698399941556 state 0x2 ref 0
00000100:00100000:0.0:1789760726.755194:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760726.755302:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520901248
00000100:00100000:3.0:1789760726.755328:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520901248
00000100:00100000:3.0:1789760726.755394:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698354891314 time 698399941556 state 0x0 ref 1
00000100:00100000:3.0:1789760726.755409:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698400201972 time 698399941556 state 0x1 ref 1
00000100:00100000:3.0:1789760726.755433:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698400201972 time 698442115738 state 0x0 ref 1
00000100:00100000:3.0:1789760726.755444:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520901248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760726.755499:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20627456, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:3.0:1789760726.755508:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.755523:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760726.755528:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760726.755534:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.755547:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760726.802449:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972356 is committed
00002000:00010000:3.0:1789760726.802605:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20627456 -> 20631552
00010000:00010000:3.0:1789760726.802620:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.802633:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.802643:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.802650:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.802654:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.802662:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.802682:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.802690:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20627456->20631551] (req 20627456->20631551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.802790:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520901248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47342us (47601us total) trans 4294972356 rc 0/0
00000100:00100000:3.0:1789760726.802801:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5069
00000100:00100000:3.0:1789760726.802810:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698400201972 time 698442115738 state 0x2 ref 0
00000100:00100000:2.0:1789760726.815866:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760726.815943:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520901376
00000100:00100000:3.0:1789760726.815953:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520901376
00000100:00100000:3.0:1789760726.816004:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698400201972 time 698442115738 state 0x0 ref 1
00000100:00100000:3.0:1789760726.816019:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698442376154 time 698442115738 state 0x1 ref 1
00000100:00100000:3.0:1789760726.816105:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698442376154 time 698502787206 state 0x0 ref 1
00000100:00100000:3.0:1789760726.816119:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520901376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760726.816165:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20631552, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:3.0:1789760726.816175:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.816190:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760726.816194:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760726.816205:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.816219:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760726.886283:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972357 is committed
00002000:00010000:3.0:1789760726.886445:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20631552 -> 20635648
00010000:00010000:3.0:1789760726.886460:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.886472:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.886479:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.886486:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.886491:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.886501:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.886519:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.886536:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bc9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20631552->20635647] (req 20631552->20635647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.886628:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520901376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70508us (70777us total) trans 4294972357 rc 0/0
00000100:00100000:3.0:1789760726.886639:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5070
00000100:00100000:3.0:1789760726.886821:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698442376154 time 698502787206 state 0x2 ref 0
00000100:00100000:1.0:1789760726.889840:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760726.890243:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520901504
00000100:00100000:0.0:1789760726.890253:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520901504
00000100:00100000:0.0:1789760726.890304:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698442376154 time 698502787206 state 0x0 ref 1
00000100:00100000:0.0:1789760726.890349:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698503047622 time 698502787206 state 0x1 ref 1
00000100:00100000:0.0:1789760726.890374:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698503047622 time 698577056308 state 0x0 ref 1
00000100:00100000:2.0:1789760726.890700:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520901504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.890749:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20635648, mtime: 0x6aad94d7, atime: 0x0, ctime: 0x6aad94d7, blocks: 0xa007
00010000:00010000:2.0:1789760726.890758:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.890773:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:2.0:1789760726.890778:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.890785:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.890799:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760726.926695:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20635648 -> 20639744
00002000:00010000:3.0:1789760726.926704:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760727 -> 1789760728
00002000:00010000:3.0:1789760726.926707:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760727 -> 1789760728
00010000:00010000:3.0:1789760726.926720:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.926734:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.926743:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.926751:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760726.926757:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.926766:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.926784:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760726.926792:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bca3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20635648->20639743] (req 20635648->20639743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760726.926900:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520901504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36342us (37065us total) trans 4294972358 rc 0/0
00000100:00100000:3.0:1789760726.926911:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5071
00000100:00100000:3.0:1789760726.926920:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698503047622 time 698577056308 state 0x2 ref 0
00000100:00100000:3.0:1789760726.930785:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:0.0:1789760726.930931:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972358 is committed
00000100:00100000:2.0:1789760726.931933:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520901632
00000100:00100000:2.0:1789760726.931944:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520901632
00000100:00100000:2.0:1789760726.931998:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698503047622 time 698577056308 state 0x0 ref 1
00000100:00100000:2.0:1789760726.932014:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698577316724 time 698577056308 state 0x1 ref 1
00000100:00100000:2.0:1789760726.932415:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698577316724 time 698619095372 state 0x0 ref 1
00000100:00100000:2.0:1789760726.932430:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520901632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760726.932658:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20639744, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:2.0:1789760726.932670:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.932686:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:2.0:1789760726.932691:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760726.932696:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.932709:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760726.991238:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20639744 -> 20643840
00010000:00010000:2.0:1789760726.991260:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.991273:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.991282:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.991290:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760726.991295:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.991304:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.991350:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760726.991356:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20639744->20643839] (req 20639744->20643839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760726.991617:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520901632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59185us (60836us total) trans 4294972359 rc 0/0
00000100:00100000:2.0:1789760726.991628:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5072
00000100:00100000:2.0:1789760726.991638:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698577316724 time 698619095372 state 0x2 ref 0
00000001:00080000:3.0:1789760726.994256:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972359 is committed
00000100:00100000:2.0:1789760727.000485:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.000579:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520901760
00000100:00100000:3.0:1789760727.000589:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520901760
00000100:00100000:3.0:1789760727.000642:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698577316724 time 698619095372 state 0x0 ref 1
00000100:00100000:3.0:1789760727.000658:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698619355788 time 698619095372 state 0x1 ref 1
00000100:00100000:3.0:1789760727.000727:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698619355788 time 698687409224 state 0x0 ref 1
00000100:00100000:3.0:1789760727.000742:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520901760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760727.000804:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20643840, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:3.0:1789760727.000815:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.000831:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760727.000836:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760727.000843:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.000867:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760727.037724:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20643840 -> 20647936
00010000:00010000:3.0:1789760727.037743:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.037756:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.037764:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.037772:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760727.037778:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.037787:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.037807:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.037815:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20643840->20647935] (req 20643840->20647935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760727.037920:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520901760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37177us (37440us total) trans 4294972360 rc 0/0
00000100:00100000:3.0:1789760727.037932:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5073
00000100:00100000:3.0:1789760727.037942:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698619355788 time 698687409224 state 0x2 ref 0
00000001:00080000:2.0:1789760727.038640:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972360 is committed
00000100:00100000:0.0:1789760727.046797:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.048807:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520901888
00000100:00100000:3.0:1789760727.048821:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520901888
00000100:00100000:3.0:1789760727.048892:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698619355788 time 698687409224 state 0x0 ref 1
00000100:00100000:3.0:1789760727.048907:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698687669640 time 698687409224 state 0x1 ref 1
00000100:00100000:3.0:1789760727.048997:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698687669640 time 698735678531 state 0x0 ref 1
00000100:00100000:3.0:1789760727.049011:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520901888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760727.049058:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20647936, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:3.0:1789760727.049068:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.049083:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760727.049088:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760727.049095:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.049108:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760727.085938:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20647936 -> 20652032
00010000:00010000:2.0:1789760727.085958:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.085972:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.085981:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.085988:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760727.085993:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.086003:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.086020:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.086028:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bcb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20647936->20652031] (req 20647936->20652031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760727.086127:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520901888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37114us (39335us total) trans 4294972361 rc 0/0
00000100:00100000:2.0:1789760727.086139:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5074
00000100:00100000:2.0:1789760727.086149:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698687669640 time 698735678531 state 0x2 ref 0
00000001:00080000:1.0:1789760727.087125:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972361 is committed
00000100:00100000:1.0:1789760727.093881:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760727.093951:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520902016
00000100:00100000:2.0:1789760727.093961:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520902016
00000100:00100000:2.0:1789760727.094012:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698687669640 time 698735678531 state 0x0 ref 1
00000100:00100000:2.0:1789760727.094027:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698735938947 time 698735678531 state 0x1 ref 1
00000100:00100000:2.0:1789760727.094056:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698735938947 time 698780738835 state 0x0 ref 1
00000100:00100000:2.0:1789760727.094068:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520902016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760727.094111:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20652032, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:2.0:1789760727.094121:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.094136:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:2.0:1789760727.094140:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760727.094146:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.094159:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760727.125463:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972362 is committed
00002000:00010000:3.0:1789760727.125705:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20652032 -> 20656128
00010000:00010000:3.0:1789760727.125720:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.125732:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.125742:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.125749:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760727.125754:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.125763:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.125787:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.125796:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bcbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20652032->20656127] (req 20652032->20656127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760727.125896:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520902016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31826us (32020us total) trans 4294972362 rc 0/0
00000100:00100000:3.0:1789760727.125907:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5075
00000100:00100000:3.0:1789760727.125917:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698735938947 time 698780738835 state 0x2 ref 0
00000100:00100000:3.0:1789760727.134301:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760727.134621:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520902144
00000100:00100000:2.0:1789760727.134632:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520902144
00000100:00100000:2.0:1789760727.134742:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698735938947 time 698780738835 state 0x0 ref 1
00000100:00100000:2.0:1789760727.134760:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698780999251 time 698780738835 state 0x1 ref 1
00000100:00100000:2.0:1789760727.134789:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698780999251 time 698821471320 state 0x0 ref 1
00000100:00100000:2.0:1789760727.134942:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520902144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760727.134991:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20656128, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:2.0:1789760727.135001:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.135018:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:2.0:1789760727.135023:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760727.135029:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.135048:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760727.162646:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548746240:0@lo:400:kworker.0
00000100:00100000:2.0:1789760727.162680:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548746368:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.162712:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760727.162712:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760727.162770:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548746880:0@lo:400:kworker.0
00000100:00100000:3.0:1789760727.162779:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b00aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548745984:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.162821:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3456:1876699548746752:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.162844:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.162872:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3456:1876699548747264:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.162893:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.162911:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3]
00000100:00100000:0.0:1789760727.162917:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876699548746112:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.162939:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.162956:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699548746624:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.162975:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.162990:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3456:1876699548747136:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163009:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.163019:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548747648:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760727.163040:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.163069:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548746240
00000100:00100000:0.0:1789760727.163076:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548746240
00000100:00100000:0.0:1789760727.163115:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415
00000100:00100000:0.0:1789760727.163124:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548746240:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163231:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548746240:12345-0@lo:400:kworker.0 Request processed in 106us (518us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.163239:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415
00000100:00100000:0.0:1789760727.163260:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548746368
00000100:00100000:0.0:1789760727.163264:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548746368
00000100:00100000:0.0:1789760727.163281:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548746752
00000100:00100000:0.0:1789760727.163283:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548746752
00000100:00100000:0.0:1789760727.163303:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548747264
00000100:00100000:0.0:1789760727.163306:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548747264
00000100:00100000:0.0:1789760727.163339:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548746112
00000100:00100000:0.0:1789760727.163341:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548746112
00000100:00100000:2.0:1789760727.163341:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.163351:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548746624
00000100:00100000:0.0:1789760727.163353:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548746624
00000100:00100000:0.0:1789760727.163364:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548747136
00000100:00100000:0.0:1789760727.163365:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548747136
00000100:00100000:2.0:1789760727.163365:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548747392:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163384:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847
00000100:00100000:2.0:1789760727.163384:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.163390:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548746368:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760727.163423:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548746880
00000100:00100000:0.0:1789760727.163425:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548746368:12345-0@lo:400:kworker.0 Request processed in 35us (713us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760727.163426:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548746880
00000100:00100000:0.0:1789760727.163431:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847
00000100:00100000:0.0:1789760727.163442:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848
00000100:00100000:0.0:1789760727.163447:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876699548746752:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760727.163449:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548747392
00000100:00100000:2.0:1789760727.163451:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548747392
00000100:00100000:2.0:1789760727.163470:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274
00000100:00100000:0.0:1789760727.163472:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876699548746752:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760727.163476:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548746880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163478:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848
00000100:00100000:0.0:1789760727.163487:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849
00000100:00100000:0.0:1789760727.163493:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876699548747264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163517:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876699548747264:12345-0@lo:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.163522:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849
00000100:00100000:0.0:1789760727.163532:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850
00000100:00100000:0.0:1789760727.163538:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876699548746112:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163562:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876699548746112:12345-0@lo:400:kworker.0 Request processed in 25us (622us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.163568:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850
00000100:00100000:0.0:1789760727.163579:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851
00000100:00100000:0.0:1789760727.163584:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd84fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699548746624:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163610:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd84fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699548746624:12345-0@lo:400:kworker.0 Request processed in 27us (635us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.163616:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851
00000100:00100000:0.0:1789760727.163627:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852
00000100:00100000:0.0:1789760727.163633:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876699548747136:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760727.163634:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548746880:12345-0@lo:400:kworker.0 Request processed in 159us (293us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760727.163640:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274
00000100:00100000:2.0:1789760727.163651:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275
00000100:00100000:0.0:1789760727.163654:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876699548747136:12345-0@lo:400:kworker.0 Request processed in 22us (644us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760727.163656:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548747392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163660:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852
00000100:00100000:2.0:1789760727.163682:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548747392:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760727.163687:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275
00000100:00100000:0.0:1789760727.163704:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548746368:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163717:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548746880:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163726:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548747392:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163751:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876699548746112:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163759:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699548746624:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163767:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3456:1876699548747136:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163775:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3456:1876699548746752:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163783:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3456:1876699548747264:0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.163791:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548746240:0@lo:400:kworker.0
00000100:00100000:1.0:1789760727.164527:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789760727.164540:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548747776:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760727.164580:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760727.164967:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548747648
00000100:00100000:0.0:1789760727.164974:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548747648
00000100:00100000:0.0:1789760727.165014:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548747776
00000100:00100000:0.0:1789760727.165017:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548747776
00000100:00100000:0.0:1789760727.165041:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348
00000100:00100000:0.0:1789760727.165048:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548747648:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1789760727.165075:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760727.165113:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548747648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (2072us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.165120:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348
00000100:00100000:0.0:1789760727.165134:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349
00000100:00100000:0.0:1789760727.165140:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548747776:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:0.0:1789760727.165149:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760727.165174:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548747776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (593us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.165180:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349
00000100:00100000:1.0:1789760727.165267:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b3d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548747776:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760727.165298:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548747648:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1789760727.165751:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760727.165792:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548746496:0@lo:400:kworker.0
00000100:00100000:3.0:1789760727.165819:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760727.166124:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548745984
00000100:00100000:1.0:1789760727.166130:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548745984
00000100:00100000:1.0:1789760727.166159:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465
00000100:00100000:1.0:1789760727.166165:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda005ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3454:x1876699548745984:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760727.166199:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda005ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3454:x1876699548745984:12345-0@lo:400:kworker.0 Request processed in 33us (448us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760727.166204:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465
00000100:00100000:0.0:1789760727.166271:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548746496
00000100:00100000:0.0:1789760727.166275:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548746496
00000100:00100000:0.0:1789760727.166305:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416
00000100:00100000:0.0:1789760727.166311:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548746496:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.166356:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548746496:12345-0@lo:400:kworker.0 Request processed in 46us (536us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.166362:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416
00000100:00100000:3.0:1789760727.166467:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548747008:0@lo:400:kworker.0
00000100:00100000:3.0:1789760727.166493:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760727.166610:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548747520:0@lo:400:kworker.0
00000100:00100000:3.0:1789760727.166632:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760727.166667:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b00aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548745984:0@lo:400:kworker.0
00000100:00100000:3.0:1789760727.166676:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548746496:0@lo:400:kworker.0
00000100:00080000:3.0:1789760727.166701:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1789760727.166706:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:3.0:1789760727.166709:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1789760727.166760:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548747008
00000100:00100000:0.0:1789760727.166764:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548747008
00000100:00100000:0.0:1789760727.166792:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548747520
00000100:00100000:0.0:1789760727.166795:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548747520
00000100:00100000:0.0:1789760727.166811:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276
00000100:00100000:0.0:1789760727.166816:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548747008:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.166864:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548747008:12345-0@lo:400:kworker.0 Request processed in 47us (369us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.166870:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276
00000100:00100000:0.0:1789760727.166881:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277
00000100:00100000:0.0:1789760727.166886:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548747520:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760727.166907:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548747520:12345-0@lo:400:kworker.0 Request processed in 22us (274us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760727.166913:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277
00000100:00100000:3.0:1789760727.167189:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548747008:0@lo:400:kworker.0
00000100:00100000:3.0:1789760727.167200:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548747520:0@lo:400:kworker.0
00002000:00010000:3.0:1789760727.170498:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20656128 -> 20660224
00010000:00010000:3.0:1789760727.170518:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.170532:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.170542:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.170550:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760727.170555:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.170563:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.170582:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.170590:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60bcc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20656128->20660223] (req 20656128->20660223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760727.170681:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520902144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35877us (36385us total) trans 4294972363 rc 0/0
00000100:00100000:3.0:1789760727.170691:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5076
00000100:00100000:3.0:1789760727.170701:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698780999251 time 698821471320 state 0x2 ref 0
00000001:00080000:1.0:1789760727.171664:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972363 is committed
00000100:00100000:1.0:1789760727.174792:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.177829:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520902272
00000100:00100000:3.0:1789760727.177843:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520902272
00000100:00100000:3.0:1789760727.178089:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698780999251 time 698821471320 state 0x0 ref 1
00000100:00100000:3.0:1789760727.178108:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698821731736 time 698821471320 state 0x1 ref 1
00000100:00100000:2.0:1789760727.178633:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698821731736 time 698865312325 state 0x0 ref 1
00000100:00100000:2.0:1789760727.178653:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520902272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760727.178775:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20660224, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:2.0:1789760727.178784:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.178799:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:2.0:1789760727.178803:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760727.178809:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.178822:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760727.210508:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20660224 -> 20664320
00010000:00010000:2.0:1789760727.210527:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.210541:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.210550:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.210557:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760727.210562:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.210572:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.210591:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.210599:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60bccd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20660224->20664319] (req 20660224->20664319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760727.210766:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520902272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32114us (35978us total) trans 4294972364 rc 0/0
00000100:00100000:2.0:1789760727.210777:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5077
00000100:00100000:2.0:1789760727.210786:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698821731736 time 698865312325 state 0x2 ref 0
00000001:00080000:3.0:1789760727.210865:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972364 is committed
00000100:00100000:2.0:1789760727.221213:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.221358:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520902400
00000100:00100000:3.0:1789760727.221367:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520902400
00000100:00100000:3.0:1789760727.221428:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698821731736 time 698865312325 state 0x0 ref 1
00000100:00100000:3.0:1789760727.221444:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698865572741 time 698865312325 state 0x1 ref 1
00000100:00100000:3.0:1789760727.221474:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698865572741 time 698908157191 state 0x0 ref 1
00000100:00100000:3.0:1789760727.221487:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520902400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760727.221532:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20664320, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:3.0:1789760727.221540:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.221556:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760727.221561:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760727.221568:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.221582:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760727.270772:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972365 is committed
00002000:00010000:1.0:1789760727.270949:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20664320 -> 20668416
00010000:00010000:1.0:1789760727.270966:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.270978:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.270987:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.270995:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760727.270999:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.271009:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.271032:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.271044:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bcd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20664320->20668415] (req 20664320->20668415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760727.271139:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520902400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49649us (49930us total) trans 4294972365 rc 0/0
00000100:00100000:1.0:1789760727.271149:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5078
00000100:00100000:1.0:1789760727.271158:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698865572741 time 698908157191 state 0x2 ref 0
00000100:00100000:1.0:1789760727.280809:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.280915:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520902528
00000100:00100000:3.0:1789760727.280926:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520902528
00000100:00100000:3.0:1789760727.280980:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698865572741 time 698908157191 state 0x0 ref 1
00000100:00100000:3.0:1789760727.280996:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698908417607 time 698908157191 state 0x1 ref 1
00000100:00100000:3.0:1789760727.281029:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698908417607 time 698967711248 state 0x0 ref 1
00000100:00100000:3.0:1789760727.281043:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520902528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760727.281091:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20668416, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:3.0:1789760727.281100:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.281116:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=698s v=(0 0)
00010000:00010000:3.0:1789760727.281121:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760727.281128:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.281141:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760727.326200:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972366 is committed
00002000:00010000:1.0:1789760727.326440:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20668416 -> 20672512
00010000:00010000:1.0:1789760727.326456:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.326468:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.326477:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.326484:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760727.326489:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.326498:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.326528:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.326538:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20668416->20672511] (req 20668416->20672511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760727.326626:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520902528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45582us (45822us total) trans 4294972366 rc 0/0
00000100:00100000:1.0:1789760727.326635:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5079
00000100:00100000:1.0:1789760727.326644:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698908417607 time 698967711248 state 0x2 ref 0
00000100:00100000:3.0:1789760727.331883:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760727.331957:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520902656
00000100:00100000:2.0:1789760727.331968:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520902656
00000100:00100000:2.0:1789760727.332031:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698908417607 time 698967711248 state 0x0 ref 1
00000100:00100000:2.0:1789760727.332048:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698967971664 time 698967711248 state 0x1 ref 1
00000100:00100000:2.0:1789760727.332078:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698967971664 time 699018760434 state 0x0 ref 1
00000100:00100000:2.0:1789760727.332091:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520902656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760727.332138:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20672512, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:2.0:1789760727.332147:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.332161:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:2.0:1789760727.332166:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760727.332172:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.332186:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760727.377140:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972367 is committed
00002000:00010000:3.0:1789760727.377232:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20672512 -> 20676608
00010000:00010000:3.0:1789760727.377246:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.377260:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.377270:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.377278:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760727.377283:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.377293:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.377365:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.377589:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bce2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20672512->20676607] (req 20672512->20676607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760727.377685:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520902656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45591us (45806us total) trans 4294972367 rc 0/0
00000100:00100000:3.0:1789760727.377696:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5080
00000100:00100000:3.0:1789760727.377706:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698967971664 time 699018760434 state 0x2 ref 0
00000100:00100000:2.0:1789760727.382965:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.383047:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520902784
00000100:00100000:3.0:1789760727.383057:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520902784
00000100:00100000:3.0:1789760727.383104:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 698967971664 time 699018760434 state 0x0 ref 1
00000100:00100000:3.0:1789760727.383119:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699019020850 time 699018760434 state 0x1 ref 1
00000100:00100000:3.0:1789760727.383149:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699019020850 time 699069831912 state 0x0 ref 1
00000100:00100000:3.0:1789760727.383160:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520902784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760727.383210:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20676608, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:3.0:1789760727.383219:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.383236:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:3.0:1789760727.383241:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760727.383248:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.383263:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760727.420390:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20676608 -> 20680704
00010000:00010000:3.0:1789760727.420410:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.420423:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.420433:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.420441:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760727.420446:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.420455:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.420474:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.420482:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bce9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20676608->20680703] (req 20676608->20680703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760727.420576:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520902784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37412us (37614us total) trans 4294972368 rc 0/0
00000100:00100000:3.0:1789760727.420586:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5081
00000100:00100000:3.0:1789760727.420596:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699019020850 time 699069831912 state 0x2 ref 0
00000001:00080000:0.0:1789760727.421240:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972368 is committed
00000100:00100000:1.0:1789760727.428976:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.429110:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520902912
00000100:00100000:3.0:1789760727.429119:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520902912
00000100:00100000:2.0:1789760727.429240:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699019020850 time 699069831912 state 0x0 ref 1
00000100:00100000:2.0:1789760727.429255:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699070092328 time 699069831912 state 0x1 ref 1
00000100:00100000:2.0:1789760727.429286:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699070092328 time 699115968224 state 0x0 ref 1
00000100:00100000:2.0:1789760727.429299:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520902912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760727.429378:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20680704, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:2.0:1789760727.429388:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.429407:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:2.0:1789760727.429412:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760727.429418:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.429438:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760727.470950:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972369 is committed
00002000:00010000:1.0:1789760727.471114:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20680704 -> 20684800
00010000:00010000:1.0:1789760727.471134:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.471148:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.471158:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.471165:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760727.471170:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.471183:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.471202:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.471210:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bcf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20680704->20684799] (req 20680704->20684799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760727.471295:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520902912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41994us (42324us total) trans 4294972369 rc 0/0
00000100:00100000:1.0:1789760727.471306:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5082
00000100:00100000:1.0:1789760727.471357:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699070092328 time 699115968224 state 0x2 ref 0
00000100:00100000:1.0:1789760727.480042:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760727.480274:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520903040
00000100:00100000:0.0:1789760727.480285:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520903040
00000100:00100000:0.0:1789760727.480616:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699070092328 time 699115968224 state 0x0 ref 1
00000100:00100000:0.0:1789760727.480632:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699116228640 time 699115968224 state 0x1 ref 1
00000100:00100000:0.0:1789760727.480705:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699116228640 time 699167387010 state 0x0 ref 1
00000100:00100000:0.0:1789760727.480719:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520903040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760727.480769:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20684800, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:0.0:1789760727.480778:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760727.480794:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:0.0:1789760727.480798:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760727.480805:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760727.480823:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760727.541517:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20684800 -> 20688896
00010000:00010000:0.0:1789760727.541536:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760727.541549:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760727.541558:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760727.541565:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760727.541570:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760727.541579:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760727.541599:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760727.541607:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bcf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20684800->20688895] (req 20684800->20688895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760727.541705:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520903040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60984us (61667us total) trans 4294972370 rc 0/0
00000100:00100000:0.0:1789760727.541715:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5083
00000100:00100000:0.0:1789760727.541725:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699116228640 time 699167387010 state 0x2 ref 0
00000001:00080000:1.0:1789760727.541833:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972370 is committed
00000100:00100000:2.0:1789760727.545227:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.545409:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520903168
00000100:00100000:3.0:1789760727.545426:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520903168
00000100:00100000:3.0:1789760727.545488:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699116228640 time 699167387010 state 0x0 ref 1
00000100:00100000:3.0:1789760727.545503:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699167647426 time 699167387010 state 0x1 ref 1
00000100:00100000:3.0:1789760727.545534:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699167647426 time 699232216376 state 0x0 ref 1
00000100:00100000:3.0:1789760727.545547:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520903168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760727.545593:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20688896, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:3.0:1789760727.545602:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.545618:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:3.0:1789760727.545623:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760727.545629:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.545643:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.610624:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:2.0:1789760727.611856:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20688896 -> 20692992
00010000:00010000:2.0:1789760727.611875:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.611898:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.611908:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.611916:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760727.611921:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.611930:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.611951:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.611965:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bcfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20688896->20692991] (req 20688896->20692991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760727.612067:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520903168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66518us (66845us total) trans 4294972371 rc 0/0
00000100:00100000:2.0:1789760727.612091:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5084
00000100:00100000:2.0:1789760727.612102:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699167647426 time 699232216376 state 0x2 ref 0
00000001:00080000:1.0:1789760727.613019:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972371 is committed
00000100:00100000:3.0:1789760727.622796:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760727.623055:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520903296
00000100:00100000:2.0:1789760727.623069:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520903296
00000100:00100000:2.0:1789760727.623149:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699167647426 time 699232216376 state 0x0 ref 1
00000100:00100000:2.0:1789760727.623167:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699232476792 time 699232216376 state 0x1 ref 1
00000100:00100000:2.0:1789760727.623203:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699232476792 time 699309884951 state 0x0 ref 1
00000100:00100000:2.0:1789760727.623216:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520903296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760727.623270:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20692992, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:2.0:1789760727.623279:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.623295:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:2.0:1789760727.623299:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760727.623305:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.623366:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760727.661245:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20692992 -> 20697088
00010000:00010000:2.0:1789760727.661267:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.661280:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.661300:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.661307:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760727.661340:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.661350:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.661370:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.661387:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60bd05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20692992->20697087] (req 20692992->20697087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760727.661474:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520903296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38256us (38683us total) trans 4294972372 rc 0/0
00000100:00100000:2.0:1789760727.661485:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5085
00000100:00100000:2.0:1789760727.661495:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699232476792 time 699309884951 state 0x2 ref 0
00000001:00080000:3.0:1789760727.661632:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972372 is committed
00000100:00100000:3.0:1789760727.667296:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760727.667667:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520903424
00000100:00100000:1.0:1789760727.667739:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520903424
00000100:00100000:1.0:1789760727.667794:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699232476792 time 699309884951 state 0x0 ref 1
00000100:00100000:1.0:1789760727.667809:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699310145367 time 699309884951 state 0x1 ref 1
00000100:00100000:1.0:1789760727.667838:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699310145367 time 699354521162 state 0x0 ref 1
00000100:00100000:1.0:1789760727.667861:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520903424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760727.667911:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20697088, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:1.0:1789760727.667920:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.667937:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:1.0:1789760727.667941:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760727.667947:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.667961:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760727.749389:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20697088 -> 20701184
00010000:00010000:3.0:1789760727.749410:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.749430:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.749440:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.749448:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760727.749453:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.749463:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.749482:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.749491:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20697088->20701183] (req 20697088->20701183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760727.752142:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520903424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 84271us (84856us total) trans 4294972373 rc 0/0
00000100:00100000:3.0:1789760727.752158:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5086
00000100:00100000:3.0:1789760727.752167:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699310145367 time 699354521162 state 0x2 ref 0
00000001:00080000:3.0:1789760727.752213:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972373 is committed
00000100:00100000:0.0:1789760727.765010:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760727.765121:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520903552
00000100:00100000:1.0:1789760727.765133:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520903552
00000100:00100000:1.0:1789760727.765194:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699310145367 time 699354521162 state 0x0 ref 1
00000100:00100000:1.0:1789760727.765212:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699354781578 time 699354521162 state 0x1 ref 1
00000100:00100000:1.0:1789760727.765247:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699354781578 time 699451929267 state 0x0 ref 1
00000100:00100000:1.0:1789760727.765261:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520903552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760727.765353:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20701184, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:1.0:1789760727.765363:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.765379:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:1.0:1789760727.765384:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760727.765391:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.765406:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760727.793535:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20701184 -> 20705280
00010000:00010000:2.0:1789760727.793556:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.793570:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.793579:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.793587:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760727.793591:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.793601:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.793620:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.793634:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bd13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20701184->20705279] (req 20701184->20705279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760727.793728:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520903552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28464us (28722us total) trans 4294972374 rc 0/0
00000100:00100000:2.0:1789760727.793740:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5087
00000100:00100000:2.0:1789760727.793750:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699354781578 time 699451929267 state 0x2 ref 0
00000001:00080000:3.0:1789760727.793896:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972374 is committed
00000100:00100000:2.0:1789760727.798671:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760727.798764:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520903680
00000100:00100000:3.0:1789760727.798774:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520903680
00000100:00100000:3.0:1789760727.798828:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699354781578 time 699451929267 state 0x0 ref 1
00000100:00100000:3.0:1789760727.798852:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699452189683 time 699451929267 state 0x1 ref 1
00000100:00100000:3.0:1789760727.798881:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699452189683 time 699485563516 state 0x0 ref 1
00000100:00100000:3.0:1789760727.798894:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520903680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760727.798941:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20705280, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:3.0:1789760727.798950:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.798966:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:3.0:1789760727.798971:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760727.798977:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.798991:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760727.839609:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972375 is committed
00002000:00010000:2.0:1789760727.840131:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20705280 -> 20709376
00010000:00010000:2.0:1789760727.840148:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.840161:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.840170:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.840178:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760727.840183:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.840192:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.840216:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.840565:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bd1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20705280->20709375] (req 20705280->20709375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760727.840701:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520903680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41804us (42036us total) trans 4294972375 rc 0/0
00000100:00100000:2.0:1789760727.840712:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5088
00000100:00100000:2.0:1789760727.840721:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699452189683 time 699485563516 state 0x2 ref 0
00000100:00100000:1.0:1789760727.844103:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760727.844561:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520903808
00000100:00100000:2.0:1789760727.844574:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520903808
00000100:00100000:2.0:1789760727.844659:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699452189683 time 699485563516 state 0x0 ref 1
00000100:00100000:2.0:1789760727.844678:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699485823932 time 699485563516 state 0x1 ref 1
00000100:00100000:2.0:1789760727.844834:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699485823932 time 699531514537 state 0x0 ref 1
00000100:00100000:2.0:1789760727.844860:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520903808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760727.844992:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20709376, mtime: 0x6aad94d8, atime: 0x0, ctime: 0x6aad94d8, blocks: 0xa007
00010000:00010000:2.0:1789760727.845007:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.845028:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:2.0:1789760727.845035:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760727.845043:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.845061:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760727.894614:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972376 is committed
00002000:00010000:3.0:1789760727.894884:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20709376 -> 20713472
00002000:00010000:3.0:1789760727.894890:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760728 -> 1789760729
00002000:00010000:3.0:1789760727.894893:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760728 -> 1789760729
00010000:00010000:3.0:1789760727.894914:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.894937:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.894948:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.894960:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760727.894967:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.894978:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.895006:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760727.895015:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20709376->20713471] (req 20709376->20713471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760727.895218:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520903808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50294us (51063us total) trans 4294972376 rc 0/0
00000100:00100000:3.0:1789760727.895231:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5089
00000100:00100000:3.0:1789760727.895245:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699485823932 time 699531514537 state 0x2 ref 0
00000100:00100000:0.0:1789760727.899693:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760727.900410:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520903936
00000100:00100000:1.0:1789760727.900426:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520903936
00000100:00100000:1.0:1789760727.900509:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699485823932 time 699531514537 state 0x0 ref 1
00000100:00100000:1.0:1789760727.900530:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699531774953 time 699531514537 state 0x1 ref 1
00000100:00100000:1.0:1789760727.900666:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699531774953 time 699587347430 state 0x0 ref 1
00000100:00100000:1.0:1789760727.900684:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520903936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760727.900750:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20713472, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:1.0:1789760727.900759:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.900784:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:1.0:1789760727.900789:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760727.900795:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.900807:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760727.966137:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20713472 -> 20717568
00010000:00010000:2.0:1789760727.966158:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.966172:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.966181:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.966188:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760727.966193:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.966202:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.966224:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760727.966232:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bd28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20713472->20717567] (req 20713472->20717567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760727.966707:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520903936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66020us (67026us total) trans 4294972377 rc 0/0
00000100:00100000:2.0:1789760727.966727:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5090
00000100:00100000:2.0:1789760727.966738:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699531774953 time 699587347430 state 0x2 ref 0
00000001:00080000:0.0:1789760727.967134:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972377 is committed
00000100:00100000:2.0:1789760727.970041:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760727.970193:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520904064
00000100:00100000:1.0:1789760727.970203:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520904064
00000100:00100000:1.0:1789760727.970261:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699531774953 time 699587347430 state 0x0 ref 1
00000100:00100000:1.0:1789760727.970277:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699587607846 time 699587347430 state 0x1 ref 1
00000100:00100000:1.0:1789760727.970355:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699587607846 time 699657036199 state 0x0 ref 1
00000100:00100000:1.0:1789760727.970370:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520904064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760727.970418:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20717568, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:1.0:1789760727.970428:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.970444:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:1.0:1789760727.970449:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760727.970456:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760727.970471:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760728.018233:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972378 is committed
00002000:00010000:0.0:1789760728.018510:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20717568 -> 20721664
00010000:00010000:0.0:1789760728.018526:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.018540:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.018550:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.018557:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760728.018636:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.018646:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.018666:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.018673:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bd2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20717568->20721663] (req 20717568->20721663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760728.018929:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520904064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48557us (48893us total) trans 4294972378 rc 0/0
00000100:00100000:0.0:1789760728.018941:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5091
00000100:00100000:0.0:1789760728.018951:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699587607846 time 699657036199 state 0x2 ref 0
00000100:00100000:3.0:1789760728.024033:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760728.024120:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520904192
00000100:00100000:2.0:1789760728.024134:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520904192
00000100:00100000:2.0:1789760728.024212:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699587607846 time 699657036199 state 0x0 ref 1
00000100:00100000:2.0:1789760728.024228:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699657296615 time 699657036199 state 0x1 ref 1
00000100:00100000:2.0:1789760728.024262:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699657296615 time 699710944385 state 0x0 ref 1
00000100:00100000:2.0:1789760728.024278:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520904192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760728.024363:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20721664, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:2.0:1789760728.024371:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.024388:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:2.0:1789760728.024392:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760728.024399:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.024413:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760728.024689:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760728.094471:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972379 is committed
00002000:00010000:2.0:1789760728.094710:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20721664 -> 20725760
00010000:00010000:2.0:1789760728.094727:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.094739:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.094748:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.094756:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760728.094760:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.094768:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.096178:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.096189:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20721664->20725759] (req 20721664->20725759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760728.096399:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520904192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 72121us (72375us total) trans 4294972379 rc 0/0
00000100:00100000:2.0:1789760728.096415:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5092
00000100:00100000:2.0:1789760728.096425:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699657296615 time 699710944385 state 0x2 ref 0
00000100:00100000:2.0:1789760728.100116:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760728.100721:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520904320
00000100:00100000:3.0:1789760728.100731:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520904320
00000100:00100000:3.0:1789760728.100967:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699657296615 time 699710944385 state 0x0 ref 1
00000100:00100000:3.0:1789760728.101043:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699711204801 time 699710944385 state 0x1 ref 1
00000100:00100000:3.0:1789760728.101115:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699711204801 time 699787796371 state 0x0 ref 1
00000100:00100000:3.0:1789760728.101129:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520904320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760728.101178:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20725760, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:3.0:1789760728.101188:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.101204:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:3.0:1789760728.101209:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760728.101216:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.101230:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760728.126135:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972380 is committed
00002000:00010000:3.0:1789760728.126355:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20725760 -> 20729856
00010000:00010000:3.0:1789760728.126371:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.126390:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.126398:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.126406:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760728.126596:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.126609:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.126630:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.126638:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20725760->20729855] (req 20725760->20729855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760728.126786:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520904320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25656us (26680us total) trans 4294972380 rc 0/0
00000100:00100000:3.0:1789760728.126798:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5093
00000100:00100000:3.0:1789760728.126807:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699711204801 time 699787796371 state 0x2 ref 0
00000100:00100000:3.0:1789760728.130150:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760728.130706:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520904448
00000100:00100000:0.0:1789760728.130716:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520904448
00000100:00100000:0.0:1789760728.130774:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699711204801 time 699787796371 state 0x0 ref 1
00000100:00100000:0.0:1789760728.130801:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699788056787 time 699787796371 state 0x1 ref 1
00000100:00100000:0.0:1789760728.130833:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699788056787 time 699817514964 state 0x0 ref 1
00000100:00100000:0.0:1789760728.130855:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520904448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760728.130904:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20729856, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:0.0:1789760728.130914:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.130929:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:0.0:1789760728.130934:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760728.130941:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.130955:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760728.165445:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972381 is committed
00002000:00010000:2.0:1789760728.165735:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20729856 -> 20733952
00010000:00010000:2.0:1789760728.165750:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.165762:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.165770:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.165777:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760728.165781:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.165789:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.165885:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.165892:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bd44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20729856->20733951] (req 20729856->20733951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760728.166021:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520904448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35164us (35875us total) trans 4294972381 rc 0/0
00000100:00100000:2.0:1789760728.166032:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5094
00000100:00100000:2.0:1789760728.166041:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699788056787 time 699817514964 state 0x2 ref 0
00000100:00100000:1.0:1789760728.178763:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760728.178870:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520904576
00000100:00100000:0.0:1789760728.178879:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520904576
00000100:00100000:0.0:1789760728.178935:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699788056787 time 699817514964 state 0x0 ref 1
00000100:00100000:0.0:1789760728.178950:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699817775380 time 699817514964 state 0x1 ref 1
00000100:00100000:0.0:1789760728.178977:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699817775380 time 699865659721 state 0x0 ref 1
00000100:00100000:0.0:1789760728.178988:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520904576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760728.179035:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20733952, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:0.0:1789760728.179044:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.179060:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:0.0:1789760728.179065:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760728.179071:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.179084:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760728.216401:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972382 is committed
00002000:00010000:1.0:1789760728.216596:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20733952 -> 20738048
00010000:00010000:1.0:1789760728.216611:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.216623:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.216633:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.216640:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760728.216644:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.216654:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.216673:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.216681:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20733952->20738047] (req 20733952->20738047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760728.216807:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520904576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37815us (38048us total) trans 4294972382 rc 0/0
00000100:00100000:1.0:1789760728.216817:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5095
00000100:00100000:1.0:1789760728.216826:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699817775380 time 699865659721 state 0x2 ref 0
00000100:00100000:0.0:1789760728.223396:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760728.224063:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520904704
00000100:00100000:2.0:1789760728.224074:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520904704
00000100:00100000:2.0:1789760728.224132:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699817775380 time 699865659721 state 0x0 ref 1
00000100:00100000:2.0:1789760728.224147:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699865920137 time 699865659721 state 0x1 ref 1
00000100:00100000:2.0:1789760728.224179:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699865920137 time 699910861750 state 0x0 ref 1
00000100:00100000:2.0:1789760728.224192:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520904704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760728.224240:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20738048, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:2.0:1789760728.224249:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.224266:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:2.0:1789760728.224270:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760728.224277:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.224290:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760728.283148:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972383 is committed
00002000:00010000:2.0:1789760728.283261:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20738048 -> 20742144
00010000:00010000:2.0:1789760728.283279:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.283290:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.283299:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.283306:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760728.283310:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.283359:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.283385:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.283394:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60bd52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20738048->20742143] (req 20738048->20742143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760728.283486:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520904704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59290us (60094us total) trans 4294972383 rc 0/0
00000100:00100000:2.0:1789760728.283500:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5096
00000100:00100000:2.0:1789760728.283511:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699865920137 time 699910861750 state 0x2 ref 0
00000100:00100000:2.0:1789760728.287232:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760728.287356:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520904832
00000100:00100000:3.0:1789760728.287366:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520904832
00000100:00100000:3.0:1789760728.287428:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699865920137 time 699910861750 state 0x0 ref 1
00000100:00100000:3.0:1789760728.287443:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699911122166 time 699910861750 state 0x1 ref 1
00000100:00100000:3.0:1789760728.287484:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699911122166 time 699974166092 state 0x0 ref 1
00000100:00100000:3.0:1789760728.287499:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520904832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760728.287547:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20742144, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:3.0:1789760728.287557:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.287574:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=699s v=(0 0)
00010000:00010000:3.0:1789760728.287578:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760728.287585:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.287600:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760728.353382:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972384 is committed
00002000:00010000:2.0:1789760728.353959:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20742144 -> 20746240
00010000:00010000:2.0:1789760728.353976:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.353989:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.353998:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.354005:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760728.354010:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.354019:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.354041:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.354049:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bd59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20742144->20746239] (req 20742144->20746239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760728.354151:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520904832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66649us (66923us total) trans 4294972384 rc 0/0
00000100:00100000:2.0:1789760728.354161:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5097
00000100:00100000:2.0:1789760728.354171:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699911122166 time 699974166092 state 0x2 ref 0
00000100:00100000:3.0:1789760728.360037:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760728.360128:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520904960
00000100:00100000:1.0:1789760728.360139:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520904960
00000100:00100000:1.0:1789760728.360192:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699911122166 time 699974166092 state 0x0 ref 1
00000100:00100000:1.0:1789760728.360208:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699974426508 time 699974166092 state 0x1 ref 1
00000100:00100000:1.0:1789760728.360240:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699974426508 time 700046922637 state 0x0 ref 1
00000100:00100000:1.0:1789760728.360252:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520904960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760728.360307:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20746240, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:1.0:1789760728.360348:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.360365:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:1.0:1789760728.360370:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760728.360376:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.360390:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760728.412624:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972385 is committed
00002000:00010000:3.0:1789760728.412868:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20746240 -> 20750336
00010000:00010000:3.0:1789760728.412883:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.412896:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.412906:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.412913:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760728.412918:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.412926:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.412945:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.412954:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60bd60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20746240->20750335] (req 20746240->20750335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760728.413082:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520904960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52826us (53050us total) trans 4294972385 rc 0/0
00000100:00100000:3.0:1789760728.413094:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5098
00000100:00100000:3.0:1789760728.413104:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699974426508 time 700046922637 state 0x2 ref 0
00000100:00100000:0.0:1789760728.424529:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760728.424623:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520905088
00000100:00100000:1.0:1789760728.424633:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520905088
00000100:00100000:1.0:1789760728.424685:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 699974426508 time 700046922637 state 0x0 ref 1
00000100:00100000:1.0:1789760728.424701:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700047183053 time 700046922637 state 0x1 ref 1
00000100:00100000:1.0:1789760728.424736:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700047183053 time 700111418394 state 0x0 ref 1
00000100:00100000:1.0:1789760728.424749:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520905088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760728.424797:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20750336, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:1.0:1789760728.424807:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.424822:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:1.0:1789760728.424827:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760728.424833:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.424858:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760728.468642:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972386 is committed
00002000:00010000:1.0:1789760728.468709:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20750336 -> 20754432
00010000:00010000:1.0:1789760728.468724:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.468737:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.468747:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.468762:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760728.468767:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.468776:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.468908:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.468918:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bd67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20750336->20754431] (req 20750336->20754431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760728.469045:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520905088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44292us (44520us total) trans 4294972386 rc 0/0
00000100:00100000:1.0:1789760728.469056:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5099
00000100:00100000:1.0:1789760728.469066:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700047183053 time 700111418394 state 0x2 ref 0
00000100:00100000:2.0:1789760728.472865:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760728.472939:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520905216
00000100:00100000:0.0:1789760728.472949:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520905216
00000100:00100000:0.0:1789760728.473000:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700047183053 time 700111418394 state 0x0 ref 1
00000100:00100000:0.0:1789760728.473014:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700111678810 time 700111418394 state 0x1 ref 1
00000100:00100000:0.0:1789760728.473044:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700111678810 time 700159726784 state 0x0 ref 1
00000100:00100000:0.0:1789760728.473056:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520905216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760728.473104:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20754432, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:0.0:1789760728.473113:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.473128:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:0.0:1789760728.473132:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760728.473138:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.473151:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760728.508211:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20754432 -> 20758528
00010000:00010000:0.0:1789760728.508233:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.508247:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.508257:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.508265:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760728.508270:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.508279:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.508298:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.508306:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bd6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20754432->20758527] (req 20754432->20758527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760728.508425:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520905216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35365us (35562us total) trans 4294972387 rc 0/0
00000100:00100000:0.0:1789760728.508435:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5100
00000100:00100000:0.0:1789760728.508445:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700111678810 time 700159726784 state 0x2 ref 0
00000001:00080000:3.0:1789760728.508866:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972387 is committed
00000100:00100000:3.0:1789760728.512058:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760728.512131:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520905344
00000100:00100000:0.0:1789760728.512141:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520905344
00000100:00100000:0.0:1789760728.512191:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700111678810 time 700159726784 state 0x0 ref 1
00000100:00100000:0.0:1789760728.512205:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700159987200 time 700159726784 state 0x1 ref 1
00000100:00100000:0.0:1789760728.512232:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700159987200 time 700198914765 state 0x0 ref 1
00000100:00100000:0.0:1789760728.512242:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520905344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760728.512287:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20758528, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:0.0:1789760728.512296:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.512311:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:0.0:1789760728.512349:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760728.512356:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.512374:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760728.559125:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972388 is committed
00002000:00010000:3.0:1789760728.560497:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20758528 -> 20762624
00010000:00010000:3.0:1789760728.560516:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.560529:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.560539:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.560546:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760728.560550:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.560559:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.560578:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.560586:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bd75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20758528->20762623] (req 20758528->20762623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760728.560685:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520905344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48438us (48631us total) trans 4294972388 rc 0/0
00000100:00100000:3.0:1789760728.560696:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5101
00000100:00100000:3.0:1789760728.560706:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700159987200 time 700198914765 state 0x2 ref 0
00000100:00100000:1.0:1789760728.571463:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760728.573693:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520905472
00000100:00100000:3.0:1789760728.573710:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520905472
00000100:00100000:3.0:1789760728.573774:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700159987200 time 700198914765 state 0x0 ref 1
00000100:00100000:3.0:1789760728.573790:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700199175181 time 700198914765 state 0x1 ref 1
00000100:00100000:3.0:1789760728.573811:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700199175181 time 700260494371 state 0x0 ref 1
00000100:00100000:3.0:1789760728.573823:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520905472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760728.573885:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20762624, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:3.0:1789760728.573894:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.573981:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:3.0:1789760728.573985:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760728.573992:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.574007:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760728.617664:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972389 is committed
00002000:00010000:2.0:1789760728.617916:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20762624 -> 20766720
00010000:00010000:2.0:1789760728.617933:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.617944:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.617953:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.617961:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760728.617965:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.617974:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.617993:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.618007:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bd7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20762624->20766719] (req 20762624->20766719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760728.618101:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520905472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44275us (46644us total) trans 4294972389 rc 0/0
00000100:00100000:2.0:1789760728.618111:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5102
00000100:00100000:2.0:1789760728.618121:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700199175181 time 700260494371 state 0x2 ref 0
00000100:00100000:2.0:1789760728.621478:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760728.621650:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520905600
00000100:00100000:1.0:1789760728.621660:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520905600
00000100:00100000:1.0:1789760728.621708:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700199175181 time 700260494371 state 0x0 ref 1
00000100:00100000:1.0:1789760728.621720:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700260754787 time 700260494371 state 0x1 ref 1
00000100:00100000:1.0:1789760728.621745:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700260754787 time 700308429401 state 0x0 ref 1
00000100:00100000:1.0:1789760728.621754:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520905600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760728.621795:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20766720, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:1.0:1789760728.621805:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.621829:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:1.0:1789760728.621842:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760728.621851:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.621865:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.633619:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760728.654915:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972390 is committed
00002000:00010000:1.0:1789760728.655117:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20766720 -> 20770816
00010000:00010000:1.0:1789760728.655132:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.655145:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.655154:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.655162:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760728.655167:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.655177:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.655196:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.655204:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bd83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20766720->20770815] (req 20766720->20770815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760728.655299:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520905600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33540us (33824us total) trans 4294972390 rc 0/0
00000100:00100000:1.0:1789760728.655310:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5103
00000100:00100000:1.0:1789760728.655355:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700260754787 time 700308429401 state 0x2 ref 0
00000100:00100000:0.0:1789760728.664998:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760728.665159:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520905728
00000100:00100000:2.0:1789760728.665178:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520905728
00000100:00100000:2.0:1789760728.665234:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700260754787 time 700308429401 state 0x0 ref 1
00000100:00100000:2.0:1789760728.665250:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700308689817 time 700308429401 state 0x1 ref 1
00000100:00100000:2.0:1789760728.665283:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700308689817 time 700351965806 state 0x0 ref 1
00000100:00100000:2.0:1789760728.665295:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520905728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760728.665378:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20770816, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:2.0:1789760728.665388:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.665403:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:2.0:1789760728.665408:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760728.665414:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.665428:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760728.695947:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972391 is committed
00002000:00010000:2.0:1789760728.696094:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20770816 -> 20774912
00010000:00010000:2.0:1789760728.696109:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.696122:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.696131:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.696310:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760728.696430:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.696442:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.696461:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.696470:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20770816->20774911] (req 20770816->20774911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760728.696600:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520905728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31302us (31607us total) trans 4294972391 rc 0/0
00000100:00100000:2.0:1789760728.696611:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5104
00000100:00100000:2.0:1789760728.696621:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700308689817 time 700351965806 state 0x2 ref 0
00000100:00100000:1.0:1789760728.706637:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760728.706730:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520905856
00000100:00100000:3.0:1789760728.706742:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520905856
00000100:00100000:3.0:1789760728.706797:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700308689817 time 700351965806 state 0x0 ref 1
00000100:00100000:3.0:1789760728.706812:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700352226222 time 700351965806 state 0x1 ref 1
00000100:00100000:3.0:1789760728.706849:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700352226222 time 700393532257 state 0x0 ref 1
00000100:00100000:3.0:1789760728.706862:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520905856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760728.706910:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20774912, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:3.0:1789760728.706919:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.706933:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:3.0:1789760728.706938:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760728.706944:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.706958:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760728.738747:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972392 is committed
00002000:00010000:3.0:1789760728.738918:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20774912 -> 20779008
00010000:00010000:3.0:1789760728.738936:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.738949:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.738959:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.738966:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760728.738972:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.738981:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.739001:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.739009:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60bd91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20774912->20779007] (req 20774912->20779007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760728.739104:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520905856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32239us (32471us total) trans 4294972392 rc 0/0
00000100:00100000:3.0:1789760728.739115:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5105
00000100:00100000:3.0:1789760728.739124:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700352226222 time 700393532257 state 0x2 ref 0
00000100:00100000:0.0:1789760728.744782:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760728.744866:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520905984
00000100:00100000:2.0:1789760728.744876:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520905984
00000100:00100000:2.0:1789760728.744929:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700352226222 time 700393532257 state 0x0 ref 1
00000100:00100000:2.0:1789760728.744943:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700393792673 time 700393532257 state 0x1 ref 1
00000100:00100000:2.0:1789760728.744970:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700393792673 time 700431653258 state 0x0 ref 1
00000100:00100000:2.0:1789760728.744984:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520905984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760728.745032:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20779008, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:2.0:1789760728.745042:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.745058:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:2.0:1789760728.745062:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760728.745068:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760728.745083:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760728.781133:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972393 is committed
00002000:00010000:0.0:1789760728.781232:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20779008 -> 20783104
00010000:00010000:0.0:1789760728.781249:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.781264:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.781274:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.781281:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760728.781286:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.781294:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.781333:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.781342:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bd98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20779008->20783103] (req 20779008->20783103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760728.781444:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520905984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36457us (36665us total) trans 4294972393 rc 0/0
00000100:00100000:0.0:1789760728.781455:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5106
00000100:00100000:0.0:1789760728.781465:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700393792673 time 700431653258 state 0x2 ref 0
00000100:00100000:3.0:1789760728.785135:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760728.785284:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520906112
00000100:00100000:1.0:1789760728.785295:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520906112
00000100:00100000:1.0:1789760728.785391:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700393792673 time 700431653258 state 0x0 ref 1
00000100:00100000:1.0:1789760728.785406:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700431913674 time 700431653258 state 0x1 ref 1
00000100:00100000:1.0:1789760728.785430:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700431913674 time 700472112679 state 0x0 ref 1
00000100:00100000:1.0:1789760728.785446:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520906112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760728.785503:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20783104, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:1.0:1789760728.785512:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.785526:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:1.0:1789760728.785531:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760728.785536:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.785549:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760728.825260:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20783104 -> 20787200
00010000:00010000:1.0:1789760728.825281:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.825294:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.825304:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.825345:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760728.825351:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760728.825571:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972394 is committed
00010000:00010000:1.0:1789760728.825614:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.825639:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760728.825647:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bd9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20783104->20787199] (req 20783104->20787199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760728.825783:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520906112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40335us (40654us total) trans 4294972394 rc 0/0
00000100:00100000:1.0:1789760728.825795:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5107
00000100:00100000:1.0:1789760728.825804:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700431913674 time 700472112679 state 0x2 ref 0
00000100:00100000:1.0:1789760728.835606:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760728.839661:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520906240
00000100:00100000:0.0:1789760728.839677:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520906240
00000100:00100000:0.0:1789760728.839740:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700431913674 time 700472112679 state 0x0 ref 1
00000100:00100000:0.0:1789760728.839757:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700472373095 time 700472112679 state 0x1 ref 1
00000100:00100000:0.0:1789760728.839893:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700472373095 time 700526573229 state 0x0 ref 1
00000100:00100000:0.0:1789760728.839908:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520906240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760728.839957:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20787200, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:0.0:1789760728.839966:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.839981:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:0.0:1789760728.839985:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760728.839993:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.840066:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760728.894673:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972395 is committed
00002000:00010000:0.0:1789760728.894750:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20787200 -> 20791296
00010000:00010000:0.0:1789760728.894766:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.894778:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.894793:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.894801:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760728.894807:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.894815:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.894846:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.894854:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60bda6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20787200->20791295] (req 20787200->20791295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760728.894952:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520906240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55043us (59351us total) trans 4294972395 rc 0/0
00000100:00100000:0.0:1789760728.894963:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5108
00000100:00100000:0.0:1789760728.894972:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700472373095 time 700526573229 state 0x2 ref 0
00000100:00100000:0.0:1789760728.900195:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760728.900552:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520906368
00000100:00100000:3.0:1789760728.900574:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520906368
00000100:00100000:3.0:1789760728.900641:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700472373095 time 700526573229 state 0x0 ref 1
00000100:00100000:3.0:1789760728.900658:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700526833645 time 700526573229 state 0x1 ref 1
00000100:00100000:3.0:1789760728.900689:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700526833645 time 700587371527 state 0x0 ref 1
00000100:00100000:3.0:1789760728.900701:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520906368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760728.900750:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20791296, mtime: 0x6aad94d9, atime: 0x0, ctime: 0x6aad94d9, blocks: 0xa007
00010000:00010000:3.0:1789760728.900760:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.900776:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:3.0:1789760728.900780:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760728.900787:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.900801:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760728.956887:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972396 is committed
00002000:00010000:3.0:1789760728.957032:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20791296 -> 20795392
00002000:00010000:3.0:1789760728.957038:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760729 -> 1789760730
00002000:00010000:3.0:1789760728.957041:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760729 -> 1789760730
00010000:00010000:3.0:1789760728.957055:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.957082:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.957091:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.957099:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760728.957103:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.957114:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.957134:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760728.957142:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20791296->20795391] (req 20791296->20795391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760728.957236:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520906368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56532us (57044us total) trans 4294972396 rc 0/0
00000100:00100000:3.0:1789760728.957247:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5109
00000100:00100000:3.0:1789760728.957257:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700526833645 time 700587371527 state 0x2 ref 0
00000100:00100000:2.0:1789760728.967481:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760728.967656:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520906496
00000100:00100000:0.0:1789760728.967668:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520906496
00000100:00100000:0.0:1789760728.967728:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700526833645 time 700587371527 state 0x0 ref 1
00000100:00100000:0.0:1789760728.967743:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700587631943 time 700587371527 state 0x1 ref 1
00000100:00100000:0.0:1789760728.967775:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700587631943 time 700654457035 state 0x0 ref 1
00000100:00100000:0.0:1789760728.967788:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520906496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760728.967849:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20795392, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:0.0:1789760728.967859:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.967874:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:0.0:1789760728.967879:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760728.967885:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760728.967898:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760729.041840:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972397 is committed
00002000:00010000:1.0:1789760729.042082:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20795392 -> 20799488
00010000:00010000:1.0:1789760729.042097:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.042109:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.042117:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.042128:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.042133:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.042142:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.042161:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.042169:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60bdb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20795392->20799487] (req 20795392->20799487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760729.043116:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520906496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 75322us (75637us total) trans 4294972397 rc 0/0
00000100:00100000:1.0:1789760729.043128:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5110
00000100:00100000:1.0:1789760729.043145:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700587631943 time 700654457035 state 0x2 ref 0
00000100:00100000:2.0:1789760729.050205:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760729.050441:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520906624
00000100:00100000:1.0:1789760729.050453:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520906624
00000100:00100000:1.0:1789760729.050511:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700587631943 time 700654457035 state 0x0 ref 1
00000100:00100000:1.0:1789760729.050527:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700654717451 time 700654457035 state 0x1 ref 1
00000100:00100000:1.0:1789760729.050672:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700654717451 time 700737352669 state 0x0 ref 1
00000100:00100000:1.0:1789760729.050690:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520906624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760729.050873:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20799488, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:1.0:1789760729.050883:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.050899:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:1.0:1789760729.050903:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760729.050909:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.050922:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760729.091689:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972398 is committed
00002000:00010000:1.0:1789760729.091783:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20799488 -> 20803584
00010000:00010000:1.0:1789760729.091799:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.091812:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.091821:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.091829:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.091844:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.091853:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.091872:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.091879:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bdbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20799488->20803583] (req 20799488->20803583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760729.092025:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520906624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41332us (41823us total) trans 4294972398 rc 0/0
00000100:00100000:1.0:1789760729.092037:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5111
00000100:00100000:1.0:1789760729.092048:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700654717451 time 700737352669 state 0x2 ref 0
00000100:00100000:1.0:1789760729.100799:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760729.100975:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520906752
00000100:00100000:2.0:1789760729.100986:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520906752
00000100:00100000:2.0:1789760729.101041:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700654717451 time 700737352669 state 0x0 ref 1
00000100:00100000:2.0:1789760729.101055:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700737613085 time 700737352669 state 0x1 ref 1
00000100:00100000:2.0:1789760729.101088:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700737613085 time 700787770584 state 0x0 ref 1
00000100:00100000:2.0:1789760729.101100:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520906752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760729.101150:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20803584, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:2.0:1789760729.101158:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.101172:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:2.0:1789760729.101177:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760729.101184:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.101198:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760729.165258:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972399 is committed
00002000:00010000:0.0:1789760729.168268:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20803584 -> 20807680
00010000:00010000:0.0:1789760729.168291:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.168304:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.168349:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.168367:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760729.168372:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.168381:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.168409:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.168417:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bdc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20803584->20807679] (req 20803584->20807679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760729.168542:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520906752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67438us (67747us total) trans 4294972399 rc 0/0
00000100:00100000:0.0:1789760729.168553:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5112
00000100:00100000:0.0:1789760729.168563:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700737613085 time 700787770584 state 0x2 ref 0
00000100:00100000:2.0:1789760729.179602:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760729.179675:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520906880
00000100:00100000:3.0:1789760729.179686:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520906880
00000100:00100000:3.0:1789760729.179740:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700737613085 time 700787770584 state 0x0 ref 1
00000100:00100000:3.0:1789760729.179754:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700788031000 time 700787770584 state 0x1 ref 1
00000100:00100000:3.0:1789760729.179918:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700788031000 time 700866598753 state 0x0 ref 1
00000100:00100000:3.0:1789760729.179931:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520906880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760729.179986:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20807680, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:3.0:1789760729.179996:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.180010:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:3.0:1789760729.180014:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760729.180021:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.180035:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760729.230475:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972400 is committed
00002000:00010000:0.0:1789760729.230851:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20807680 -> 20811776
00010000:00010000:0.0:1789760729.230868:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.230888:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.230896:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.230903:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760729.230908:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.230917:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.230935:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.230942:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bdc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20807680->20811775] (req 20807680->20811775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760729.231045:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520906880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51111us (51447us total) trans 4294972400 rc 0/0
00000100:00100000:0.0:1789760729.231056:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5113
00000100:00100000:0.0:1789760729.231743:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700788031000 time 700866598753 state 0x2 ref 0
00000100:00100000:2.0:1789760729.238004:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760729.238174:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520907008
00000100:00100000:1.0:1789760729.238189:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520907008
00000100:00100000:1.0:1789760729.238243:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700788031000 time 700866598753 state 0x0 ref 1
00000100:00100000:1.0:1789760729.238258:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700866859169 time 700866598753 state 0x1 ref 1
00000100:00100000:1.0:1789760729.238290:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700866859169 time 700924972478 state 0x0 ref 1
00000100:00100000:1.0:1789760729.238301:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520907008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760729.238531:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20811776, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:1.0:1789760729.238541:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.238558:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:1.0:1789760729.238563:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760729.238569:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.238583:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760729.292664:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972401 is committed
00002000:00010000:1.0:1789760729.292841:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20811776 -> 20815872
00010000:00010000:1.0:1789760729.292856:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.292870:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.292878:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.292884:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.292889:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.292898:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.292917:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.292925:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20811776->20815871] (req 20811776->20815871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760729.293018:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520907008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54714us (55019us total) trans 4294972401 rc 0/0
00000100:00100000:1.0:1789760729.293029:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5114
00000100:00100000:1.0:1789760729.293038:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700866859169 time 700924972478 state 0x2 ref 0
00000100:00100000:1.0:1789760729.296439:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760729.296555:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520907136
00000100:00100000:2.0:1789760729.296630:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520907136
00000100:00100000:2.0:1789760729.296687:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700866859169 time 700924972478 state 0x0 ref 1
00000100:00100000:2.0:1789760729.296702:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700925232894 time 700924972478 state 0x1 ref 1
00000100:00100000:2.0:1789760729.296795:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700925232894 time 700983476945 state 0x0 ref 1
00000100:00100000:2.0:1789760729.296809:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520907136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760729.296871:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20815872, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:2.0:1789760729.296880:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.296895:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=700s v=(0 0)
00010000:00010000:2.0:1789760729.296900:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760729.296906:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.296919:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760729.326280:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972402 is committed
00002000:00010000:1.0:1789760729.326389:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20815872 -> 20819968
00010000:00010000:1.0:1789760729.326404:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.326417:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.326426:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.326433:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.326437:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.326452:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.326473:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.326480:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20815872->20819967] (req 20815872->20819967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760729.326579:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520907136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29767us (30144us total) trans 4294972402 rc 0/0
00000100:00100000:1.0:1789760729.326590:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5115
00000100:00100000:1.0:1789760729.326599:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700925232894 time 700983476945 state 0x2 ref 0
00000100:00100000:2.0:1789760729.331903:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760729.333729:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520907264
00000100:00100000:0.0:1789760729.333743:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520907264
00000100:00100000:1.0:1789760729.334021:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700925232894 time 700983476945 state 0x0 ref 1
00000100:00100000:1.0:1789760729.334038:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700983737361 time 700983476945 state 0x1 ref 1
00000100:00100000:1.0:1789760729.334076:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700983737361 time 701020758661 state 0x0 ref 1
00000100:00100000:1.0:1789760729.334089:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520907264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760729.334138:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20819968, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:1.0:1789760729.334147:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.334169:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:1.0:1789760729.334174:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760729.334181:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.334194:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760729.379224:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972403 is committed
00002000:00010000:1.0:1789760729.379309:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20819968 -> 20824064
00010000:00010000:1.0:1789760729.379448:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.379533:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.379544:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.379552:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.379557:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.379640:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.379659:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.379667:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60bdde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20819968->20824063] (req 20819968->20824063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760729.380235:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520907264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46141us (48334us total) trans 4294972403 rc 0/0
00000100:00100000:0.0:1789760729.380248:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5116
00000100:00100000:0.0:1789760729.380258:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700983737361 time 701020758661 state 0x2 ref 0
00000100:00100000:1.0:1789760729.383381:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760729.383534:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520907392
00000100:00100000:0.0:1789760729.383545:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520907392
00000100:00100000:0.0:1789760729.383680:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 700983737361 time 701020758661 state 0x0 ref 1
00000100:00100000:0.0:1789760729.383695:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701021019077 time 701020758661 state 0x1 ref 1
00000100:00100000:0.0:1789760729.383725:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701021019077 time 701070407236 state 0x0 ref 1
00000100:00100000:0.0:1789760729.383737:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520907392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760729.383787:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20824064, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:0.0:1789760729.383796:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.383811:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760729.383816:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760729.383823:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.383846:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760729.433782:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972404 is committed
00002000:00010000:0.0:1789760729.434029:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20824064 -> 20828160
00010000:00010000:0.0:1789760729.434046:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.434059:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.434069:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.434077:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760729.434082:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.434091:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.434113:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.434121:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bde5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20824064->20828159] (req 20824064->20828159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760729.434293:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520907392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50553us (50919us total) trans 4294972404 rc 0/0
00000100:00100000:0.0:1789760729.434308:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5117
00000100:00100000:0.0:1789760729.434480:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701021019077 time 701070407236 state 0x2 ref 0
00000100:00100000:1.0:1789760729.444986:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760729.445088:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520907520
00000100:00100000:2.0:1789760729.445098:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520907520
00000100:00100000:2.0:1789760729.445152:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701021019077 time 701070407236 state 0x0 ref 1
00000100:00100000:2.0:1789760729.445167:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701070667652 time 701070407236 state 0x1 ref 1
00000100:00100000:2.0:1789760729.445200:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701070667652 time 701131882199 state 0x0 ref 1
00000100:00100000:2.0:1789760729.445212:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520907520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760729.445258:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20828160, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:2.0:1789760729.445267:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.445282:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:2.0:1789760729.445287:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760729.445293:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.445307:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760729.489740:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972405 is committed
00002000:00010000:1.0:1789760729.491355:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20828160 -> 20832256
00010000:00010000:1.0:1789760729.491376:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.491389:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.491398:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.491406:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.491411:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.491419:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.491439:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.491452:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bdec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20828160->20832255] (req 20828160->20832255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760729.491563:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520907520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46348us (46582us total) trans 4294972405 rc 0/0
00000100:00100000:1.0:1789760729.491575:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5118
00000100:00100000:1.0:1789760729.491586:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701070667652 time 701131882199 state 0x2 ref 0
00000100:00100000:2.0:1789760729.495270:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760729.501512:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520907648
00000100:00100000:1.0:1789760729.501531:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520907648
00000100:00100000:2.0:1789760729.501729:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701070667652 time 701131882199 state 0x0 ref 1
00000100:00100000:2.0:1789760729.501745:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701132142615 time 701131882199 state 0x1 ref 1
00000100:00100000:2.0:1789760729.501787:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701132142615 time 701188468560 state 0x0 ref 1
00000100:00100000:2.0:1789760729.501800:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520907648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760729.501863:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20832256, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:2.0:1789760729.501873:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.501889:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:2.0:1789760729.501893:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760729.501900:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.501919:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760729.547055:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20832256 -> 20836352
00010000:00010000:0.0:1789760729.547074:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.547087:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.547097:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.547105:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760729.547109:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.547118:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.547136:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.547151:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bdf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20832256->20836351] (req 20832256->20836351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760729.547236:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520907648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45433us (51968us total) trans 4294972406 rc 0/0
00000100:00100000:0.0:1789760729.547246:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5119
00000100:00100000:0.0:1789760729.547256:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701132142615 time 701188468560 state 0x2 ref 0
00000001:00080000:1.0:1789760729.547349:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972406 is committed
00000100:00100000:2.0:1789760729.552217:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760729.554659:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520907776
00000100:00100000:0.0:1789760729.554673:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520907776
00000100:00100000:0.0:1789760729.554736:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701132142615 time 701188468560 state 0x0 ref 1
00000100:00100000:0.0:1789760729.554750:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701188728976 time 701188468560 state 0x1 ref 1
00000100:00100000:0.0:1789760729.554775:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701188728976 time 701241458927 state 0x0 ref 1
00000100:00100000:0.0:1789760729.554784:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520907776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760729.554874:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20836352, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:0.0:1789760729.554884:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.554901:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760729.554982:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760729.554992:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.555007:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760729.609754:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972407 is committed
00002000:00010000:0.0:1789760729.609934:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20836352 -> 20840448
00010000:00010000:0.0:1789760729.609951:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.609964:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.609974:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.609982:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760729.609987:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.609997:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.610017:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.610025:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60bdfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20836352->20840447] (req 20836352->20840447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760729.610122:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520907776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55333us (57911us total) trans 4294972407 rc 0/0
00000100:00100000:0.0:1789760729.610136:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5120
00000100:00100000:0.0:1789760729.610146:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701188728976 time 701241458927 state 0x2 ref 0
00000100:00100000:2.0:1789760729.614909:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760729.615105:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520907904
00000100:00100000:0.0:1789760729.615114:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520907904
00000100:00100000:0.0:1789760729.615164:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701188728976 time 701241458927 state 0x0 ref 1
00000100:00100000:0.0:1789760729.615178:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701241719343 time 701241458927 state 0x1 ref 1
00000100:00100000:0.0:1789760729.615246:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701241719343 time 701301928379 state 0x0 ref 1
00000100:00100000:0.0:1789760729.615259:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520907904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760729.615307:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20840448, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:0.0:1789760729.615334:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.615352:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760729.615367:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760729.615375:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.615390:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760729.646930:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972408 is committed
00002000:00010000:0.0:1789760729.647097:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20840448 -> 20844544
00010000:00010000:0.0:1789760729.647114:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.647126:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.647135:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.647142:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760729.647147:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.647157:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.647177:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.647185:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60be01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20840448->20844543] (req 20840448->20844543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760729.647311:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520907904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32049us (32406us total) trans 4294972408 rc 0/0
00000100:00100000:0.0:1789760729.647364:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5121
00000100:00100000:0.0:1789760729.647373:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701241719343 time 701301928379 state 0x2 ref 0
00000100:00100000:2.0:1789760729.653798:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760729.653926:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520908032
00000100:00100000:1.0:1789760729.653935:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520908032
00000100:00100000:1.0:1789760729.654047:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701241719343 time 701301928379 state 0x0 ref 1
00000100:00100000:1.0:1789760729.654060:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701302188795 time 701301928379 state 0x1 ref 1
00000100:00100000:1.0:1789760729.654119:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701302188795 time 701340802011 state 0x0 ref 1
00000100:00100000:1.0:1789760729.654132:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520908032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760729.654177:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20844544, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:1.0:1789760729.654185:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.654200:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:1.0:1789760729.654204:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760729.654210:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.654224:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.658082:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:1.0:1789760729.683235:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20844544 -> 20848640
00010000:00010000:1.0:1789760729.683259:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.683272:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.683282:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.683290:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.683296:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.683305:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.683352:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.683771:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20844544->20848639] (req 20844544->20848639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760729.683884:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520908032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29750us (30091us total) trans 4294972409 rc 0/0
00000100:00100000:1.0:1789760729.683902:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5122
00000100:00100000:1.0:1789760729.683911:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701302188795 time 701340802011 state 0x2 ref 0
00000001:00080000:3.0:1789760729.684883:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972409 is committed
00000100:00100000:2.0:1789760729.688630:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760729.688782:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520908160
00000100:00100000:0.0:1789760729.688792:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520908160
00000100:00100000:0.0:1789760729.688866:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701302188795 time 701340802011 state 0x0 ref 1
00000100:00100000:0.0:1789760729.688882:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701341062427 time 701340802011 state 0x1 ref 1
00000100:00100000:0.0:1789760729.688920:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701341062427 time 701375602375 state 0x0 ref 1
00000100:00100000:0.0:1789760729.688933:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520908160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760729.688981:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20848640, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:0.0:1789760729.688993:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.689013:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760729.689017:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760729.689026:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.689040:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760729.717340:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20848640 -> 20852736
00010000:00010000:1.0:1789760729.717373:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.717387:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.717397:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.717404:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.717410:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.717419:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.717438:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.717450:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60be0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20848640->20852735] (req 20848640->20852735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760729.717542:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520908160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28607us (28916us total) trans 4294972410 rc 0/0
00000100:00100000:1.0:1789760729.717553:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5123
00000100:00100000:1.0:1789760729.717563:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701341062427 time 701375602375 state 0x2 ref 0
00000001:00080000:3.0:1789760729.718101:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972410 is committed
00000100:00100000:2.0:1789760729.721983:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548747904:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1789760729.722052:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760729.722184:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548747904
00000100:00100000:0.0:1789760729.722192:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548747904
00000100:00100000:0.0:1789760729.722242:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417
00000100:00100000:0.0:1789760729.722252:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548747904:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1789760729.722291:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:0.0:1789760729.722372:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548747904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (318us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760729.722383:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417
00000100:00100000:2.0:1789760729.722685:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548747904:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1789760729.724935:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760729.725015:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520908288
00000100:00100000:1.0:1789760729.725024:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520908288
00000100:00100000:1.0:1789760729.725070:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701341062427 time 701375602375 state 0x0 ref 1
00000100:00100000:1.0:1789760729.725086:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701375862791 time 701375602375 state 0x1 ref 1
00000100:00100000:1.0:1789760729.725114:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701375862791 time 701411796888 state 0x0 ref 1
00000100:00100000:1.0:1789760729.725125:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520908288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760729.725164:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20852736, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:1.0:1789760729.725174:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.725189:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:1.0:1789760729.725193:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760729.725199:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.725217:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760729.763980:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972411 is committed
00002000:00010000:1.0:1789760729.764162:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20852736 -> 20856832
00010000:00010000:1.0:1789760729.764178:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.764190:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.764199:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.764207:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760729.764211:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.764219:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.764237:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.764245:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20852736->20856831] (req 20852736->20856831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760729.766056:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520908288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40922us (41118us total) trans 4294972411 rc 0/0
00000100:00100000:1.0:1789760729.766070:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5124
00000100:00100000:1.0:1789760729.766080:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701375862791 time 701411796888 state 0x2 ref 0
00000100:00100000:2.0:1789760729.768580:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760729.769223:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520908416
00000100:00100000:3.0:1789760729.769234:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520908416
00000100:00100000:3.0:1789760729.769289:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701375862791 time 701411796888 state 0x0 ref 1
00000100:00100000:3.0:1789760729.769305:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701412057304 time 701411796888 state 0x1 ref 1
00000100:00100000:1.0:1789760729.769473:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701412057304 time 701456152726 state 0x0 ref 1
00000100:00100000:1.0:1789760729.769490:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520908416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760729.769539:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20856832, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:1.0:1789760729.769548:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.769562:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:1.0:1789760729.769566:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760729.769572:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.769585:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760729.802262:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20856832 -> 20860928
00010000:00010000:2.0:1789760729.802282:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.802295:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.802304:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.802334:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760729.802339:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.802349:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.802379:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.802391:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60be1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20856832->20860927] (req 20856832->20860927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760729.802554:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972412 is committed
00000100:00100000:2.0:1789760729.802613:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520908416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33123us (34038us total) trans 4294972412 rc 0/0
00000100:00100000:2.0:1789760729.802624:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5125
00000100:00100000:2.0:1789760729.802633:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701412057304 time 701456152726 state 0x2 ref 0
00000100:00100000:2.0:1789760729.808614:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760729.808715:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520908544
00000100:00100000:1.0:1789760729.808725:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520908544
00000100:00100000:1.0:1789760729.808779:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701412057304 time 701456152726 state 0x0 ref 1
00000100:00100000:1.0:1789760729.808793:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701456413142 time 701456152726 state 0x1 ref 1
00000100:00100000:1.0:1789760729.808834:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701456413142 time 701495507756 state 0x0 ref 1
00000100:00100000:1.0:1789760729.808847:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520908544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760729.808902:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20860928, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:1.0:1789760729.808911:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.808928:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:1.0:1789760729.808933:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760729.808938:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760729.808952:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760729.858785:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20860928 -> 20865024
00010000:00010000:3.0:1789760729.858805:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.858817:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.858841:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.858848:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760729.858852:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.858861:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.858878:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.858885:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20860928->20865023] (req 20860928->20865023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760729.858979:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520908544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50129us (50662us total) trans 4294972413 rc 0/0
00000100:00100000:3.0:1789760729.858989:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5126
00000100:00100000:3.0:1789760729.858997:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701456413142 time 701495507756 state 0x2 ref 0
00000001:00080000:3.0:1789760729.859036:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972413 is committed
00000100:00100000:0.0:1789760729.865750:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760729.865861:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520908672
00000100:00100000:3.0:1789760729.865870:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520908672
00000100:00100000:3.0:1789760729.865983:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701456413142 time 701495507756 state 0x0 ref 1
00000100:00100000:3.0:1789760729.866002:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701495768172 time 701495507756 state 0x1 ref 1
00000100:00100000:3.0:1789760729.866076:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701495768172 time 701552758035 state 0x0 ref 1
00000100:00100000:3.0:1789760729.866089:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520908672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760729.866137:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20865024, mtime: 0x6aad94da, atime: 0x0, ctime: 0x6aad94da, blocks: 0xa007
00010000:00010000:3.0:1789760729.866146:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.866162:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:3.0:1789760729.866166:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760729.866173:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.866186:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760729.910595:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20865024 -> 20869120
00002000:00010000:0.0:1789760729.910601:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760730 -> 1789760731
00002000:00010000:0.0:1789760729.910603:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760730 -> 1789760731
00010000:00010000:0.0:1789760729.910614:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.910627:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.910635:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.910643:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760729.910648:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.910658:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.910675:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.910681:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20865024->20869119] (req 20865024->20869119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760729.910774:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520908672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44682us (45027us total) trans 4294972414 rc 0/0
00000100:00100000:0.0:1789760729.910785:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5127
00000100:00100000:0.0:1789760729.910794:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701495768172 time 701552758035 state 0x2 ref 0
00000001:00080000:2.0:1789760729.910933:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972414 is committed
00000100:00100000:2.0:1789760729.916183:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760729.916245:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520908800
00000100:00100000:0.0:1789760729.916256:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520908800
00000100:00100000:0.0:1789760729.916359:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701495768172 time 701552758035 state 0x0 ref 1
00000100:00100000:0.0:1789760729.916375:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701553018451 time 701552758035 state 0x1 ref 1
00000100:00100000:0.0:1789760729.916404:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701553018451 time 701603087278 state 0x0 ref 1
00000100:00100000:0.0:1789760729.916417:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520908800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760729.916472:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20869120, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:0.0:1789760729.916484:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.916499:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760729.916504:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760729.916510:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760729.916524:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760729.978468:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972415 is committed
00002000:00010000:3.0:1789760729.978490:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20869120 -> 20873216
00010000:00010000:3.0:1789760729.978507:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.978521:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.978530:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.978543:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760729.978549:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.978557:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.978575:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760729.978583:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60be32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20869120->20873215] (req 20869120->20873215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760729.978867:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520908800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62445us (62685us total) trans 4294972415 rc 0/0
00000100:00100000:3.0:1789760729.978878:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5128
00000100:00100000:3.0:1789760729.978887:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701553018451 time 701603087278 state 0x2 ref 0
00000100:00100000:3.0:1789760729.989198:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760729.989792:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520908928
00000100:00100000:2.0:1789760729.989804:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520908928
00000100:00100000:2.0:1789760729.990034:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701553018451 time 701603087278 state 0x0 ref 1
00000100:00100000:2.0:1789760729.990051:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701603347694 time 701603087278 state 0x1 ref 1
00000100:00100000:2.0:1789760729.990087:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701603347694 time 701676769268 state 0x0 ref 1
00000100:00100000:2.0:1789760729.990100:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520908928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760729.990146:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20873216, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:2.0:1789760729.990155:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.990172:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:2.0:1789760729.990176:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760729.990182:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760729.990195:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760730.028976:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972416 is committed
00002000:00010000:2.0:1789760730.029078:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20873216 -> 20877312
00010000:00010000:2.0:1789760730.029093:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.029105:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.029114:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.029120:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760730.029125:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.029135:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.029154:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.029162:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20873216->20877311] (req 20873216->20877311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760730.029434:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520908928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39331us (40239us total) trans 4294972416 rc 0/0
00000100:00100000:2.0:1789760730.029445:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5129
00000100:00100000:2.0:1789760730.029453:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701603347694 time 701676769268 state 0x2 ref 0
00000100:00100000:0.0:1789760730.033650:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760730.033737:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520909056
00000100:00100000:1.0:1789760730.033748:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520909056
00000100:00100000:1.0:1789760730.033837:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701603347694 time 701676769268 state 0x0 ref 1
00000100:00100000:1.0:1789760730.033853:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701677029684 time 701676769268 state 0x1 ref 1
00000100:00100000:1.0:1789760730.033880:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701677029684 time 701720562600 state 0x0 ref 1
00000100:00100000:1.0:1789760730.033894:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520909056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760730.033942:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20877312, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:1.0:1789760730.033952:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.033967:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:1.0:1789760730.033972:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760730.033979:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.033992:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760730.034898:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:0.0:1789760730.068812:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20877312 -> 20881408
00010000:00010000:0.0:1789760730.068843:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.068855:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.068864:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.068871:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760730.068875:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.068885:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.068905:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.068913:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60be40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20877312->20881407] (req 20877312->20881407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760730.069005:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520909056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35109us (35359us total) trans 4294972417 rc 0/0
00000100:00100000:0.0:1789760730.069018:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5130
00000100:00100000:0.0:1789760730.069027:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701677029684 time 701720562600 state 0x2 ref 0
00000001:00080000:0.0:1789760730.069641:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972417 is committed
00000100:00100000:3.0:1789760730.073681:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.074022:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520909184
00000100:00100000:0.0:1789760730.074033:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520909184
00000100:00100000:0.0:1789760730.074089:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701677029684 time 701720562600 state 0x0 ref 1
00000100:00100000:0.0:1789760730.074106:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701720823016 time 701720562600 state 0x1 ref 1
00000100:00100000:0.0:1789760730.074181:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701720823016 time 701760863039 state 0x0 ref 1
00000100:00100000:0.0:1789760730.074194:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520909184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760730.074241:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20881408, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:0.0:1789760730.074250:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.074276:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760730.074280:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760730.074286:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.074299:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760730.111333:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20881408 -> 20885504
00010000:00010000:1.0:1789760730.111361:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.111375:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.111384:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.111392:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760730.111397:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.111407:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.111435:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.111444:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60be47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20881408->20885503] (req 20881408->20885503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760730.111497:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972418 is committed
00000100:00100000:1.0:1789760730.111558:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520909184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37360us (37882us total) trans 4294972418 rc 0/0
00000100:00100000:1.0:1789760730.111570:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5131
00000100:00100000:1.0:1789760730.111579:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701720823016 time 701760863039 state 0x2 ref 0
00000100:00100000:1.0:1789760730.114940:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760730.115199:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520909312
00000100:00100000:2.0:1789760730.115208:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520909312
00000100:00100000:2.0:1789760730.115254:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701720823016 time 701760863039 state 0x0 ref 1
00000100:00100000:2.0:1789760730.115268:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701761123455 time 701760863039 state 0x1 ref 1
00000100:00100000:2.0:1789760730.115346:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701761123455 time 701802028768 state 0x0 ref 1
00000100:00100000:2.0:1789760730.115368:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520909312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760730.115410:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20885504, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:2.0:1789760730.115419:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.115435:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:2.0:1789760730.115439:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760730.115445:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.115562:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760730.145834:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20885504 -> 20889600
00010000:00010000:2.0:1789760730.145855:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.145874:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.145883:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.145889:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760730.145894:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.145903:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.145922:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.145929:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60be4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20885504->20889599] (req 20885504->20889599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760730.146023:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520909312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30652us (31085us total) trans 4294972419 rc 0/0
00000100:00100000:2.0:1789760730.146034:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5132
00000100:00100000:2.0:1789760730.146043:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701761123455 time 701802028768 state 0x2 ref 0
00000001:00080000:0.0:1789760730.149771:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972419 is committed
00000100:00100000:2.0:1789760730.149945:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.150056:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520909440
00000100:00100000:0.0:1789760730.150066:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520909440
00000100:00100000:0.0:1789760730.150119:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701761123455 time 701802028768 state 0x0 ref 1
00000100:00100000:0.0:1789760730.150135:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701802289184 time 701802028768 state 0x1 ref 1
00000100:00100000:0.0:1789760730.150164:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701802289184 time 701836846472 state 0x0 ref 1
00000100:00100000:0.0:1789760730.150174:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520909440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760730.150221:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20889600, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:0.0:1789760730.150229:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.150244:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760730.150248:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760730.150255:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.150268:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760730.184510:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20889600 -> 20893696
00010000:00010000:0.0:1789760730.184531:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.184546:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.184561:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.184569:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760730.184574:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.184583:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.184603:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.184612:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60be55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20889600->20893695] (req 20889600->20893695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760730.184704:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520909440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34526us (34757us total) trans 4294972420 rc 0/0
00000100:00100000:0.0:1789760730.184715:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5133
00000100:00100000:0.0:1789760730.184725:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701802289184 time 701836846472 state 0x2 ref 0
00000001:00080000:3.0:1789760730.188013:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972420 is committed
00000100:00100000:2.0:1789760730.188164:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.188237:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520909568
00000100:00100000:0.0:1789760730.188247:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520909568
00000100:00100000:0.0:1789760730.188299:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701802289184 time 701836846472 state 0x0 ref 1
00000100:00100000:0.0:1789760730.188344:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701837106888 time 701836846472 state 0x1 ref 1
00000100:00100000:0.0:1789760730.188375:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701837106888 time 701875057724 state 0x0 ref 1
00000100:00100000:0.0:1789760730.188388:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520909568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760730.188438:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20893696, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:0.0:1789760730.188447:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.188614:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760730.188619:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760730.188626:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.188641:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760730.217664:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972421 is committed
00002000:00010000:2.0:1789760730.217765:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20893696 -> 20897792
00010000:00010000:2.0:1789760730.217780:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.217792:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.217801:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.217808:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760730.217813:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.217821:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.217849:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.217856:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60be5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20893696->20897791] (req 20893696->20897791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760730.217975:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520909568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29586us (29812us total) trans 4294972421 rc 0/0
00000100:00100000:2.0:1789760730.217985:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5134
00000100:00100000:2.0:1789760730.217995:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701837106888 time 701875057724 state 0x2 ref 0
00000100:00100000:2.0:1789760730.222170:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760730.222288:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520909696
00000100:00100000:3.0:1789760730.222298:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520909696
00000100:00100000:3.0:1789760730.222607:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701837106888 time 701875057724 state 0x0 ref 1
00000100:00100000:3.0:1789760730.222626:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701875318140 time 701875057724 state 0x1 ref 1
00000100:00100000:3.0:1789760730.222688:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701875318140 time 701909370866 state 0x0 ref 1
00000100:00100000:3.0:1789760730.222701:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520909696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760730.222750:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20897792, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:3.0:1789760730.222761:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.222778:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:3.0:1789760730.222782:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760730.222788:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.222803:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760730.258004:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20897792 -> 20901888
00010000:00010000:3.0:1789760730.258025:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.258039:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.258048:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.258063:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760730.258068:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.258078:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.258097:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.258104:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20897792->20901887] (req 20897792->20901887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760730.258202:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520909696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35498us (36036us total) trans 4294972422 rc 0/0
00000100:00100000:3.0:1789760730.258213:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5135
00000100:00100000:3.0:1789760730.258223:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701875318140 time 701909370866 state 0x2 ref 0
00000001:00080000:0.0:1789760730.261858:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972422 is committed
00000100:00100000:2.0:1789760730.262450:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760730.262591:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520909824
00000100:00100000:3.0:1789760730.262601:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520909824
00000100:00100000:3.0:1789760730.262657:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701875318140 time 701909370866 state 0x0 ref 1
00000100:00100000:3.0:1789760730.262671:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701909631282 time 701909370866 state 0x1 ref 1
00000100:00100000:3.0:1789760730.262701:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701909631282 time 701949383854 state 0x0 ref 1
00000100:00100000:3.0:1789760730.262716:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520909824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760730.262765:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20901888, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:3.0:1789760730.262774:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.262789:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:3.0:1789760730.262793:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760730.262799:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.262812:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760730.294428:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972423 is committed
00002000:00010000:2.0:1789760730.294707:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20901888 -> 20905984
00010000:00010000:2.0:1789760730.294723:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.294735:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.294745:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.294751:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760730.294756:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.294765:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.294783:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.294791:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60be6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20901888->20905983] (req 20901888->20905983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760730.294926:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520909824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32207us (32568us total) trans 4294972423 rc 0/0
00000100:00100000:2.0:1789760730.294938:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5136
00000100:00100000:2.0:1789760730.294946:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701909631282 time 701949383854 state 0x2 ref 0
00000100:00100000:2.0:1789760730.299210:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.299310:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520909952
00000100:00100000:0.0:1789760730.299534:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520909952
00000100:00100000:0.0:1789760730.299586:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701909631282 time 701949383854 state 0x0 ref 1
00000100:00100000:0.0:1789760730.299601:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701949644270 time 701949383854 state 0x1 ref 1
00000100:00100000:0.0:1789760730.299668:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701949644270 time 701986349597 state 0x0 ref 1
00000100:00100000:0.0:1789760730.299680:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520909952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760730.299729:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20905984, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:0.0:1789760730.299739:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.299754:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=701s v=(0 0)
00010000:00010000:0.0:1789760730.299758:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760730.299764:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.299777:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760730.326290:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20905984 -> 20910080
00010000:00010000:0.0:1789760730.326309:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.326365:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.326374:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.326381:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760730.326386:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.326395:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.326420:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.326428:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20905984->20910079] (req 20905984->20910079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760730.326756:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520909952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27071us (27549us total) trans 4294972424 rc 0/0
00000100:00100000:2.0:1789760730.326767:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5137
00000100:00100000:2.0:1789760730.326777:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701949644270 time 701986349597 state 0x2 ref 0
00000001:00080000:0.0:1789760730.329648:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972424 is committed
00000100:00100000:0.0:1789760730.330170:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760730.330295:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520910080
00000100:00100000:2.0:1789760730.330304:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520910080
00000100:00100000:2.0:1789760730.330399:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701949644270 time 701986349597 state 0x0 ref 1
00000100:00100000:2.0:1789760730.330415:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701986610013 time 701986349597 state 0x1 ref 1
00000100:00100000:2.0:1789760730.330441:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701986610013 time 702017123173 state 0x0 ref 1
00000100:00100000:2.0:1789760730.330604:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520910080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760730.330658:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20910080, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:2.0:1789760730.330668:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.330685:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:2.0:1789760730.330690:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760730.330696:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.330716:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760730.388023:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20910080 -> 20914176
00010000:00010000:2.0:1789760730.388043:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.388059:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760730.388060:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972425 is committed
00010000:00010000:2.0:1789760730.388074:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.388082:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760730.388088:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.388098:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.388118:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.388126:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60be78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20910080->20914175] (req 20910080->20914175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760730.388256:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520910080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57801us (58086us total) trans 4294972425 rc 0/0
00000100:00100000:2.0:1789760730.388266:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5138
00000100:00100000:2.0:1789760730.388275:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701986610013 time 702017123173 state 0x2 ref 0
00000100:00100000:3.0:1789760730.391626:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.391699:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520910208
00000100:00100000:0.0:1789760730.391709:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520910208
00000100:00100000:0.0:1789760730.391764:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 701986610013 time 702017123173 state 0x0 ref 1
00000100:00100000:0.0:1789760730.391778:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702017383589 time 702017123173 state 0x1 ref 1
00000100:00100000:0.0:1789760730.391808:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702017383589 time 702078491169 state 0x0 ref 1
00000100:00100000:0.0:1789760730.391833:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520910208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760730.391892:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20914176, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:0.0:1789760730.391901:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.391916:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:0.0:1789760730.391921:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760730.391928:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.391942:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760730.421756:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972426 is committed
00002000:00010000:3.0:1789760730.421854:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20914176 -> 20918272
00010000:00010000:3.0:1789760730.421883:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.421897:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.421907:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.421915:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760730.421920:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.421930:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.421949:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.421956:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60be7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20914176->20918271] (req 20914176->20918271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760730.422072:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520910208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30248us (30450us total) trans 4294972426 rc 0/0
00000100:00100000:3.0:1789760730.422082:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5139
00000100:00100000:3.0:1789760730.422091:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702017383589 time 702078491169 state 0x2 ref 0
00000100:00100000:2.0:1789760730.427213:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760730.427619:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520910336
00000100:00100000:3.0:1789760730.427629:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520910336
00000100:00100000:3.0:1789760730.427682:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702017383589 time 702078491169 state 0x0 ref 1
00000100:00100000:3.0:1789760730.427696:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702078751585 time 702078491169 state 0x1 ref 1
00000100:00100000:3.0:1789760730.427723:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702078751585 time 702114406034 state 0x0 ref 1
00000100:00100000:3.0:1789760730.427735:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520910336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760730.427780:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20918272, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:3.0:1789760730.427789:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.427804:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:3.0:1789760730.427809:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760730.427815:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.427840:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760730.468301:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972427 is committed
00002000:00010000:3.0:1789760730.468519:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20918272 -> 20922368
00010000:00010000:3.0:1789760730.468535:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.468549:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.468560:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.468568:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760730.468573:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.468583:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.468601:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.468610:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60be86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20918272->20922367] (req 20918272->20922367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760730.468741:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520910336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41002us (41529us total) trans 4294972427 rc 0/0
00000100:00100000:3.0:1789760730.468751:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5140
00000100:00100000:3.0:1789760730.468760:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702078751585 time 702114406034 state 0x2 ref 0
00000100:00100000:0.0:1789760730.478416:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760730.480535:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520910464
00000100:00100000:2.0:1789760730.480549:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520910464
00000100:00100000:2.0:1789760730.480608:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702078751585 time 702114406034 state 0x0 ref 1
00000100:00100000:2.0:1789760730.480624:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702114666450 time 702114406034 state 0x1 ref 1
00000100:00100000:2.0:1789760730.480662:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702114666450 time 702167344595 state 0x0 ref 1
00000100:00100000:2.0:1789760730.480675:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520910464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760730.480727:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20922368, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:2.0:1789760730.480737:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.480753:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:2.0:1789760730.480758:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760730.480764:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.480779:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760730.519843:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972428 is committed
00002000:00010000:2.0:1789760730.519959:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20922368 -> 20926464
00010000:00010000:2.0:1789760730.519975:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.519987:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.519996:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.520005:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760730.520009:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.520018:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.520036:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.520044:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60be8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20922368->20926463] (req 20922368->20926463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760730.520139:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520910464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39461us (41726us total) trans 4294972428 rc 0/0
00000100:00100000:2.0:1789760730.520153:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5141
00000100:00100000:2.0:1789760730.520162:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702114666450 time 702167344595 state 0x2 ref 0
00000100:00100000:3.0:1789760730.527537:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760730.527672:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520910592
00000100:00100000:2.0:1789760730.527682:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520910592
00000100:00100000:2.0:1789760730.527751:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702114666450 time 702167344595 state 0x0 ref 1
00000100:00100000:2.0:1789760730.527767:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702167605011 time 702167344595 state 0x1 ref 1
00000100:00100000:2.0:1789760730.527797:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702167605011 time 702214479772 state 0x0 ref 1
00000100:00100000:2.0:1789760730.527809:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520910592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760730.527866:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20926464, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:2.0:1789760730.527876:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.527891:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:2.0:1789760730.527895:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760730.527901:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.527916:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760730.589360:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20926464 -> 20930560
00010000:00010000:0.0:1789760730.589379:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.589392:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.589401:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.589409:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760730.589414:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.589423:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.589443:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.589460:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60be94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20926464->20930559] (req 20926464->20930559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760730.589549:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520910592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61737us (62017us total) trans 4294972429 rc 0/0
00000100:00100000:0.0:1789760730.589559:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5142
00000100:00100000:0.0:1789760730.589568:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702167605011 time 702214479772 state 0x2 ref 0
00000001:00080000:0.0:1789760730.589605:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972429 is committed
00000100:00100000:3.0:1789760730.596916:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.597044:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520910720
00000100:00100000:0.0:1789760730.597054:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520910720
00000100:00100000:0.0:1789760730.597107:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702167605011 time 702214479772 state 0x0 ref 1
00000100:00100000:0.0:1789760730.597122:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702214740188 time 702214479772 state 0x1 ref 1
00000100:00100000:0.0:1789760730.597157:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702214740188 time 702283838228 state 0x0 ref 1
00000100:00100000:0.0:1789760730.597169:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520910720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760730.597218:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20930560, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:0.0:1789760730.597228:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.597245:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:0.0:1789760730.597249:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760730.597255:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.597270:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760730.660191:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972430 is committed
00002000:00010000:1.0:1789760730.663059:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20930560 -> 20934656
00010000:00010000:1.0:1789760730.663079:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.663092:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.663100:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.663106:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760730.663111:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.663119:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.663137:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.663143:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60be9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20930560->20934655] (req 20930560->20934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760730.663250:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520910720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66077us (66337us total) trans 4294972430 rc 0/0
00000100:00100000:1.0:1789760730.663261:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5143
00000100:00100000:1.0:1789760730.663270:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702214740188 time 702283838228 state 0x2 ref 0
00000100:00100000:1.0:1789760730.667356:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760730.667478:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520910848
00000100:00100000:3.0:1789760730.667487:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520910848
00000100:00100000:3.0:1789760730.667538:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702214740188 time 702283838228 state 0x0 ref 1
00000100:00100000:3.0:1789760730.667554:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702284098644 time 702283838228 state 0x1 ref 1
00000100:00100000:3.0:1789760730.667588:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702284098644 time 702354270088 state 0x0 ref 1
00000100:00100000:3.0:1789760730.667608:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520910848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760730.667658:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20934656, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:3.0:1789760730.667668:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.667683:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:3.0:1789760730.667688:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760730.667695:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.667708:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.687288:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760730.709489:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972431 is committed
00002000:00010000:1.0:1789760730.709611:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20934656 -> 20938752
00010000:00010000:1.0:1789760730.709626:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.709639:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.709649:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.709662:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760730.709666:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.709676:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.709695:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.709703:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60bea2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20934656->20938751] (req 20934656->20938751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760730.709800:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520910848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42190us (42493us total) trans 4294972431 rc 0/0
00000100:00100000:1.0:1789760730.709810:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5144
00000100:00100000:1.0:1789760730.709828:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702284098644 time 702354270088 state 0x2 ref 0
00000100:00100000:3.0:1789760730.718881:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760730.719000:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520910976
00000100:00100000:2.0:1789760730.719010:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520910976
00000100:00100000:2.0:1789760730.719065:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702284098644 time 702354270088 state 0x0 ref 1
00000100:00100000:2.0:1789760730.719082:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702354530504 time 702354270088 state 0x1 ref 1
00000100:00100000:2.0:1789760730.719116:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702354530504 time 702405798225 state 0x0 ref 1
00000100:00100000:2.0:1789760730.719129:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520910976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760730.719177:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20938752, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:2.0:1789760730.719186:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.719207:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:2.0:1789760730.719222:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760730.719228:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.719242:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760730.745744:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1789760730.745768:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548748032:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1789760730.745845:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760730.747495:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548748032
00000100:00100000:2.0:1789760730.747506:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548748032
00000100:00100000:2.0:1789760730.747560:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418
00000100:00100000:2.0:1789760730.747570:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548748032:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1789760730.747615:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:2.0:1789760730.747702:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548748032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (1857us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760730.747713:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418
00000100:00100000:0.0:1789760730.748023:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548748032:0@lo:41:osp-pre-1-0.0
00000001:00080000:0.0:1789760730.778152:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972432 is committed
00002000:00010000:2.0:1789760730.779274:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20938752 -> 20942848
00010000:00010000:2.0:1789760730.779293:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.779307:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.779459:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.779470:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760730.779475:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.779484:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.779504:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.779512:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bea9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20938752->20942847] (req 20938752->20942847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760730.779610:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520910976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60478us (60734us total) trans 4294972432 rc 0/0
00000100:00100000:2.0:1789760730.779625:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5145
00000100:00100000:2.0:1789760730.779635:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702354530504 time 702405798225 state 0x2 ref 0
00000100:00100000:2.0:1789760730.784564:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.784632:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520911104
00000100:00100000:0.0:1789760730.784642:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520911104
00000100:00100000:0.0:1789760730.784699:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702354530504 time 702405798225 state 0x0 ref 1
00000100:00100000:0.0:1789760730.784713:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702406058641 time 702405798225 state 0x1 ref 1
00000100:00100000:0.0:1789760730.784746:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702406058641 time 702471429021 state 0x0 ref 1
00000100:00100000:0.0:1789760730.784757:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520911104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760730.784806:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20942848, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:0.0:1789760730.785034:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.785050:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:0.0:1789760730.785055:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760730.785062:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760730.785076:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760730.843736:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972433 is committed
00002000:00010000:1.0:1789760730.843827:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20942848 -> 20946944
00010000:00010000:1.0:1789760730.843843:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.843858:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.843866:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.843874:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760730.843879:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.843887:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.843904:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.843911:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60beb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20942848->20946943] (req 20942848->20946943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760730.844037:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520911104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59277us (59491us total) trans 4294972433 rc 0/0
00000100:00100000:1.0:1789760730.844048:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5146
00000100:00100000:1.0:1789760730.844057:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702406058641 time 702471429021 state 0x2 ref 0
00000100:00100000:0.0:1789760730.850779:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760730.850880:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520911232
00000100:00100000:1.0:1789760730.850892:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520911232
00000100:00100000:1.0:1789760730.850944:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702406058641 time 702471429021 state 0x0 ref 1
00000100:00100000:1.0:1789760730.850959:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702471689437 time 702471429021 state 0x1 ref 1
00000100:00100000:1.0:1789760730.850990:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702471689437 time 702537673650 state 0x0 ref 1
00000100:00100000:1.0:1789760730.851001:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520911232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760730.851049:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20946944, mtime: 0x6aad94db, atime: 0x0, ctime: 0x6aad94db, blocks: 0xa007
00010000:00010000:1.0:1789760730.851058:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.851074:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:1.0:1789760730.851079:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760730.851085:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.851101:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760730.894293:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972434 is committed
00002000:00010000:1.0:1789760730.894461:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20946944 -> 20951040
00002000:00010000:1.0:1789760730.894466:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760731 -> 1789760732
00002000:00010000:1.0:1789760730.894469:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760731 -> 1789760732
00010000:00010000:1.0:1789760730.894482:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.894495:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.894504:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.894512:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760730.894516:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.894525:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.894545:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.894553:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60beb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20946944->20951039] (req 20946944->20951039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760730.894683:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520911232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43678us (43909us total) trans 4294972434 rc 0/0
00000100:00100000:1.0:1789760730.894696:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5147
00000100:00100000:1.0:1789760730.894705:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702471689437 time 702537673650 state 0x2 ref 0
00000100:00100000:0.0:1789760730.898449:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760730.898546:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520911360
00000100:00100000:1.0:1789760730.898557:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520911360
00000100:00100000:1.0:1789760730.898611:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702471689437 time 702537673650 state 0x0 ref 1
00000100:00100000:1.0:1789760730.898626:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702537934066 time 702537673650 state 0x1 ref 1
00000100:00100000:1.0:1789760730.898695:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702537934066 time 702585377379 state 0x0 ref 1
00000100:00100000:1.0:1789760730.898708:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520911360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760730.898757:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20951040, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa007
00010000:00010000:1.0:1789760730.898765:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.898780:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:1.0:1789760730.898784:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760730.898790:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.898804:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760730.932930:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20951040 -> 20955136
00010000:00010000:1.0:1789760730.932951:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.932974:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.932983:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.932990:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760730.932995:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.933005:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.933025:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760730.933032:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60bebe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20951040->20955135] (req 20951040->20955135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760730.933132:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520911360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34419us (34691us total) trans 4294972435 rc 0/0
00000100:00100000:1.0:1789760730.933655:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5148
00000100:00100000:1.0:1789760730.933667:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702537934066 time 702585377379 state 0x2 ref 0
00000001:00080000:0.0:1789760730.933786:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972435 is committed
00000100:00100000:3.0:1789760730.939270:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760730.939379:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520911488
00000100:00100000:2.0:1789760730.939390:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520911488
00000100:00100000:2.0:1789760730.939438:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702537934066 time 702585377379 state 0x0 ref 1
00000100:00100000:2.0:1789760730.939449:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702585637795 time 702585377379 state 0x1 ref 1
00000100:00100000:2.0:1789760730.939478:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702585637795 time 702626160849 state 0x0 ref 1
00000100:00100000:2.0:1789760730.939490:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520911488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760730.939536:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20955136, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa007
00010000:00010000:2.0:1789760730.939546:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.939561:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:2.0:1789760730.939565:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760730.939572:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760730.939585:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760730.970971:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.971010:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.971038:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.971059:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.971080:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760730.971105:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520911744
00000100:00100000:0.0:1789760730.971114:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520911744
00000100:00100000:0.0:1789760730.971162:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520912000
00000100:00100000:0.0:1789760730.971165:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520912000
00000100:00100000:0.0:1789760730.971176:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520911872
00000100:00100000:0.0:1789760730.971178:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520911872
00000100:00100000:0.0:1789760730.971188:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520912128
00000100:00100000:0.0:1789760730.971190:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520912128
00000100:00100000:0.0:1789760730.971205:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 853
00000100:00100000:0.0:1789760730.971214:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520911744:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760730.971288:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699520911744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 75us (325us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760730.971296:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 853
00000100:00100000:0.0:1789760730.971343:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 854
00000100:00100000:0.0:1789760730.971366:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520912000:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760730.971392:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520912000:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760730.971407:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 854
00000100:00100000:0.0:1789760730.971420:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 855
00000100:00100000:0.0:1789760730.971426:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520911872:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760730.971461:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520911872:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760730.971467:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 855
00000100:00100000:0.0:1789760730.971479:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 856
00000100:00100000:0.0:1789760730.971484:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520912128:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760730.971512:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699520912128:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (431us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760730.971518:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 856
00000100:00100000:0.0:1789760730.971537:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520911616
00000100:00100000:0.0:1789760730.971540:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520911616
00000100:00100000:0.0:1789760730.971568:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 466
00000100:00100000:0.0:1789760730.971574:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda0059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520911616:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760730.971596:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda0059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699520911616:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (558us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760730.971602:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 466
00000100:00080000:0.0:1789760730.971715:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1789760730.971720:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000001:00080000:2.0:1789760730.997260:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972436 is committed
00002000:00010000:3.0:1789760730.997477:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20955136 -> 20959232
00010000:00010000:3.0:1789760730.997495:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.997508:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.997517:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.997525:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760730.997531:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.997539:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.997560:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760730.997568:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60bec5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20955136->20959231] (req 20955136->20959231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760730.997696:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520911488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58202us (58429us total) trans 4294972436 rc 0/0
00000100:00100000:3.0:1789760730.997707:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5149
00000100:00100000:3.0:1789760730.997716:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702585637795 time 702626160849 state 0x2 ref 0
00000100:00100000:0.0:1789760731.001733:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760731.004103:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520912256
00000100:00100000:1.0:1789760731.004118:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520912256
00000100:00100000:1.0:1789760731.004182:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702585637795 time 702626160849 state 0x0 ref 1
00000100:00100000:1.0:1789760731.004198:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702626421265 time 702626160849 state 0x1 ref 1
00000100:00100000:1.0:1789760731.004229:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702626421265 time 702690911980 state 0x0 ref 1
00000100:00100000:1.0:1789760731.004241:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520912256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760731.004288:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20959232, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa007
00010000:00010000:1.0:1789760731.004298:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.004333:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:1.0:1789760731.004337:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760731.004343:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.004357:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760731.043125:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20959232 -> 20963328
00010000:00010000:0.0:1789760731.043144:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.043164:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.043173:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.043179:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760731.043184:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.043193:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.043212:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.043220:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60becc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20959232->20963327] (req 20959232->20963327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760731.043346:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520912256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39072us (41588us total) trans 4294972437 rc 0/0
00000100:00100000:0.0:1789760731.043366:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5150
00000100:00100000:0.0:1789760731.043375:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702626421265 time 702690911980 state 0x2 ref 0
00000001:00080000:3.0:1789760731.044025:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972437 is committed
00000100:00100000:2.0:1789760731.047032:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760731.047171:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520912384
00000100:00100000:1.0:1789760731.047180:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520912384
00000100:00100000:1.0:1789760731.047233:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702626421265 time 702690911980 state 0x0 ref 1
00000100:00100000:1.0:1789760731.047247:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702691172396 time 702690911980 state 0x1 ref 1
00000100:00100000:1.0:1789760731.047361:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702691172396 time 702734035427 state 0x0 ref 1
00000100:00100000:1.0:1789760731.047375:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520912384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760731.047424:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20963328, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa007
00010000:00010000:1.0:1789760731.047434:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.047449:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:1.0:1789760731.047454:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760731.047460:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.047473:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760731.083472:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20963328 -> 20967424
00010000:00010000:3.0:1789760731.083492:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.083506:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.083515:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.083524:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760731.083528:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.083536:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.083561:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.083569:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60bed3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20963328->20967423] (req 20963328->20967423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760731.083665:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520912384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36289us (36636us total) trans 4294972438 rc 0/0
00000100:00100000:3.0:1789760731.083675:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5151
00000100:00100000:3.0:1789760731.083684:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702691172396 time 702734035427 state 0x2 ref 0
00000001:00080000:2.0:1789760731.083766:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972438 is committed
00000100:00100000:2.0:1789760731.090448:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760731.092557:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520912512
00000100:00100000:3.0:1789760731.092572:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520912512
00000100:00100000:3.0:1789760731.092632:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702691172396 time 702734035427 state 0x0 ref 1
00000100:00100000:3.0:1789760731.092659:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702734295843 time 702734035427 state 0x1 ref 1
00000100:00100000:3.0:1789760731.092693:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702734295843 time 702779374948 state 0x0 ref 1
00000100:00100000:3.0:1789760731.092707:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520912512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760731.092755:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20967424, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa007
00010000:00010000:3.0:1789760731.092765:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.092782:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:3.0:1789760731.092787:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760731.092793:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.092808:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.137266:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972439 is committed
00002000:00010000:3.0:1789760731.137384:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20967424 -> 20971520
00010000:00010000:3.0:1789760731.137401:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.137415:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.137425:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.137432:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760731.137437:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.137446:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.137465:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.137473:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60beda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20967424->20971519] (req 20967424->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760731.137571:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520912512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44861us (47130us total) trans 4294972439 rc 0/0
00000100:00100000:3.0:1789760731.137582:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5152
00000100:00100000:3.0:1789760731.137592:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702734295843 time 702779374948 state 0x2 ref 0
00000100:00100000:0.0:1789760731.145699:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760731.145800:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520912640
00000100:00100000:3.0:1789760731.145809:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520912640
00000100:00100000:3.0:1789760731.145885:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702734295843 time 702779374948 state 0x0 ref 1
00000100:00100000:3.0:1789760731.145900:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702779635364 time 702779374948 state 0x1 ref 1
00000100:00100000:3.0:1789760731.145933:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702779635364 time 702832615912 state 0x0 ref 1
00000100:00100000:3.0:1789760731.145946:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520912640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760731.145994:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20971520, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa007
00010000:00010000:3.0:1789760731.146003:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.146019:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:3.0:1789760731.146023:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760731.146029:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.146042:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760731.190379:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972440 is committed
00002000:00010000:2.0:1789760731.190474:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20971520 -> 20975616
00002000:00010000:2.0:1789760731.190479:0:8103:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 40967 -> 43015
00010000:00010000:2.0:1789760731.190492:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.190506:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.190516:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.190524:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760731.190529:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.190539:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.190559:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.190567:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bee1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20971520->20975615] (req 20971520->20975615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760731.190661:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520912640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44713us (44967us total) trans 4294972440 rc 0/0
00000100:00100000:2.0:1789760731.190671:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5153
00000100:00100000:2.0:1789760731.190681:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702779635364 time 702832615912 state 0x2 ref 0
00000100:00100000:2.0:1789760731.196524:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760731.196615:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520912768
00000100:00100000:0.0:1789760731.196626:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520912768
00000100:00100000:0.0:1789760731.196679:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702779635364 time 702832615912 state 0x0 ref 1
00000100:00100000:0.0:1789760731.196757:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702832876328 time 702832615912 state 0x1 ref 1
00000100:00100000:0.0:1789760731.196833:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702832876328 time 702883515519 state 0x0 ref 1
00000100:00100000:0.0:1789760731.196848:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520912768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760731.196893:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20975616, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:0.0:1789760731.196902:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.196918:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:0.0:1789760731.196923:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760731.196929:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.196942:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.237099:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972441 is committed
00002000:00010000:0.0:1789760731.237416:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20975616 -> 20979712
00010000:00010000:0.0:1789760731.237432:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.237444:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.237454:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.237461:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760731.237466:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.237475:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.237495:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.237503:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60bee8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20975616->20979711] (req 20975616->20979711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760731.237597:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520912768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40747us (41145us total) trans 4294972441 rc 0/0
00000100:00100000:0.0:1789760731.237606:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5154
00000100:00100000:0.0:1789760731.237615:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702832876328 time 702883515519 state 0x2 ref 0
00000100:00100000:0.0:1789760731.243247:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760731.247262:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520912896
00000100:00100000:1.0:1789760731.247276:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520912896
00000100:00100000:1.0:1789760731.247360:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702832876328 time 702883515519 state 0x0 ref 1
00000100:00100000:1.0:1789760731.247374:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702883775935 time 702883515519 state 0x1 ref 1
00000100:00100000:1.0:1789760731.247402:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702883775935 time 702934085720 state 0x0 ref 1
00000100:00100000:1.0:1789760731.247415:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520912896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760731.247461:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20979712, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:1.0:1789760731.247470:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.247486:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:1.0:1789760731.247491:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760731.247497:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.247511:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760731.258737:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1789760731.258757:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548748160:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1789760731.258830:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760731.258894:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548748160
00000100:00100000:0.0:1789760731.258902:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548748160
00000100:00100000:0.0:1789760731.258948:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350
00000100:00100000:0.0:1789760731.258957:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548748160:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1789760731.258977:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527761408 pending 1703936 free 3837788160 avail 3794796544
00000100:00100000:0.0:1789760731.259017:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548748160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (187us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760731.259024:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350
00000100:00080000:0.0:1789760731.259042:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760731.259074:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548748160:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1789760731.259298:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1789760731.259308:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548748288:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760731.259367:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760731.259393:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548748288
00000100:00100000:3.0:1789760731.259396:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548748288
00000100:00100000:3.0:1789760731.259423:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351
00000100:00100000:3.0:1789760731.259430:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548748288:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1789760731.259441:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527761408 pending 1703936 free 3837788160 avail 3794796544
00000100:00100000:3.0:1789760731.259481:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548748288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (112us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760731.259487:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351
00000100:00100000:3.0:1789760731.259512:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548748288:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1789760731.259525:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:1.0:1789760731.273872:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20979712 -> 20983808
00010000:00010000:1.0:1789760731.273893:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.273906:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.273914:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.273920:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760731.273925:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.273933:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.273951:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.273959:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60beef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20979712->20983807] (req 20979712->20983807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760731.274052:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520912896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26635us (30810us total) trans 4294972442 rc 0/0
00000100:00100000:1.0:1789760731.274063:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5155
00000100:00100000:1.0:1789760731.274074:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702883775935 time 702934085720 state 0x2 ref 0
00000001:00080000:2.0:1789760731.274153:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972442 is committed
00000100:00100000:1.0:1789760731.277727:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760731.277799:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520913024
00000100:00100000:3.0:1789760731.277810:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520913024
00000100:00100000:3.0:1789760731.277875:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702883775935 time 702934085720 state 0x0 ref 1
00000100:00100000:3.0:1789760731.277890:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702934346136 time 702934085720 state 0x1 ref 1
00000100:00100000:3.0:1789760731.277922:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702934346136 time 702964604485 state 0x0 ref 1
00000100:00100000:3.0:1789760731.277935:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520913024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760731.277978:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20983808, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:3.0:1789760731.277986:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.278002:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:3.0:1789760731.278006:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760731.278012:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.278025:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760731.308077:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972443 is committed
00002000:00010000:3.0:1789760731.308242:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20983808 -> 20987904
00010000:00010000:3.0:1789760731.308257:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.308269:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.308277:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.308283:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760731.308288:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.308296:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.308355:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.308365:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bef6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20983808->20987903] (req 20983808->20987903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760731.308462:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520913024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30516us (30730us total) trans 4294972443 rc 0/0
00000100:00100000:3.0:1789760731.308473:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5156
00000100:00100000:3.0:1789760731.308482:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702934346136 time 702964604485 state 0x2 ref 0
00000100:00100000:2.0:1789760731.311385:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760731.311540:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520913152
00000100:00100000:0.0:1789760731.311549:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520913152
00000100:00100000:0.0:1789760731.311597:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702934346136 time 702964604485 state 0x0 ref 1
00000100:00100000:0.0:1789760731.311611:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702964864901 time 702964604485 state 0x1 ref 1
00000100:00100000:0.0:1789760731.311641:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702964864901 time 702998323461 state 0x0 ref 1
00000100:00100000:0.0:1789760731.311651:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520913152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760731.311694:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20987904, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:0.0:1789760731.311702:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.311718:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=702s v=(0 0)
00010000:00010000:0.0:1789760731.311722:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760731.311728:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.311742:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760731.343483:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972444 is committed
00002000:00010000:0.0:1789760731.343651:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20987904 -> 20992000
00010000:00010000:0.0:1789760731.343667:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.343681:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.343690:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.343696:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760731.343701:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.343710:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.343730:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.343738:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60befd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20987904->20991999] (req 20987904->20991999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760731.343839:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520913152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32184us (32456us total) trans 4294972444 rc 0/0
00000100:00100000:0.0:1789760731.343850:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5157
00000100:00100000:0.0:1789760731.343860:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702964864901 time 702998323461 state 0x2 ref 0
00000100:00100000:0.0:1789760731.348068:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760731.348146:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520913280
00000100:00100000:1.0:1789760731.348156:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520913280
00000100:00100000:1.0:1789760731.348208:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702964864901 time 702998323461 state 0x0 ref 1
00000100:00100000:1.0:1789760731.348223:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702998583877 time 702998323461 state 0x1 ref 1
00000100:00100000:1.0:1789760731.348248:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702998583877 time 703034931689 state 0x0 ref 1
00000100:00100000:1.0:1789760731.348260:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520913280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760731.348307:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20992000, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:1.0:1789760731.348342:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.348368:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:1.0:1789760731.348372:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760731.348377:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.348391:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760731.387176:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972445 is committed
00002000:00010000:1.0:1789760731.387402:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20992000 -> 20996096
00010000:00010000:1.0:1789760731.387418:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.387436:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.387553:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.387563:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760731.387567:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.387577:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.387596:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.387603:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20992000->20996095] (req 20992000->20996095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760731.387701:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520913280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39436us (39638us total) trans 4294972445 rc 0/0
00000100:00100000:1.0:1789760731.387713:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5158
00000100:00100000:1.0:1789760731.387724:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702998583877 time 703034931689 state 0x2 ref 0
00000100:00100000:1.0:1789760731.391741:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760731.393623:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520913408
00000100:00100000:3.0:1789760731.393639:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520913408
00000100:00100000:3.0:1789760731.393707:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 702998583877 time 703034931689 state 0x0 ref 1
00000100:00100000:3.0:1789760731.393724:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703035192105 time 703034931689 state 0x1 ref 1
00000100:00100000:3.0:1789760731.393762:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703035192105 time 703080444110 state 0x0 ref 1
00000100:00100000:3.0:1789760731.393777:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520913408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760731.393836:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 20996096, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:3.0:1789760731.393846:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.393863:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:3.0:1789760731.393868:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760731.393875:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.393888:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.440659:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972446 is committed
00002000:00010000:1.0:1789760731.440770:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 20996096 -> 21000192
00010000:00010000:1.0:1789760731.440786:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.440799:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.440809:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.440828:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760731.440833:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.440842:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.440861:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.440868:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bf0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [20996096->21000191] (req 20996096->21000191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760731.440965:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520913408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47187us (49229us total) trans 4294972446 rc 0/0
00000100:00100000:1.0:1789760731.440975:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5159
00000100:00100000:1.0:1789760731.440985:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703035192105 time 703080444110 state 0x2 ref 0
00000100:00100000:2.0:1789760731.444669:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760731.444796:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520913536
00000100:00100000:3.0:1789760731.444807:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520913536
00000100:00100000:3.0:1789760731.444875:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703035192105 time 703080444110 state 0x0 ref 1
00000100:00100000:3.0:1789760731.444889:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703080704526 time 703080444110 state 0x1 ref 1
00000100:00100000:3.0:1789760731.444914:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703080704526 time 703131597395 state 0x0 ref 1
00000100:00100000:3.0:1789760731.444926:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520913536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760731.444978:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21000192, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:3.0:1789760731.444987:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.445003:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:3.0:1789760731.445007:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760731.445013:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.445027:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760731.478068:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21000192 -> 21004288
00010000:00010000:0.0:1789760731.478086:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.478098:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.478107:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.478114:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760731.478119:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.478130:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.478149:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.478162:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21000192->21004287] (req 21000192->21004287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760731.478260:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520913536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33331us (33596us total) trans 4294972447 rc 0/0
00000100:00100000:0.0:1789760731.478270:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5160
00000100:00100000:0.0:1789760731.478280:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703080704526 time 703131597395 state 0x2 ref 0
00000001:00080000:2.0:1789760731.481237:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972447 is committed
00000100:00100000:2.0:1789760731.481714:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760731.481809:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520913664
00000100:00100000:0.0:1789760731.481828:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520913664
00000100:00100000:0.0:1789760731.481881:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703080704526 time 703131597395 state 0x0 ref 1
00000100:00100000:0.0:1789760731.481896:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703131857811 time 703131597395 state 0x1 ref 1
00000100:00100000:0.0:1789760731.481946:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703131857811 time 703168628710 state 0x0 ref 1
00000100:00100000:0.0:1789760731.481957:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520913664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760731.482009:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21004288, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:0.0:1789760731.482018:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.482034:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:0.0:1789760731.482039:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760731.482044:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.482062:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.527461:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972448 is committed
00002000:00010000:0.0:1789760731.527673:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21004288 -> 21008384
00010000:00010000:0.0:1789760731.527689:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.527702:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.527710:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.527718:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760731.527723:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.527732:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.527753:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.527761:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21004288->21008383] (req 21004288->21008383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760731.527873:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520913664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45912us (46160us total) trans 4294972448 rc 0/0
00000100:00100000:0.0:1789760731.527885:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5161
00000100:00100000:0.0:1789760731.527895:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703131857811 time 703168628710 state 0x2 ref 0
00000100:00100000:1.0:1789760731.535504:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760731.535592:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520913792
00000100:00100000:0.0:1789760731.535602:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520913792
00000100:00100000:0.0:1789760731.535655:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703131857811 time 703168628710 state 0x0 ref 1
00000100:00100000:0.0:1789760731.535671:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703168889126 time 703168628710 state 0x1 ref 1
00000100:00100000:0.0:1789760731.535705:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703168889126 time 703222387115 state 0x0 ref 1
00000100:00100000:0.0:1789760731.535718:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520913792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760731.535767:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21008384, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:0.0:1789760731.535776:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.535791:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:0.0:1789760731.535795:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760731.535800:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.535823:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.586396:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972449 is committed
00002000:00010000:3.0:1789760731.586725:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21008384 -> 21012480
00010000:00010000:3.0:1789760731.586741:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.586753:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.586762:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.586769:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760731.586773:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.586783:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.586801:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.586809:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60bf20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21008384->21012479] (req 21008384->21012479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760731.586912:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520913792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51191us (51411us total) trans 4294972449 rc 0/0
00000100:00100000:3.0:1789760731.586924:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5162
00000100:00100000:3.0:1789760731.586933:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703168889126 time 703222387115 state 0x2 ref 0
00000100:00100000:2.0:1789760731.590614:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760731.590709:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520913920
00000100:00100000:1.0:1789760731.590719:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520913920
00000100:00100000:1.0:1789760731.590779:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703168889126 time 703222387115 state 0x0 ref 1
00000100:00100000:1.0:1789760731.590795:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703222647531 time 703222387115 state 0x1 ref 1
00000100:00100000:1.0:1789760731.590832:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703222647531 time 703277514582 state 0x0 ref 1
00000100:00100000:1.0:1789760731.590842:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520913920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760731.590891:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21012480, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:1.0:1789760731.590899:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.590914:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:1.0:1789760731.590918:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760731.590923:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.590935:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760731.649394:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21012480 -> 21016576
00010000:00010000:3.0:1789760731.649416:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.649431:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.649439:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.649456:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760731.649461:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.649469:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.649487:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.649495:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21012480->21016575] (req 21012480->21016575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760731.649591:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520913920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58744us (58980us total) trans 4294972450 rc 0/0
00000100:00100000:3.0:1789760731.649601:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5163
00000100:00100000:3.0:1789760731.649610:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703222647531 time 703277514582 state 0x2 ref 0
00000001:00080000:0.0:1789760731.649785:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972450 is committed
00000100:00100000:2.0:1789760731.655085:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760731.655179:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520914048
00000100:00100000:3.0:1789760731.655190:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520914048
00000100:00100000:3.0:1789760731.655244:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703222647531 time 703277514582 state 0x0 ref 1
00000100:00100000:3.0:1789760731.655259:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703277774998 time 703277514582 state 0x1 ref 1
00000100:00100000:3.0:1789760731.655365:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703277774998 time 703342046700 state 0x0 ref 1
00000100:00100000:3.0:1789760731.655379:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520914048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760731.655425:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21016576, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:3.0:1789760731.655434:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.655460:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:3.0:1789760731.655465:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760731.655471:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.655486:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760731.689948:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21016576 -> 21020672
00010000:00010000:0.0:1789760731.689969:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.689983:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.689992:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.689999:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760731.690003:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.690012:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.690031:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.690039:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21016576->21020671] (req 21016576->21020671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760731.690131:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520914048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34750us (35051us total) trans 4294972451 rc 0/0
00000100:00100000:0.0:1789760731.690142:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5164
00000100:00100000:0.0:1789760731.690152:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703277774998 time 703342046700 state 0x2 ref 0
00000001:00080000:2.0:1789760731.690240:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972451 is committed
00000100:00100000:1.0:1789760731.694644:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760731.694742:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520914176
00000100:00100000:2.0:1789760731.694752:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520914176
00000100:00100000:2.0:1789760731.694807:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703277774998 time 703342046700 state 0x0 ref 1
00000100:00100000:2.0:1789760731.694835:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703342307116 time 703342046700 state 0x1 ref 1
00000100:00100000:2.0:1789760731.694863:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703342307116 time 703381546031 state 0x0 ref 1
00000100:00100000:2.0:1789760731.694876:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520914176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760731.694923:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21020672, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:2.0:1789760731.694932:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.694948:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:2.0:1789760731.694952:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760731.694959:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.694973:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.705707:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1789760731.728205:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21020672 -> 21024768
00010000:00010000:0.0:1789760731.728223:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.728237:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.728248:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.728255:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760731.728260:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.728270:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.728290:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.728298:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60bf35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21020672->21024767] (req 21020672->21024767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760731.732069:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520914176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37185us (37424us total) trans 4294972452 rc 0/0
00000100:00100000:0.0:1789760731.732084:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5165
00000100:00100000:0.0:1789760731.732094:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703342307116 time 703381546031 state 0x2 ref 0
00000001:00080000:3.0:1789760731.732209:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972452 is committed
00000100:00100000:3.0:1789760731.737738:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760731.737839:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520914304
00000100:00100000:0.0:1789760731.737849:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520914304
00000100:00100000:0.0:1789760731.737899:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703342307116 time 703381546031 state 0x0 ref 1
00000100:00100000:0.0:1789760731.737915:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703381806447 time 703381546031 state 0x1 ref 1
00000100:00100000:0.0:1789760731.737949:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703381806447 time 703424630869 state 0x0 ref 1
00000100:00100000:0.0:1789760731.737961:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520914304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760731.738005:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21024768, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:0.0:1789760731.738014:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.738030:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:0.0:1789760731.738034:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760731.738040:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.738055:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.791515:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972453 is committed
00002000:00010000:3.0:1789760731.791665:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21024768 -> 21028864
00010000:00010000:3.0:1789760731.791681:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.791694:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.791704:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.791711:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760731.791716:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.791725:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.791745:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.791753:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60bf3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21024768->21028863] (req 21024768->21028863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760731.791860:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520914304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53896us (54126us total) trans 4294972453 rc 0/0
00000100:00100000:3.0:1789760731.791871:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5166
00000100:00100000:3.0:1789760731.791880:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703381806447 time 703424630869 state 0x2 ref 0
00000100:00100000:2.0:1789760731.795553:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760731.795660:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520914432
00000100:00100000:3.0:1789760731.795670:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520914432
00000100:00100000:3.0:1789760731.795726:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703381806447 time 703424630869 state 0x0 ref 1
00000100:00100000:3.0:1789760731.795743:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703424891285 time 703424630869 state 0x1 ref 1
00000100:00100000:0.0:1789760731.795782:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703424891285 time 703482461163 state 0x0 ref 1
00000100:00100000:0.0:1789760731.795798:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520914432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760731.795858:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21028864, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:0.0:1789760731.795868:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.795883:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:0.0:1789760731.795887:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760731.795894:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.795907:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.845198:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972454 is committed
00002000:00010000:3.0:1789760731.845713:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21028864 -> 21032960
00010000:00010000:3.0:1789760731.845728:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.845742:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.845751:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.845758:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760731.845764:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.845773:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.845805:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.845822:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60bf43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21028864->21032959] (req 21028864->21032959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760731.845932:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520914432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50132us (50386us total) trans 4294972454 rc 0/0
00000100:00100000:3.0:1789760731.845943:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5167
00000100:00100000:3.0:1789760731.845953:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703424891285 time 703482461163 state 0x2 ref 0
00000100:00100000:2.0:1789760731.863884:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760731.864066:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520914560
00000100:00100000:3.0:1789760731.864078:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520914560
00000100:00100000:3.0:1789760731.864136:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703424891285 time 703482461163 state 0x0 ref 1
00000100:00100000:3.0:1789760731.864151:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703482721579 time 703482461163 state 0x1 ref 1
00000100:00100000:3.0:1789760731.864190:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703482721579 time 703550872627 state 0x0 ref 1
00000100:00100000:3.0:1789760731.864208:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520914560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760731.864262:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21032960, mtime: 0x6aad94dc, atime: 0x0, ctime: 0x6aad94dc, blocks: 0xa807
00010000:00010000:3.0:1789760731.864272:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.864289:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:3.0:1789760731.864294:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760731.864300:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760731.864446:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.934290:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972455 is committed
00002000:00010000:2.0:1789760731.934386:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21032960 -> 21037056
00002000:00010000:2.0:1789760731.934391:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760732 -> 1789760733
00002000:00010000:2.0:1789760731.934395:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760732 -> 1789760733
00010000:00010000:2.0:1789760731.934409:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.934424:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.934434:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.934442:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760731.934448:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.934458:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.934478:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760731.934486:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60bf4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21032960->21037055] (req 21032960->21037055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760731.934580:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520914560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70374us (70702us total) trans 4294972455 rc 0/0
00000100:00100000:2.0:1789760731.934591:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5168
00000100:00100000:2.0:1789760731.934600:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703482721579 time 703550872627 state 0x2 ref 0
00000100:00100000:2.0:1789760731.940967:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760731.943916:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520914688
00000100:00100000:1.0:1789760731.943935:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520914688
00000100:00100000:1.0:1789760731.944006:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703482721579 time 703550872627 state 0x0 ref 1
00000100:00100000:1.0:1789760731.944026:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703551133043 time 703550872627 state 0x1 ref 1
00000100:00100000:1.0:1789760731.944064:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703551133043 time 703630747310 state 0x0 ref 1
00000100:00100000:1.0:1789760731.944079:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520914688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760731.944134:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21037056, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:1.0:1789760731.944144:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.944162:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:1.0:1789760731.944167:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760731.944174:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.944189:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760731.971535:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972456 is committed
00002000:00010000:1.0:1789760731.971654:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21037056 -> 21041152
00010000:00010000:1.0:1789760731.971669:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.971684:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.971694:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.971708:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760731.971713:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.971722:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.971740:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760731.971749:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21037056->21041151] (req 21037056->21041151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760731.971878:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520914688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27798us (30917us total) trans 4294972456 rc 0/0
00000100:00100000:1.0:1789760731.971890:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5169
00000100:00100000:1.0:1789760731.971899:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703551133043 time 703630747310 state 0x2 ref 0
00000100:00100000:2.0:1789760731.985056:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760731.985149:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520914816
00000100:00100000:0.0:1789760731.985159:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520914816
00000100:00100000:0.0:1789760731.985211:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703551133043 time 703630747310 state 0x0 ref 1
00000100:00100000:0.0:1789760731.985225:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703631007726 time 703630747310 state 0x1 ref 1
00000100:00100000:0.0:1789760731.985637:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703631007726 time 703672317842 state 0x0 ref 1
00000100:00100000:0.0:1789760731.985653:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520914816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760731.985705:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21041152, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:0.0:1789760731.985714:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.985730:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:0.0:1789760731.985734:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760731.985740:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760731.985753:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760732.027382:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21041152 -> 21045248
00010000:00010000:1.0:1789760732.027406:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.027421:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.027437:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.027455:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760732.027460:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.027469:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.027488:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.027496:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60bf58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21041152->21045247] (req 21041152->21045247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760732.027607:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520914816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41952us (42555us total) trans 4294972457 rc 0/0
00000100:00100000:1.0:1789760732.027617:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5170
00000100:00100000:1.0:1789760732.027628:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703631007726 time 703672317842 state 0x2 ref 0
00000001:00080000:2.0:1789760732.030293:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972457 is committed
00000100:00100000:1.0:1789760732.031806:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760732.033654:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520914944
00000100:00100000:3.0:1789760732.033668:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520914944
00000100:00100000:3.0:1789760732.033788:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703631007726 time 703672317842 state 0x0 ref 1
00000100:00100000:3.0:1789760732.033804:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703672578258 time 703672317842 state 0x1 ref 1
00000100:00100000:3.0:1789760732.033840:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703672578258 time 703720522572 state 0x0 ref 1
00000100:00100000:3.0:1789760732.033854:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520914944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760732.033903:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21045248, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:3.0:1789760732.033913:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.033928:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:3.0:1789760732.033933:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760732.033939:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.033952:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760732.035379:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:1.0:1789760732.076348:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972458 is committed
00002000:00010000:2.0:1789760732.076540:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21045248 -> 21049344
00010000:00010000:2.0:1789760732.076556:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.076576:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.076585:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.076594:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.076599:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.076610:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.076631:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.076639:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60bf5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21045248->21049343] (req 21045248->21049343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.076738:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520914944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42882us (44936us total) trans 4294972458 rc 0/0
00000100:00100000:2.0:1789760732.076748:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5171
00000100:00100000:2.0:1789760732.076758:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703672578258 time 703720522572 state 0x2 ref 0
00000100:00100000:0.0:1789760732.081472:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760732.081729:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520915072
00000100:00100000:2.0:1789760732.081740:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520915072
00000100:00100000:2.0:1789760732.081792:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703672578258 time 703720522572 state 0x0 ref 1
00000100:00100000:2.0:1789760732.081807:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703720782988 time 703720522572 state 0x1 ref 1
00000100:00100000:2.0:1789760732.081847:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703720782988 time 703768529467 state 0x0 ref 1
00000100:00100000:2.0:1789760732.081860:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520915072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760732.081920:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21049344, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:2.0:1789760732.081929:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.081945:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:2.0:1789760732.081949:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760732.081955:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.081968:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760732.129674:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21049344 -> 21053440
00010000:00010000:2.0:1789760732.129708:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.129723:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.129737:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.129744:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.129749:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.129758:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.129777:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.129785:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21049344->21053439] (req 21049344->21053439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.129885:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520915072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48022us (48419us total) trans 4294972459 rc 0/0
00000100:00100000:2.0:1789760732.129895:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5172
00000100:00100000:2.0:1789760732.129904:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703720782988 time 703768529467 state 0x2 ref 0
00000001:00080000:1.0:1789760732.130492:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972459 is committed
00000100:00100000:3.0:1789760732.134816:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760732.134953:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520915200
00000100:00100000:1.0:1789760732.134963:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520915200
00000100:00100000:1.0:1789760732.135016:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703720782988 time 703768529467 state 0x0 ref 1
00000100:00100000:1.0:1789760732.135031:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703768789883 time 703768529467 state 0x1 ref 1
00000100:00100000:1.0:1789760732.135060:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703768789883 time 703821743000 state 0x0 ref 1
00000100:00100000:1.0:1789760732.135072:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520915200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760732.135119:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21053440, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:1.0:1789760732.135129:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.135143:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:1.0:1789760732.135148:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760732.135155:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.135168:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760732.181353:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972460 is committed
00002000:00010000:2.0:1789760732.181597:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21053440 -> 21057536
00010000:00010000:2.0:1789760732.181612:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.181630:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.181640:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.181647:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.181652:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.181660:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.181679:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.181686:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21053440->21057535] (req 21053440->21057535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.181824:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520915200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46748us (47020us total) trans 4294972460 rc 0/0
00000100:00100000:2.0:1789760732.181834:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5173
00000100:00100000:2.0:1789760732.181844:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703768789883 time 703821743000 state 0x2 ref 0
00000100:00100000:0.0:1789760732.195901:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760732.196031:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520915328
00000100:00100000:1.0:1789760732.196040:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520915328
00000100:00100000:1.0:1789760732.196097:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703768789883 time 703821743000 state 0x0 ref 1
00000100:00100000:1.0:1789760732.196113:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703822003416 time 703821743000 state 0x1 ref 1
00000100:00100000:1.0:1789760732.196143:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703822003416 time 703882826168 state 0x0 ref 1
00000100:00100000:1.0:1789760732.196158:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520915328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760732.196206:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21057536, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:1.0:1789760732.196215:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.196232:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:1.0:1789760732.196236:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760732.196242:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.196256:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760732.239474:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972461 is committed
00002000:00010000:1.0:1789760732.239642:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21057536 -> 21061632
00010000:00010000:1.0:1789760732.239658:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.239670:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.239678:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.239685:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760732.239690:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.239700:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.239718:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.239726:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21057536->21061631] (req 21057536->21061631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760732.239834:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520915328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43672us (43937us total) trans 4294972461 rc 0/0
00000100:00100000:1.0:1789760732.239851:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5174
00000100:00100000:1.0:1789760732.239864:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703822003416 time 703882826168 state 0x2 ref 0
00000100:00100000:0.0:1789760732.245217:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760732.245433:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520915456
00000100:00100000:2.0:1789760732.245444:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520915456
00000100:00100000:2.0:1789760732.245498:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703822003416 time 703882826168 state 0x0 ref 1
00000100:00100000:2.0:1789760732.245515:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703883086584 time 703882826168 state 0x1 ref 1
00000100:00100000:2.0:1789760732.245546:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703883086584 time 703932228643 state 0x0 ref 1
00000100:00100000:2.0:1789760732.245558:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520915456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760732.245609:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21061632, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:2.0:1789760732.245618:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.245635:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:2.0:1789760732.245641:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760732.245647:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.245662:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760732.281525:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548748544:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760732.281600:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760732.281655:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789760732.281661:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548748416:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760732.281694:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760732.281730:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548748544
00000100:00100000:1.0:1789760732.281738:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548748544
00000100:00100000:1.0:1789760732.281782:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548748416
00000100:00100000:1.0:1789760732.281785:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548748416
00000100:00100000:1.0:1789760732.281801:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352
00000100:00100000:1.0:1789760732.281820:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548748544:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:1.0:1789760732.281855:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760732.281896:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548748544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (295us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760732.281903:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352
00000100:00100000:1.0:1789760732.281918:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353
00000100:00100000:1.0:1789760732.281924:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548748416:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1789760732.281934:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760732.281957:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548748416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (273us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760732.281963:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353
00000100:00100000:1.0:1789760732.282003:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b3d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548748416:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760732.282015:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b3d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548748544:0@lo:13:osp-pre-1-0.0
00000100:00080000:0.0:1789760732.283863:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789760732.286665:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548748672:0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.286750:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760732.286797:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548749184:0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.286835:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760732.286854:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548749696:0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.286879:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760732.286903:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:1.0:1789760732.286909:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548748800:0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.286932:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760732.286952:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548749312:0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.286972:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760732.286990:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda742a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548749824:0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.287010:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760732.287040:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548749184
00000100:00100000:1.0:1789760732.287047:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548749184
00000100:00100000:1.0:1789760732.287089:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419
00000100:00100000:1.0:1789760732.287097:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548749184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.287152:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548749184:12345-0@lo:400:kworker.0 Request processed in 56us (316us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760732.287159:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419
00000100:00100000:1.0:1789760732.287177:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548749696
00000100:00100000:1.0:1789760732.287181:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548749696
00000100:00100000:1.0:1789760732.287205:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278
00000100:00100000:1.0:1789760732.287212:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548749696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.287242:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548749696:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760732.287248:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278
00000100:00100000:1.0:1789760732.287265:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548748800
00000100:00100000:1.0:1789760732.287269:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548748800
00000100:00100000:1.0:1789760732.287291:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548749312
00000100:00100000:1.0:1789760732.287294:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548749312
00000100:00100000:1.0:1789760732.287358:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548749824
00000100:00100000:1.0:1789760732.287362:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548749824
00000100:00100000:1.0:1789760732.287379:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857
00000100:00100000:1.0:1789760732.287385:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548748800:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.287417:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548748800:12345-0@lo:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760732.287424:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857
00000100:00100000:1.0:1789760732.287435:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858
00000100:00100000:1.0:1789760732.287441:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548749312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.287468:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548749312:12345-0@lo:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760732.287473:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858
00000100:00100000:1.0:1789760732.287500:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859
00000100:00100000:1.0:1789760732.287508:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548749824:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.287654:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548748928:0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.287687:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760732.287711:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3453:1876699548749440:0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.287733:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760732.287744:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7428e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3453:1876699548749952:0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.287962:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548748672
00000100:00100000:2.0:1789760732.287968:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548748672
00000100:00100000:2.0:1789760732.288000:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467
00000100:00100000:2.0:1789760732.288007:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548748672:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.288057:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548748672:12345-0@lo:400:kworker.0 Request processed in 51us (1308us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760732.288063:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467
00000100:00100000:0.0:1789760732.288098:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760732.288119:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0]
00000100:00100000:0.0:1789760732.288126:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548749056:0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288147:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760732.288159:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548749568:0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288178:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760732.288221:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548749440
00000100:00100000:0.0:1789760732.288226:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548749440
00000100:00100000:0.0:1789760732.288245:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548749952
00000100:00100000:0.0:1789760732.288248:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548749952
00000100:00100000:0.0:1789760732.288258:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548749056
00000100:00100000:0.0:1789760732.288260:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548749056
00000100:00100000:0.0:1789760732.288272:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860
00000100:00100000:0.0:1789760732.288278:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876699548749440:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288340:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876699548749440:12345-0@lo:400:kworker.0 Request processed in 61us (605us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760732.288346:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860
00000100:00100000:0.0:1789760732.288358:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861
00000100:00100000:0.0:1789760732.288364:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876699548749952:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288390:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876699548749952:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760732.288395:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861
00000100:00100000:0.0:1789760732.288405:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862
00000100:00100000:0.0:1789760732.288412:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548749056:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.288436:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548749568
00000100:00100000:2.0:1789760732.288441:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548749568
00000100:00100000:0.0:1789760732.288443:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548749056:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760732.288451:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862
00000100:00100000:0.0:1789760732.288472:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548748928
00000100:00100000:0.0:1789760732.288477:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548748928
00000100:00100000:2.0:1789760732.288481:0:9637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279
00000100:00100000:2.0:1789760732.288498:0:9637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548749568:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288507:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420
00000100:00100000:0.0:1789760732.288518:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548748928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.288663:0:9637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548749568:12345-0@lo:400:kworker.0 Request processed in 43us (359us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760732.288670:0:9637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279
00000100:00100000:0.0:1789760732.288698:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548748928:12345-0@lo:400:kworker.0 Request processed in 182us (1009us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760732.288707:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420
00000100:00100000:0.0:1789760732.288745:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548749056:0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288756:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548749568:0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288765:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548748928:0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288833:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3453:1876699548749440:0@lo:400:kworker.0
00000100:00100000:0.0:1789760732.288848:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7428e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3453:1876699548749952:0@lo:400:kworker.0
00000100:00080000:0.0:1789760732.289462:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1789760732.289468:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:2.0:1789760732.290139:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548748800:0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.290155:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548749312:0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.290167:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda742a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548749824:0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.290177:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548748672:0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.290187:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548749184:0@lo:400:kworker.0
00000100:00100000:2.0:1789760732.290198:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548749696:0@lo:400:kworker.0
00000100:00100000:1.0:1789760732.290656:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548749824:12345-0@lo:400:kworker.0 Request processed in 30us (526us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760732.290669:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859
00000001:00080000:3.0:1789760732.306495:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972462 is committed
00002000:00010000:1.0:1789760732.306881:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21061632 -> 21065728
00010000:00010000:1.0:1789760732.306898:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.306912:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.306921:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.306929:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760732.306934:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.306943:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.306962:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.306970:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60bf7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21061632->21065727] (req 21061632->21065727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760732.307075:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520915456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61513us (61861us total) trans 4294972462 rc 0/0
00000100:00100000:1.0:1789760732.307085:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5175
00000100:00100000:1.0:1789760732.307095:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703883086584 time 703932228643 state 0x2 ref 0
00000100:00100000:0.0:1789760732.310492:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760732.311001:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520915584
00000100:00100000:2.0:1789760732.311013:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520915584
00000100:00100000:2.0:1789760732.311067:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703883086584 time 703932228643 state 0x0 ref 1
00000100:00100000:2.0:1789760732.311083:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703932489059 time 703932228643 state 0x1 ref 1
00000100:00100000:2.0:1789760732.311153:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703932489059 time 703997834167 state 0x0 ref 1
00000100:00100000:2.0:1789760732.311166:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520915584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760732.311212:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21065728, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:2.0:1789760732.311221:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.311237:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=703s v=(0 0)
00010000:00010000:2.0:1789760732.311241:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760732.311248:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.311261:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760732.357053:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21065728 -> 21069824
00010000:00010000:3.0:1789760732.357074:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.357091:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.357100:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.357107:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760732.357112:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.357121:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.357142:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.357151:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60bf82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21065728->21069823] (req 21065728->21069823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760732.357249:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520915584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46081us (46766us total) trans 4294972463 rc 0/0
00000100:00100000:3.0:1789760732.357264:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5176
00000100:00100000:3.0:1789760732.357274:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703932489059 time 703997834167 state 0x2 ref 0
00000001:00080000:3.0:1789760732.357919:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972463 is committed
00000100:00100000:2.0:1789760732.365794:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760732.365908:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520915712
00000100:00100000:1.0:1789760732.365917:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520915712
00000100:00100000:1.0:1789760732.365969:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703932489059 time 703997834167 state 0x0 ref 1
00000100:00100000:1.0:1789760732.365984:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703998094583 time 703997834167 state 0x1 ref 1
00000100:00100000:1.0:1789760732.366044:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703998094583 time 704052726298 state 0x0 ref 1
00000100:00100000:1.0:1789760732.366057:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520915712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760732.366106:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21069824, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:1.0:1789760732.366116:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.366132:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:1.0:1789760732.366137:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760732.366143:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.366162:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760732.404194:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21069824 -> 21073920
00010000:00010000:2.0:1789760732.404215:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.404229:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.404238:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.404246:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.404250:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.404258:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.404282:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.404290:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60bf89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21069824->21073919] (req 21069824->21073919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.404427:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520915712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38366us (38637us total) trans 4294972464 rc 0/0
00000100:00100000:2.0:1789760732.404438:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5177
00000100:00100000:2.0:1789760732.404448:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703998094583 time 704052726298 state 0x2 ref 0
00000001:00080000:3.0:1789760732.407473:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972464 is committed
00000100:00100000:2.0:1789760732.408247:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760732.408360:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520915840
00000100:00100000:1.0:1789760732.408369:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520915840
00000100:00100000:1.0:1789760732.408423:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 703998094583 time 704052726298 state 0x0 ref 1
00000100:00100000:1.0:1789760732.408438:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704052986714 time 704052726298 state 0x1 ref 1
00000100:00100000:1.0:1789760732.408472:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704052986714 time 704095154981 state 0x0 ref 1
00000100:00100000:1.0:1789760732.408485:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520915840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760732.408533:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21073920, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:1.0:1789760732.408736:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.408752:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:1.0:1789760732.408757:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760732.408763:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.408777:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760732.455221:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972465 is committed
00002000:00010000:1.0:1789760732.455373:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21073920 -> 21078016
00010000:00010000:1.0:1789760732.455390:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.455403:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.455411:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.455418:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760732.455422:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.455430:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.455457:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.455465:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bf90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21073920->21078015] (req 21073920->21078015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760732.455699:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520915840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47212us (47453us total) trans 4294972465 rc 0/0
00000100:00100000:1.0:1789760732.455709:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5178
00000100:00100000:1.0:1789760732.455717:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704052986714 time 704095154981 state 0x2 ref 0
00000100:00100000:2.0:1789760732.460372:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760732.460700:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520915968
00000100:00100000:1.0:1789760732.460711:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520915968
00000100:00100000:1.0:1789760732.460759:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704052986714 time 704095154981 state 0x0 ref 1
00000100:00100000:1.0:1789760732.460773:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704095415397 time 704095154981 state 0x1 ref 1
00000100:00100000:1.0:1789760732.460801:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704095415397 time 704147484343 state 0x0 ref 1
00000100:00100000:1.0:1789760732.460824:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520915968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760732.461012:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21078016, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:1.0:1789760732.461022:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.461037:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:1.0:1789760732.461041:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760732.461048:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.461061:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760732.496419:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972466 is committed
00002000:00010000:2.0:1789760732.496456:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21078016 -> 21082112
00010000:00010000:2.0:1789760732.496471:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.496540:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.496551:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.496557:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.496563:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.496572:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.496592:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.496600:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60bf97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21078016->21082111] (req 21078016->21082111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.496694:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520915968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35867us (36326us total) trans 4294972466 rc 0/0
00000100:00100000:2.0:1789760732.496705:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5179
00000100:00100000:2.0:1789760732.496714:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704095415397 time 704147484343 state 0x2 ref 0
00000100:00100000:2.0:1789760732.500289:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760732.500738:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520916096
00000100:00100000:3.0:1789760732.500750:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520916096
00000100:00100000:3.0:1789760732.500832:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704095415397 time 704147484343 state 0x0 ref 1
00000100:00100000:3.0:1789760732.500866:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704147744759 time 704147484343 state 0x1 ref 1
00000100:00100000:3.0:1789760732.500897:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704147744759 time 704187578907 state 0x0 ref 1
00000100:00100000:3.0:1789760732.500910:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520916096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760732.500956:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21082112, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:3.0:1789760732.500966:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.500982:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:3.0:1789760732.500986:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760732.500993:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.501006:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760732.554632:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972467 is committed
00002000:00010000:1.0:1789760732.554800:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21082112 -> 21086208
00010000:00010000:1.0:1789760732.554826:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.554839:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.554849:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.554858:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760732.554863:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.554872:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.554890:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.554899:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60bf9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21082112->21086207] (req 21082112->21086207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760732.555018:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520916096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54105us (54732us total) trans 4294972467 rc 0/0
00000100:00100000:1.0:1789760732.555028:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5180
00000100:00100000:1.0:1789760732.555036:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704147744759 time 704187578907 state 0x2 ref 0
00000100:00100000:0.0:1789760732.559906:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760732.559990:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520916224
00000100:00100000:2.0:1789760732.560000:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520916224
00000100:00100000:2.0:1789760732.560056:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704147744759 time 704187578907 state 0x0 ref 1
00000100:00100000:2.0:1789760732.560071:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704187839323 time 704187578907 state 0x1 ref 1
00000100:00100000:2.0:1789760732.560103:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704187839323 time 704246786249 state 0x0 ref 1
00000100:00100000:2.0:1789760732.560116:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520916224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760732.560164:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21086208, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:2.0:1789760732.560173:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.560189:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:2.0:1789760732.560193:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760732.560199:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.560211:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760732.590846:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21086208 -> 21090304
00010000:00010000:2.0:1789760732.590869:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.590881:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.590890:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.590898:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.590902:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.590911:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.590930:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.590938:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfa5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21086208->21090303] (req 21086208->21090303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.591031:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520916224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30913us (31129us total) trans 4294972468 rc 0/0
00000100:00100000:2.0:1789760732.591042:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5181
00000100:00100000:2.0:1789760732.591052:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704187839323 time 704246786249 state 0x2 ref 0
00000001:00080000:1.0:1789760732.591129:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972468 is committed
00000100:00100000:2.0:1789760732.595224:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760732.595643:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520916352
00000100:00100000:1.0:1789760732.595656:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520916352
00000100:00100000:1.0:1789760732.595716:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704187839323 time 704246786249 state 0x0 ref 1
00000100:00100000:1.0:1789760732.595737:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704247046665 time 704246786249 state 0x1 ref 1
00000100:00100000:1.0:1789760732.595772:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704247046665 time 704282454664 state 0x0 ref 1
00000100:00100000:1.0:1789760732.595795:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520916352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760732.595850:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21090304, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:1.0:1789760732.595859:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.595875:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:1.0:1789760732.595880:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760732.595886:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.595901:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760732.650098:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972469 is committed
00002000:00010000:2.0:1789760732.650154:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21090304 -> 21094400
00010000:00010000:2.0:1789760732.650172:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.650187:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.650196:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.650204:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.650209:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.650224:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.650244:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.650252:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60bfac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21090304->21094399] (req 21090304->21094399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.650657:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520916352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54859us (55437us total) trans 4294972469 rc 0/0
00000100:00100000:2.0:1789760732.650669:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5182
00000100:00100000:2.0:1789760732.650679:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704247046665 time 704282454664 state 0x2 ref 0
00000100:00100000:0.0:1789760732.660084:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760732.661375:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520916480
00000100:00100000:1.0:1789760732.661388:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520916480
00000100:00100000:1.0:1789760732.661451:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704247046665 time 704282454664 state 0x0 ref 1
00000100:00100000:1.0:1789760732.661466:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704282715080 time 704282454664 state 0x1 ref 1
00000100:00100000:1.0:1789760732.661505:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704282715080 time 704348187364 state 0x0 ref 1
00000100:00100000:1.0:1789760732.661518:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520916480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760732.662741:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21094400, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:1.0:1789760732.662758:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.662781:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:1.0:1789760732.662787:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760732.662794:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760732.662816:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760732.723445:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972470 is committed
00002000:00010000:2.0:1789760732.723594:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21094400 -> 21098496
00010000:00010000:2.0:1789760732.723613:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.723625:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.723633:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.723641:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.723646:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.723656:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.723674:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.723751:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60bfb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21094400->21098495] (req 21094400->21098495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.723891:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520916480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62372us (63813us total) trans 4294972470 rc 0/0
00000100:00100000:2.0:1789760732.723902:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5183
00000100:00100000:2.0:1789760732.723912:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704282715080 time 704348187364 state 0x2 ref 0
00000100:00100000:1.0:1789760732.727817:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760732.727942:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520916608
00000100:00100000:3.0:1789760732.727952:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520916608
00000100:00100000:3.0:1789760732.728006:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704282715080 time 704348187364 state 0x0 ref 1
00000100:00100000:3.0:1789760732.728022:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704348447780 time 704348187364 state 0x1 ref 1
00000100:00100000:3.0:1789760732.728047:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704348447780 time 704414730004 state 0x0 ref 1
00000100:00100000:3.0:1789760732.728059:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520916608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760732.728107:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21098496, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:3.0:1789760732.728117:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.728132:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:3.0:1789760732.728137:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760732.728144:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.728157:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.733000:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760732.780616:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972471 is committed
00002000:00010000:2.0:1789760732.780876:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21098496 -> 21102592
00010000:00010000:2.0:1789760732.780892:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.780904:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.780912:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.780925:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.780929:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.780939:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.780957:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.780965:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60bfba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21098496->21102591] (req 21098496->21102591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.781065:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520916608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53002us (53260us total) trans 4294972471 rc 0/0
00000100:00100000:2.0:1789760732.781075:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5184
00000100:00100000:2.0:1789760732.781085:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704348447780 time 704414730004 state 0x2 ref 0
00000100:00100000:0.0:1789760732.785560:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760732.785609:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520916736
00000100:00100000:2.0:1789760732.785620:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520916736
00000100:00100000:2.0:1789760732.785671:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704348447780 time 704414730004 state 0x0 ref 1
00000100:00100000:2.0:1789760732.785687:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704414990420 time 704414730004 state 0x1 ref 1
00000100:00100000:2.0:1789760732.785721:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704414990420 time 704472403536 state 0x0 ref 1
00000100:00100000:2.0:1789760732.785736:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520916736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760732.785783:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21102592, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:2.0:1789760732.785792:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.785819:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:2.0:1789760732.785824:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760732.785831:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.785845:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760732.828780:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21102592 -> 21106688
00010000:00010000:2.0:1789760732.828812:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.828826:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.828835:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.828978:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.828983:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.828993:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.829013:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.829020:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21102592->21106687] (req 21102592->21106687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.829222:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520916736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43482us (43665us total) trans 4294972472 rc 0/0
00000100:00100000:2.0:1789760732.829232:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5185
00000100:00100000:2.0:1789760732.829241:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704414990420 time 704472403536 state 0x2 ref 0
00000001:00080000:1.0:1789760732.829385:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972472 is committed
00000100:00100000:0.0:1789760732.836001:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760732.836195:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520916864
00000100:00100000:2.0:1789760732.836206:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520916864
00000100:00100000:2.0:1789760732.836264:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704414990420 time 704472403536 state 0x0 ref 1
00000100:00100000:2.0:1789760732.836278:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704472663952 time 704472403536 state 0x1 ref 1
00000100:00100000:2.0:1789760732.836581:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704472663952 time 704523261872 state 0x0 ref 1
00000100:00100000:2.0:1789760732.836596:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520916864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760732.836647:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21106688, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:2.0:1789760732.836656:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.836673:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:2.0:1789760732.836677:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760732.836684:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.836697:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760732.904625:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972473 is committed
00002000:00010000:2.0:1789760732.904733:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21106688 -> 21110784
00010000:00010000:2.0:1789760732.904750:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.904763:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.904771:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.904778:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760732.904783:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.904792:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.904821:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.904831:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21106688->21110783] (req 21106688->21110783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760732.904920:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520916864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68323us (68927us total) trans 4294972473 rc 0/0
00000100:00100000:2.0:1789760732.904930:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5186
00000100:00100000:2.0:1789760732.904939:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704472663952 time 704523261872 state 0x2 ref 0
00000100:00100000:0.0:1789760732.915276:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760732.915921:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520916992
00000100:00100000:2.0:1789760732.915931:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520916992
00000100:00100000:2.0:1789760732.915983:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704472663952 time 704523261872 state 0x0 ref 1
00000100:00100000:2.0:1789760732.915997:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704523522288 time 704523261872 state 0x1 ref 1
00000100:00100000:2.0:1789760732.916031:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704523522288 time 704602714084 state 0x0 ref 1
00000100:00100000:2.0:1789760732.916044:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520916992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760732.916094:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21110784, mtime: 0x6aad94dd, atime: 0x0, ctime: 0x6aad94dd, blocks: 0xa807
00010000:00010000:2.0:1789760732.916102:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.916119:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:2.0:1789760732.916123:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760732.916129:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760732.916147:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760732.947559:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972474 is committed
00002000:00010000:0.0:1789760732.947647:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21110784 -> 21114880
00002000:00010000:0.0:1789760732.947652:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760733 -> 1789760734
00002000:00010000:0.0:1789760732.947654:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760733 -> 1789760734
00010000:00010000:0.0:1789760732.947665:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760732.947679:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760732.947686:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760732.947690:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760732.947693:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760732.947700:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760732.947715:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760732.947719:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60bfcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21110784->21114879] (req 21110784->21114879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760732.947843:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520916992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31796us (32570us total) trans 4294972474 rc 0/0
00000100:00100000:0.0:1789760732.947854:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5187
00000100:00100000:0.0:1789760732.947864:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704523522288 time 704602714084 state 0x2 ref 0
00000100:00100000:1.0:1789760732.951066:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760732.951432:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520917120
00000100:00100000:3.0:1789760732.951450:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520917120
00000100:00100000:3.0:1789760732.951503:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704523522288 time 704602714084 state 0x0 ref 1
00000100:00100000:3.0:1789760732.951521:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704602974500 time 704602714084 state 0x1 ref 1
00000100:00100000:3.0:1789760732.951553:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704602974500 time 704638236004 state 0x0 ref 1
00000100:00100000:3.0:1789760732.951565:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520917120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760732.951609:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21114880, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:3.0:1789760732.951618:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.951634:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:3.0:1789760732.951638:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760732.951645:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760732.951658:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760733.012114:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972475 is committed
00002000:00010000:2.0:1789760733.012201:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21114880 -> 21118976
00010000:00010000:2.0:1789760733.012217:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.012231:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.012241:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.012249:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760733.012254:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.012263:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.012281:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.012289:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60bfd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21114880->21118975] (req 21114880->21118975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760733.012636:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520917120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61066us (61572us total) trans 4294972475 rc 0/0
00000100:00100000:2.0:1789760733.012646:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5188
00000100:00100000:2.0:1789760733.012656:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704602974500 time 704638236004 state 0x2 ref 0
00000100:00100000:2.0:1789760733.016959:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760733.017055:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520917248
00000100:00100000:1.0:1789760733.017067:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520917248
00000100:00100000:1.0:1789760733.017120:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704602974500 time 704638236004 state 0x0 ref 1
00000100:00100000:1.0:1789760733.017136:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704638496420 time 704638236004 state 0x1 ref 1
00000100:00100000:1.0:1789760733.017163:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704638496420 time 704703845982 state 0x0 ref 1
00000100:00100000:1.0:1789760733.017176:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520917248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760733.017227:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21118976, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:1.0:1789760733.017236:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.017252:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:1.0:1789760733.017256:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760733.017262:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.017274:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760733.055234:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972476 is committed
00002000:00010000:0.0:1789760733.055596:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21118976 -> 21123072
00010000:00010000:0.0:1789760733.055613:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.055626:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.055635:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.055643:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760733.055648:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.055657:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.055679:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.055686:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60bfdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21118976->21123071] (req 21118976->21123071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760733.055829:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520917248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38651us (38875us total) trans 4294972476 rc 0/0
00000100:00100000:0.0:1789760733.055841:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5189
00000100:00100000:0.0:1789760733.055850:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704638496420 time 704703845982 state 0x2 ref 0
00000100:00100000:0.0:1789760733.065057:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760733.065162:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520917376
00000100:00100000:2.0:1789760733.065173:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520917376
00000100:00100000:2.0:1789760733.065228:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704638496420 time 704703845982 state 0x0 ref 1
00000100:00100000:2.0:1789760733.065243:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704704106398 time 704703845982 state 0x1 ref 1
00000100:00100000:2.0:1789760733.065277:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704704106398 time 704751959892 state 0x0 ref 1
00000100:00100000:2.0:1789760733.065289:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520917376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760733.065383:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21123072, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:2.0:1789760733.065393:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.065408:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:2.0:1789760733.065413:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760733.065420:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.065433:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760733.096644:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972477 is committed
00002000:00010000:2.0:1789760733.096759:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21123072 -> 21127168
00010000:00010000:2.0:1789760733.096776:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.096789:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.096799:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.096817:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760733.096822:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.096830:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.096849:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.096857:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bfe4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21123072->21127167] (req 21123072->21127167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760733.096954:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520917376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31661us (31902us total) trans 4294972477 rc 0/0
00000100:00100000:2.0:1789760733.096969:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5190
00000100:00100000:2.0:1789760733.096979:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704704106398 time 704751959892 state 0x2 ref 0
00000100:00100000:1.0:1789760733.102068:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760733.102159:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520917504
00000100:00100000:0.0:1789760733.102170:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520917504
00000100:00100000:0.0:1789760733.102227:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704704106398 time 704751959892 state 0x0 ref 1
00000100:00100000:0.0:1789760733.102243:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704752220308 time 704751959892 state 0x1 ref 1
00000100:00100000:0.0:1789760733.102309:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704752220308 time 704788991222 state 0x0 ref 1
00000100:00100000:0.0:1789760733.102364:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520917504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760733.102413:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21127168, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:0.0:1789760733.102435:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.102452:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:0.0:1789760733.102456:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760733.102463:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.102477:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760733.140605:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21127168 -> 21131264
00010000:00010000:1.0:1789760733.140625:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.140638:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.140647:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.140655:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760733.140659:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.140672:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.140691:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.140698:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60bfeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21127168->21131263] (req 21127168->21131263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760733.140786:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520917504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38421us (38723us total) trans 4294972478 rc 0/0
00000100:00100000:1.0:1789760733.140798:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5191
00000100:00100000:1.0:1789760733.140815:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704752220308 time 704788991222 state 0x2 ref 0
00000001:00080000:3.0:1789760733.141073:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972478 is committed
00000100:00100000:3.0:1789760733.145204:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760733.145346:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520917632
00000100:00100000:2.0:1789760733.145357:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520917632
00000100:00100000:2.0:1789760733.145412:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704752220308 time 704788991222 state 0x0 ref 1
00000100:00100000:2.0:1789760733.145427:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704789251638 time 704788991222 state 0x1 ref 1
00000100:00100000:2.0:1789760733.145461:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704789251638 time 704832143685 state 0x0 ref 1
00000100:00100000:2.0:1789760733.145473:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520917632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760733.145520:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21131264, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:2.0:1789760733.145529:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.145544:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:2.0:1789760733.145549:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760733.145555:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.145569:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760733.184098:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972479 is committed
00002000:00010000:3.0:1789760733.184297:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21131264 -> 21135360
00010000:00010000:3.0:1789760733.184396:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.184410:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.184424:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.184432:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760733.184436:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.184446:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.184465:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.184473:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60bff2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21131264->21135359] (req 21131264->21135359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760733.184548:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520917632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39073us (39348us total) trans 4294972479 rc 0/0
00000100:00100000:3.0:1789760733.184558:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5192
00000100:00100000:3.0:1789760733.184567:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704789251638 time 704832143685 state 0x2 ref 0
00000100:00100000:0.0:1789760733.191954:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760733.192038:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520917760
00000100:00100000:2.0:1789760733.192048:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520917760
00000100:00100000:2.0:1789760733.192101:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704789251638 time 704832143685 state 0x0 ref 1
00000100:00100000:2.0:1789760733.192117:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704832404101 time 704832143685 state 0x1 ref 1
00000100:00100000:2.0:1789760733.192139:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704832404101 time 704878821782 state 0x0 ref 1
00000100:00100000:2.0:1789760733.192152:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520917760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760733.192206:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21135360, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:2.0:1789760733.192216:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.192232:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:2.0:1789760733.192236:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760733.192243:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.192258:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760733.236035:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972480 is committed
00002000:00010000:2.0:1789760733.238412:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21135360 -> 21139456
00010000:00010000:2.0:1789760733.238433:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.238446:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.238455:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.238463:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760733.238468:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.238477:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.238497:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.238505:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60bff9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21135360->21139455] (req 21135360->21139455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760733.238609:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520917760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46455us (46660us total) trans 4294972480 rc 0/0
00000100:00100000:2.0:1789760733.238620:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5193
00000100:00100000:2.0:1789760733.238628:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704832404101 time 704878821782 state 0x2 ref 0
00000100:00100000:1.0:1789760733.245237:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760733.248023:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520917888
00000100:00100000:0.0:1789760733.248038:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520917888
00000100:00100000:0.0:1789760733.248098:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704832404101 time 704878821782 state 0x0 ref 1
00000100:00100000:0.0:1789760733.248116:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704879082198 time 704878821782 state 0x1 ref 1
00000100:00100000:0.0:1789760733.248150:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704879082198 time 704934832175 state 0x0 ref 1
00000100:00100000:0.0:1789760733.248162:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520917888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760733.248266:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21139456, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:1.0:1789760733.248279:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.248311:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=704s v=(0 0)
00010000:00010000:1.0:1789760733.248719:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760733.248727:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.248742:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760733.343545:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972481 is committed
00002000:00010000:1.0:1789760733.343699:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21139456 -> 21143552
00010000:00010000:1.0:1789760733.343714:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.343728:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.343738:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.343746:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760733.343751:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.343760:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.343781:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.343788:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c000 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21139456->21143551] (req 21139456->21143551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760733.343893:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520917888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 95728us (98660us total) trans 4294972481 rc 0/0
00000100:00100000:1.0:1789760733.343907:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5194
00000100:00100000:1.0:1789760733.343917:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704879082198 time 704934832175 state 0x2 ref 0
00000100:00100000:3.0:1789760733.348020:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760733.349092:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520918016
00000100:00100000:1.0:1789760733.349103:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520918016
00000100:00100000:1.0:1789760733.349153:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704879082198 time 704934832175 state 0x0 ref 1
00000100:00100000:1.0:1789760733.349170:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704935092591 time 704934832175 state 0x1 ref 1
00000100:00100000:1.0:1789760733.349201:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704935092591 time 705035883839 state 0x0 ref 1
00000100:00100000:1.0:1789760733.349213:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520918016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760733.349258:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21143552, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:1.0:1789760733.349267:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.349282:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:1.0:1789760733.349286:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760733.349292:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.349306:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760733.411615:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21143552 -> 21147648
00010000:00010000:1.0:1789760733.411635:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.411650:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.411660:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.411667:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760733.411672:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.411680:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.411699:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.411707:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c007 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21143552->21147647] (req 21143552->21147647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760733.411834:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520918016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62613us (63814us total) trans 4294972482 rc 0/0
00000100:00100000:1.0:1789760733.411845:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5195
00000100:00100000:1.0:1789760733.411855:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704935092591 time 705035883839 state 0x2 ref 0
00000001:00080000:2.0:1789760733.411978:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972482 is committed
00000100:00100000:2.0:1789760733.416113:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760733.416193:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520918144
00000100:00100000:3.0:1789760733.416203:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520918144
00000100:00100000:3.0:1789760733.416257:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 704935092591 time 705035883839 state 0x0 ref 1
00000100:00100000:3.0:1789760733.416273:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705036144255 time 705035883839 state 0x1 ref 1
00000100:00100000:3.0:1789760733.416364:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705036144255 time 705103046352 state 0x0 ref 1
00000100:00100000:3.0:1789760733.416377:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520918144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760733.416421:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21147648, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:3.0:1789760733.416530:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.416546:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:3.0:1789760733.416551:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760733.416558:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.416572:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760733.467702:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972483 is committed
00002000:00010000:3.0:1789760733.468168:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21147648 -> 21151744
00010000:00010000:3.0:1789760733.468183:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.468196:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.468213:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.468221:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760733.468226:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.468235:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.468255:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.468264:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c00e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21147648->21151743] (req 21147648->21151743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760733.468523:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520918144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52141us (52413us total) trans 4294972483 rc 0/0
00000100:00100000:3.0:1789760733.468534:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5196
00000100:00100000:3.0:1789760733.468546:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705036144255 time 705103046352 state 0x2 ref 0
00000100:00100000:0.0:1789760733.472157:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760733.472275:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520918272
00000100:00100000:3.0:1789760733.472285:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520918272
00000100:00100000:3.0:1789760733.472364:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705036144255 time 705103046352 state 0x0 ref 1
00000100:00100000:3.0:1789760733.472379:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705103306768 time 705103046352 state 0x1 ref 1
00000100:00100000:3.0:1789760733.472409:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705103306768 time 705159091824 state 0x0 ref 1
00000100:00100000:3.0:1789760733.472422:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520918272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760733.472623:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21151744, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:3.0:1789760733.472632:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.472648:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:3.0:1789760733.472652:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760733.472658:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.472670:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760733.505069:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972484 is committed
00002000:00010000:3.0:1789760733.506397:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21151744 -> 21155840
00010000:00010000:3.0:1789760733.506416:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.506441:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.506451:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.506459:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760733.506465:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.506473:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.506493:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.506502:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c015 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21151744->21155839] (req 21151744->21155839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760733.506605:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520918272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34180us (34451us total) trans 4294972484 rc 0/0
00000100:00100000:3.0:1789760733.506616:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5197
00000100:00100000:3.0:1789760733.506625:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705103306768 time 705159091824 state 0x2 ref 0
00000100:00100000:0.0:1789760733.513909:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760733.514066:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520918400
00000100:00100000:1.0:1789760733.514076:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520918400
00000100:00100000:1.0:1789760733.514128:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705103306768 time 705159091824 state 0x0 ref 1
00000100:00100000:1.0:1789760733.514143:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705159352240 time 705159091824 state 0x1 ref 1
00000100:00100000:1.0:1789760733.514228:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705159352240 time 705200908713 state 0x0 ref 1
00000100:00100000:1.0:1789760733.514241:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520918400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760733.514287:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21155840, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:1.0:1789760733.514296:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.514348:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:1.0:1789760733.514354:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760733.514359:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.514373:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760733.560970:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972485 is committed
00002000:00010000:3.0:1789760733.561165:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21155840 -> 21159936
00010000:00010000:3.0:1789760733.561183:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.561197:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.561206:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.561219:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760733.561225:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.561234:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.561254:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.561261:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c01c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21155840->21159935] (req 21155840->21159935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760733.561416:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520918400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47173us (47511us total) trans 4294972485 rc 0/0
00000100:00100000:3.0:1789760733.561427:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5198
00000100:00100000:3.0:1789760733.561436:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705159352240 time 705200908713 state 0x2 ref 0
00000100:00100000:2.0:1789760733.566467:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760733.568451:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520918528
00000100:00100000:0.0:1789760733.568464:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520918528
00000100:00100000:0.0:1789760733.568858:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705159352240 time 705200908713 state 0x0 ref 1
00000100:00100000:0.0:1789760733.568874:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705201169129 time 705200908713 state 0x1 ref 1
00000100:00100000:0.0:1789760733.568910:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705201169129 time 705255591889 state 0x0 ref 1
00000100:00100000:0.0:1789760733.568923:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520918528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760733.568975:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21159936, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:0.0:1789760733.568986:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.569003:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:0.0:1789760733.569008:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760733.569014:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.569035:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760733.622952:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972486 is committed
00002000:00010000:3.0:1789760733.623054:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21159936 -> 21164032
00010000:00010000:3.0:1789760733.623080:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.623094:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.623109:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.623118:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760733.623123:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.623133:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.623161:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.623171:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c023 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21159936->21164031] (req 21159936->21164031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760733.623402:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520918528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54476us (56938us total) trans 4294972486 rc 0/0
00000100:00100000:3.0:1789760733.623413:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5199
00000100:00100000:3.0:1789760733.623422:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705201169129 time 705255591889 state 0x2 ref 0
00000100:00100000:0.0:1789760733.627877:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760733.629127:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520918656
00000100:00100000:3.0:1789760733.629139:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520918656
00000100:00100000:3.0:1789760733.629384:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705201169129 time 705255591889 state 0x0 ref 1
00000100:00100000:3.0:1789760733.629400:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705255852305 time 705255591889 state 0x1 ref 1
00000100:00100000:3.0:1789760733.629436:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705255852305 time 705316118105 state 0x0 ref 1
00000100:00100000:3.0:1789760733.629449:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520918656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760733.629498:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21164032, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:3.0:1789760733.629508:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.629534:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:3.0:1789760733.629538:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760733.629545:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.629559:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760733.669560:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972487 is committed
00002000:00010000:2.0:1789760733.669853:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21164032 -> 21168128
00010000:00010000:2.0:1789760733.669867:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.669880:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.669890:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.669898:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760733.669902:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.669910:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.669927:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.669934:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c02a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21164032->21168127] (req 21164032->21168127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760733.670026:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520918656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40575us (42153us total) trans 4294972487 rc 0/0
00000100:00100000:2.0:1789760733.670039:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5200
00000100:00100000:2.0:1789760733.670049:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705255852305 time 705316118105 state 0x2 ref 0
00000100:00100000:3.0:1789760733.677430:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760733.677580:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520918784
00000100:00100000:0.0:1789760733.677593:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520918784
00000100:00100000:0.0:1789760733.677651:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705255852305 time 705316118105 state 0x0 ref 1
00000100:00100000:0.0:1789760733.677665:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705316378521 time 705316118105 state 0x1 ref 1
00000100:00100000:0.0:1789760733.677693:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705316378521 time 705364376125 state 0x0 ref 1
00000100:00100000:0.0:1789760733.677705:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520918784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760733.677760:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21168128, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:0.0:1789760733.677769:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.677786:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:0.0:1789760733.677790:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760733.677806:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.677821:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760733.740665:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972488 is committed
00002000:00010000:1.0:1789760733.740772:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21168128 -> 21172224
00010000:00010000:1.0:1789760733.740788:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.740812:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.740827:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.740835:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760733.740840:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.740849:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.740869:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.740878:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c031 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21168128->21172223] (req 21168128->21172223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760733.740975:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520918784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63267us (63551us total) trans 4294972488 rc 0/0
00000100:00100000:1.0:1789760733.740988:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5201
00000100:00100000:1.0:1789760733.740998:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705316378521 time 705364376125 state 0x2 ref 0
00000100:00100000:0.0:1789760733.746244:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760733.746614:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520918912
00000100:00100000:1.0:1789760733.746624:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520918912
00000100:00100000:1.0:1789760733.746675:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705316378521 time 705364376125 state 0x0 ref 1
00000100:00100000:1.0:1789760733.746690:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705364636541 time 705364376125 state 0x1 ref 1
00000100:00100000:1.0:1789760733.746755:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705364636541 time 705433437106 state 0x0 ref 1
00000100:00100000:1.0:1789760733.746768:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520918912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760733.746827:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21172224, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:1.0:1789760733.746836:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.746853:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:1.0:1789760733.746857:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760733.746863:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.746878:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.755101:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760733.789123:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972489 is committed
00002000:00010000:2.0:1789760733.789260:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21172224 -> 21176320
00010000:00010000:2.0:1789760733.789276:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.789288:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.789297:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.789304:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760733.789309:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.789411:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.789432:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.789440:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c038 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21172224->21176319] (req 21172224->21176319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760733.789609:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520918912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42838us (43369us total) trans 4294972489 rc 0/0
00000100:00100000:2.0:1789760733.789620:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5202
00000100:00100000:2.0:1789760733.789630:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705364636541 time 705433437106 state 0x2 ref 0
00000100:00100000:0.0:1789760733.797172:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760733.797498:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520919040
00000100:00100000:3.0:1789760733.797509:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520919040
00000100:00100000:3.0:1789760733.797562:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705364636541 time 705433437106 state 0x0 ref 1
00000100:00100000:3.0:1789760733.797577:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705433697522 time 705433437106 state 0x1 ref 1
00000100:00100000:3.0:1789760733.797610:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705433697522 time 705484293206 state 0x0 ref 1
00000100:00100000:3.0:1789760733.797623:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520919040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760733.797676:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21176320, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:3.0:1789760733.797686:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.797701:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:3.0:1789760733.797705:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760733.797711:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.797725:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760733.846587:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21176320 -> 21180416
00010000:00010000:3.0:1789760733.846606:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.846619:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.846629:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.846638:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760733.846643:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.846652:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.846671:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.846680:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c03f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21176320->21180415] (req 21176320->21180415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760733.846775:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520919040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49149us (49607us total) trans 4294972490 rc 0/0
00000100:00100000:3.0:1789760733.846785:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5203
00000100:00100000:3.0:1789760733.846794:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705433697522 time 705484293206 state 0x2 ref 0
00000001:00080000:3.0:1789760733.849468:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972490 is committed
00000100:00100000:3.0:1789760733.851366:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760733.851557:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520919168
00000100:00100000:1.0:1789760733.851567:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520919168
00000100:00100000:1.0:1789760733.851621:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705433697522 time 705484293206 state 0x0 ref 1
00000100:00100000:1.0:1789760733.851637:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705484553622 time 705484293206 state 0x1 ref 1
00000100:00100000:1.0:1789760733.851668:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705484553622 time 705538350086 state 0x0 ref 1
00000100:00100000:1.0:1789760733.851681:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520919168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760733.851733:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21180416, mtime: 0x6aad94de, atime: 0x0, ctime: 0x6aad94de, blocks: 0xa807
00010000:00010000:1.0:1789760733.851742:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.851756:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:1.0:1789760733.851760:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760733.851766:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.851779:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760733.883357:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972491 is committed
00002000:00010000:0.0:1789760733.883530:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21180416 -> 21184512
00002000:00010000:0.0:1789760733.883535:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760734 -> 1789760735
00002000:00010000:0.0:1789760733.883538:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760734 -> 1789760735
00010000:00010000:0.0:1789760733.883553:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.883565:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.883574:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.883582:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760733.883587:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.883597:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.883615:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760733.883620:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c046 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21180416->21184511] (req 21180416->21184511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760733.883727:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520919168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32045us (32418us total) trans 4294972491 rc 0/0
00000100:00100000:0.0:1789760733.883734:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5204
00000100:00100000:0.0:1789760733.883741:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705484553622 time 705538350086 state 0x2 ref 0
00000100:00100000:0.0:1789760733.887559:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760733.887716:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520919296
00000100:00100000:1.0:1789760733.887726:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520919296
00000100:00100000:1.0:1789760733.887781:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705484553622 time 705538350086 state 0x0 ref 1
00000100:00100000:1.0:1789760733.887806:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705538610502 time 705538350086 state 0x1 ref 1
00000100:00100000:1.0:1789760733.887875:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705538610502 time 705574557705 state 0x0 ref 1
00000100:00100000:1.0:1789760733.887888:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520919296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760733.887933:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21184512, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:1.0:1789760733.887941:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.887956:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:1.0:1789760733.887960:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760733.887966:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760733.887981:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760733.929996:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972492 is committed
00002000:00010000:2.0:1789760733.930110:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21184512 -> 21188608
00010000:00010000:2.0:1789760733.930127:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.930140:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.930149:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.930156:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760733.930161:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.930170:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.930188:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760733.930196:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c04d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21184512->21188607] (req 21184512->21188607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760733.930293:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520919296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42403us (42738us total) trans 4294972492 rc 0/0
00000100:00100000:2.0:1789760733.930307:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5205
00000100:00100000:2.0:1789760733.930354:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705538610502 time 705574557705 state 0x2 ref 0
00000100:00100000:2.0:1789760733.934582:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760733.934691:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520919424
00000100:00100000:3.0:1789760733.934700:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520919424
00000100:00100000:3.0:1789760733.934851:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705538610502 time 705574557705 state 0x0 ref 1
00000100:00100000:3.0:1789760733.934867:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705574818121 time 705574557705 state 0x1 ref 1
00000100:00100000:3.0:1789760733.934956:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705574818121 time 705621637377 state 0x0 ref 1
00000100:00100000:3.0:1789760733.934970:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520919424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760733.935018:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21188608, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:3.0:1789760733.935027:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.935044:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:3.0:1789760733.935048:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760733.935054:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.935068:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760733.973002:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21188608 -> 21192704
00010000:00010000:3.0:1789760733.973025:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.973040:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.973049:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.973057:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760733.973061:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.973070:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.973089:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.973097:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c054 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21188608->21192703] (req 21188608->21192703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760733.973190:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520919424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38217us (38613us total) trans 4294972493 rc 0/0
00000100:00100000:3.0:1789760733.973201:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5206
00000100:00100000:3.0:1789760733.973211:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705574818121 time 705621637377 state 0x2 ref 0
00000001:00080000:0.0:1789760733.973713:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972493 is committed
00000100:00100000:0.0:1789760733.984139:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760733.984243:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520919552
00000100:00100000:3.0:1789760733.984254:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520919552
00000100:00100000:3.0:1789760733.984344:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705574818121 time 705621637377 state 0x0 ref 1
00000100:00100000:3.0:1789760733.984362:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705621897793 time 705621637377 state 0x1 ref 1
00000100:00100000:3.0:1789760733.984395:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705621897793 time 705671077212 state 0x0 ref 1
00000100:00100000:3.0:1789760733.984407:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520919552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760733.984459:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21192704, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:3.0:1789760733.984468:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.984483:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:3.0:1789760733.984487:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760733.984493:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760733.984513:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760734.016007:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972494 is committed
00002000:00010000:3.0:1789760734.016091:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21192704 -> 21196800
00010000:00010000:3.0:1789760734.016106:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.016119:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.016127:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.016133:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760734.016138:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.016146:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.016163:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.016170:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c05b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21192704->21196799] (req 21192704->21196799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760734.016304:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520919552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31895us (32169us total) trans 4294972494 rc 0/0
00000100:00100000:3.0:1789760734.016423:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5207
00000100:00100000:3.0:1789760734.016444:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705621897793 time 705671077212 state 0x2 ref 0
00000100:00100000:1.0:1789760734.019717:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760734.019829:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520919680
00000100:00100000:0.0:1789760734.019838:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520919680
00000100:00100000:0.0:1789760734.019911:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705621897793 time 705671077212 state 0x0 ref 1
00000100:00100000:0.0:1789760734.019927:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705671337628 time 705671077212 state 0x1 ref 1
00000100:00100000:0.0:1789760734.019952:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705671337628 time 705706634750 state 0x0 ref 1
00000100:00100000:0.0:1789760734.019964:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520919680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760734.020010:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21196800, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:0.0:1789760734.020019:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.020035:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:0.0:1789760734.020039:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760734.020046:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.020061:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:2.0:1789760734.020456:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:1.0:1789760734.053279:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972495 is committed
00002000:00010000:0.0:1789760734.053393:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21196800 -> 21200896
00010000:00010000:0.0:1789760734.053409:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.053422:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.053608:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.053616:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760734.053621:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.053629:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.053651:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.053659:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c062 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21196800->21200895] (req 21196800->21200895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760734.053760:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520919680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33793us (34047us total) trans 4294972495 rc 0/0
00000100:00100000:0.0:1789760734.053770:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5208
00000100:00100000:0.0:1789760734.053780:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705671337628 time 705706634750 state 0x2 ref 0
00000100:00100000:2.0:1789760734.058620:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760734.058685:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520919808
00000100:00100000:3.0:1789760734.058695:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520919808
00000100:00100000:3.0:1789760734.058746:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705671337628 time 705706634750 state 0x0 ref 1
00000100:00100000:3.0:1789760734.058762:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705706895166 time 705706634750 state 0x1 ref 1
00000100:00100000:3.0:1789760734.058791:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705706895166 time 705745473370 state 0x0 ref 1
00000100:00100000:3.0:1789760734.058812:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520919808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760734.058859:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21200896, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:3.0:1789760734.058867:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.058882:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:3.0:1789760734.058887:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760734.058893:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.058907:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760734.104188:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972496 is committed
00002000:00010000:3.0:1789760734.104300:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21200896 -> 21204992
00010000:00010000:3.0:1789760734.104451:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.104465:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.104475:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.104483:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760734.104488:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.104497:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.104519:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.104528:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c069 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21200896->21204991] (req 21200896->21204991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760734.104663:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520919808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45848us (46046us total) trans 4294972496 rc 0/0
00000100:00100000:3.0:1789760734.104677:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5209
00000100:00100000:3.0:1789760734.104687:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705706895166 time 705745473370 state 0x2 ref 0
00000100:00100000:3.0:1789760734.109584:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760734.109674:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520919936
00000100:00100000:2.0:1789760734.109685:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520919936
00000100:00100000:2.0:1789760734.109742:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705706895166 time 705745473370 state 0x0 ref 1
00000100:00100000:2.0:1789760734.109757:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705745733786 time 705745473370 state 0x1 ref 1
00000100:00100000:2.0:1789760734.109833:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705745733786 time 705796515782 state 0x0 ref 1
00000100:00100000:2.0:1789760734.109846:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520919936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760734.109892:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21204992, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:2.0:1789760734.109901:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.109916:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:2.0:1789760734.109920:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760734.109926:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.109941:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760734.169401:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972497 is committed
00002000:00010000:2.0:1789760734.169752:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21204992 -> 21209088
00010000:00010000:2.0:1789760734.169768:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.169780:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.169789:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.169805:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760734.169810:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.169819:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.169839:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.169847:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c070 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21204992->21209087] (req 21204992->21209087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760734.170095:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520919936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60246us (60580us total) trans 4294972497 rc 0/0
00000100:00100000:2.0:1789760734.170110:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5210
00000100:00100000:2.0:1789760734.170119:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705745733786 time 705796515782 state 0x2 ref 0
00000100:00100000:1.0:1789760734.174772:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760734.175014:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520920064
00000100:00100000:3.0:1789760734.175024:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520920064
00000100:00100000:3.0:1789760734.175077:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705745733786 time 705796515782 state 0x0 ref 1
00000100:00100000:3.0:1789760734.175093:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705796776198 time 705796515782 state 0x1 ref 1
00000100:00100000:3.0:1789760734.175842:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705796776198 time 705862521020 state 0x0 ref 1
00000100:00100000:3.0:1789760734.175924:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520920064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760734.175975:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21209088, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:3.0:1789760734.176021:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.176036:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:3.0:1789760734.176040:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760734.176046:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.176060:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760734.211710:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972498 is committed
00002000:00010000:3.0:1789760734.212176:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21209088 -> 21213184
00010000:00010000:3.0:1789760734.212193:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.212205:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.212214:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.212220:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760734.212224:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.212233:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.212666:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.212677:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c077 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21209088->21213183] (req 21209088->21213183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760734.212875:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520920064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37015us (38109us total) trans 4294972498 rc 0/0
00000100:00100000:2.0:1789760734.212886:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5211
00000100:00100000:2.0:1789760734.212896:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705796776198 time 705862521020 state 0x2 ref 0
00000100:00100000:0.0:1789760734.223903:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760734.224918:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520920192
00000100:00100000:1.0:1789760734.224930:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520920192
00000100:00100000:1.0:1789760734.225001:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705796776198 time 705862521020 state 0x0 ref 1
00000100:00100000:1.0:1789760734.225017:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705862781436 time 705862521020 state 0x1 ref 1
00000100:00100000:1.0:1789760734.225054:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705862781436 time 705911736558 state 0x0 ref 1
00000100:00100000:1.0:1789760734.225067:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520920192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760734.228651:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21213184, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:2.0:1789760734.228667:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.228684:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:2.0:1789760734.228689:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760734.228696:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.228711:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760734.266293:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21213184 -> 21217280
00010000:00010000:2.0:1789760734.266348:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.266363:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.266373:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.266380:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760734.266385:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.266394:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.266412:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.266420:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c07e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21213184->21217279] (req 21213184->21217279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760734.266506:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520920192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41438us (42607us total) trans 4294972499 rc 0/0
00000100:00100000:2.0:1789760734.266517:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5212
00000100:00100000:2.0:1789760734.266527:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705862781436 time 705911736558 state 0x2 ref 0
00000001:00080000:2.0:1789760734.266563:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972499 is committed
00000100:00100000:3.0:1789760734.278545:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760734.279364:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520920320
00000100:00100000:2.0:1789760734.279375:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520920320
00000100:00100000:2.0:1789760734.279431:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705862781436 time 705911736558 state 0x0 ref 1
00000100:00100000:2.0:1789760734.279449:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705911996974 time 705911736558 state 0x1 ref 1
00000100:00100000:2.0:1789760734.279484:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705911996974 time 705966166435 state 0x0 ref 1
00000100:00100000:2.0:1789760734.279497:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520920320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760734.279543:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21217280, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:2.0:1789760734.279553:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.279570:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=705s v=(0 0)
00010000:00010000:2.0:1789760734.279574:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760734.279581:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.279595:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760734.327153:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972500 is committed
00002000:00010000:3.0:1789760734.327246:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21217280 -> 21221376
00010000:00010000:3.0:1789760734.327275:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.327288:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.327298:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.327306:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760734.327577:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.327589:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.327612:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.327620:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c085 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21217280->21221375] (req 21217280->21221375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760734.327717:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520920320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48218us (49176us total) trans 4294972500 rc 0/0
00000100:00100000:3.0:1789760734.327727:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5213
00000100:00100000:3.0:1789760734.327737:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705911996974 time 705966166435 state 0x2 ref 0
00000100:00100000:3.0:1789760734.331146:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760734.331722:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520920448
00000100:00100000:2.0:1789760734.331732:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520920448
00000100:00100000:2.0:1789760734.331781:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705911996974 time 705966166435 state 0x0 ref 1
00000100:00100000:2.0:1789760734.331806:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705966426851 time 705966166435 state 0x1 ref 1
00000100:00100000:2.0:1789760734.331837:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705966426851 time 706018520590 state 0x0 ref 1
00000100:00100000:2.0:1789760734.331849:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520920448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760734.331894:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21221376, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:2.0:1789760734.331903:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.331918:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:2.0:1789760734.331923:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760734.331929:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.331942:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760734.360789:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972501 is committed
00002000:00010000:2.0:1789760734.360898:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21221376 -> 21225472
00010000:00010000:2.0:1789760734.360914:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.360927:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.360936:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.360943:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760734.360948:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.360956:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.360975:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.360982:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c08c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21221376->21225471] (req 21221376->21225471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760734.361070:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520920448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29218us (29928us total) trans 4294972501 rc 0/0
00000100:00100000:2.0:1789760734.361080:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5214
00000100:00100000:2.0:1789760734.361088:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705966426851 time 706018520590 state 0x2 ref 0
00000100:00100000:2.0:1789760734.365442:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760734.365564:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520920576
00000100:00100000:3.0:1789760734.365574:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520920576
00000100:00100000:3.0:1789760734.365633:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 705966426851 time 706018520590 state 0x0 ref 1
00000100:00100000:3.0:1789760734.365652:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706018781006 time 706018520590 state 0x1 ref 1
00000100:00100000:3.0:1789760734.365684:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706018781006 time 706052366578 state 0x0 ref 1
00000100:00100000:3.0:1789760734.365696:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520920576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760734.365744:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21225472, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:3.0:1789760734.365754:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.365771:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:3.0:1789760734.365775:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760734.365781:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.365805:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760734.391894:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972502 is committed
00002000:00010000:2.0:1789760734.391996:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21225472 -> 21229568
00010000:00010000:2.0:1789760734.392012:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.392026:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.392035:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.392042:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760734.392046:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.392060:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.392079:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.392087:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c093 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21225472->21229567] (req 21225472->21229567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760734.392181:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520920576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26482us (26756us total) trans 4294972502 rc 0/0
00000100:00100000:2.0:1789760734.392193:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5215
00000100:00100000:2.0:1789760734.392204:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706018781006 time 706052366578 state 0x2 ref 0
00000100:00100000:3.0:1789760734.395172:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760734.395259:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520920704
00000100:00100000:2.0:1789760734.395269:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520920704
00000100:00100000:2.0:1789760734.395360:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706018781006 time 706052366578 state 0x0 ref 1
00000100:00100000:2.0:1789760734.395377:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706052626994 time 706052366578 state 0x1 ref 1
00000100:00100000:2.0:1789760734.395399:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706052626994 time 706082081566 state 0x0 ref 1
00000100:00100000:2.0:1789760734.395411:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520920704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760734.395467:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21229568, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:2.0:1789760734.395475:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.395490:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:2.0:1789760734.395494:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760734.395499:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.395512:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760734.447666:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972503 is committed
00002000:00010000:0.0:1789760734.447818:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21229568 -> 21233664
00010000:00010000:0.0:1789760734.447832:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.447845:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.447855:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.447863:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760734.447868:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.447876:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.447902:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.447909:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c09a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21229568->21233663] (req 21229568->21233663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760734.447996:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520920704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52582us (52829us total) trans 4294972503 rc 0/0
00000100:00100000:0.0:1789760734.448006:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5216
00000100:00100000:0.0:1789760734.448015:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706052626994 time 706082081566 state 0x2 ref 0
00000100:00100000:3.0:1789760734.459703:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760734.459838:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520920832
00000100:00100000:2.0:1789760734.459848:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520920832
00000100:00100000:2.0:1789760734.459900:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706052626994 time 706082081566 state 0x0 ref 1
00000100:00100000:2.0:1789760734.459916:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706082341982 time 706082081566 state 0x1 ref 1
00000100:00100000:2.0:1789760734.459948:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706082341982 time 706146630527 state 0x0 ref 1
00000100:00100000:2.0:1789760734.459961:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520920832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760734.460008:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21233664, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:2.0:1789760734.460017:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.460033:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:2.0:1789760734.460037:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760734.460043:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.460059:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760734.527289:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21233664 -> 21237760
00010000:00010000:0.0:1789760734.527310:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.527359:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.527369:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.527377:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760734.527382:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.527396:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.527416:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.527425:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c0a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21233664->21237759] (req 21233664->21237759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760734.527526:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520920832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67563us (67827us total) trans 4294972504 rc 0/0
00000100:00100000:0.0:1789760734.527537:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5217
00000100:00100000:0.0:1789760734.527547:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706082341982 time 706146630527 state 0x2 ref 0
00000001:00080000:2.0:1789760734.527715:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972504 is committed
00000100:00100000:3.0:1789760734.536171:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760734.536526:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520920960
00000100:00100000:0.0:1789760734.536537:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520920960
00000100:00100000:0.0:1789760734.536592:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706082341982 time 706146630527 state 0x0 ref 1
00000100:00100000:0.0:1789760734.536607:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706146890943 time 706146630527 state 0x1 ref 1
00000100:00100000:0.0:1789760734.536639:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706146890943 time 706223321692 state 0x0 ref 1
00000100:00100000:0.0:1789760734.536650:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520920960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760734.536698:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21237760, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:0.0:1789760734.536707:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.536722:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:0.0:1789760734.536726:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760734.536732:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.536744:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760734.593911:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972505 is committed
00002000:00010000:0.0:1789760734.594019:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21237760 -> 21241856
00010000:00010000:0.0:1789760734.594036:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.594050:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.594060:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.594068:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760734.594072:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.594081:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.594099:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.594108:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21237760->21241855] (req 21237760->21241855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760734.594199:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520920960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57546us (58034us total) trans 4294972505 rc 0/0
00000100:00100000:0.0:1789760734.594211:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5218
00000100:00100000:0.0:1789760734.594222:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706146890943 time 706223321692 state 0x2 ref 0
00000100:00100000:0.0:1789760734.599710:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760734.599911:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520921088
00000100:00100000:3.0:1789760734.599921:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520921088
00000100:00100000:3.0:1789760734.599980:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706146890943 time 706223321692 state 0x0 ref 1
00000100:00100000:3.0:1789760734.599996:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706223582108 time 706223321692 state 0x1 ref 1
00000100:00100000:3.0:1789760734.600036:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706223582108 time 706286719055 state 0x0 ref 1
00000100:00100000:3.0:1789760734.600048:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520921088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760734.600092:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21241856, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:3.0:1789760734.600102:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.600119:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:3.0:1789760734.600123:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760734.600128:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.600141:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760734.715509:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21241856 -> 21245952
00010000:00010000:1.0:1789760734.715531:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.715544:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.715553:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.715562:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760734.715567:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.715575:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.715595:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.715604:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c0af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21241856->21245951] (req 21241856->21245951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760734.715704:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520921088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 115653us (116001us total) trans 4294972506 rc 0/0
00000100:00100000:1.0:1789760734.715715:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5219
00000100:00100000:1.0:1789760734.715725:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706223582108 time 706286719055 state 0x2 ref 0
00000001:00080000:0.0:1789760734.716238:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972506 is committed
00000100:00100000:1.0:1789760734.720971:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760734.721135:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520921216
00000100:00100000:2.0:1789760734.721185:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520921216
00000100:00100000:2.0:1789760734.721241:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706223582108 time 706286719055 state 0x0 ref 1
00000100:00100000:2.0:1789760734.721257:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706286979471 time 706286719055 state 0x1 ref 1
00000100:00100000:2.0:1789760734.721356:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706286979471 time 706408037419 state 0x0 ref 1
00000100:00100000:2.0:1789760734.721370:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520921216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760734.721421:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21245952, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:2.0:1789760734.721431:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.721447:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:2.0:1789760734.721452:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760734.721458:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.721477:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760734.763599:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21245952 -> 21250048
00010000:00010000:2.0:1789760734.763618:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.763632:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.763641:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.763648:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760734.763653:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.763662:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.763680:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.763688:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21245952->21250047] (req 21245952->21250047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760734.763856:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520921216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42482us (42890us total) trans 4294972507 rc 0/0
00000100:00100000:2.0:1789760734.763870:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5220
00000100:00100000:2.0:1789760734.763879:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706286979471 time 706408037419 state 0x2 ref 0
00000001:00080000:1.0:1789760734.763957:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972507 is committed
00000100:00100000:2.0:1789760734.767502:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760734.767656:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520921344
00000100:00100000:1.0:1789760734.767665:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520921344
00000100:00100000:1.0:1789760734.767720:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706286979471 time 706408037419 state 0x0 ref 1
00000100:00100000:1.0:1789760734.767734:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706408297835 time 706408037419 state 0x1 ref 1
00000100:00100000:0.0:1789760734.769746:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706408297835 time 706456413469 state 0x0 ref 1
00000100:00100000:0.0:1789760734.769774:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520921344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760734.769836:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21250048, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:0.0:1789760734.769845:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.769860:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:0.0:1789760734.769864:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760734.769871:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.769885:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.777555:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760734.798936:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972508 is committed
00002000:00010000:0.0:1789760734.799002:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21250048 -> 21254144
00010000:00010000:0.0:1789760734.799017:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.799031:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.799040:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.799048:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760734.799053:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.799063:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.799083:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.799091:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21250048->21254143] (req 21250048->21254143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760734.799173:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520921344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29406us (31676us total) trans 4294972508 rc 0/0
00000100:00100000:0.0:1789760734.799184:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5221
00000100:00100000:0.0:1789760734.799193:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706408297835 time 706456413469 state 0x2 ref 0
00000100:00100000:3.0:1789760734.804593:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760734.804982:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520921472
00000100:00100000:0.0:1789760734.804992:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520921472
00000100:00100000:0.0:1789760734.805048:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706408297835 time 706456413469 state 0x0 ref 1
00000100:00100000:0.0:1789760734.805063:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706456673885 time 706456413469 state 0x1 ref 1
00000100:00100000:0.0:1789760734.805094:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706456673885 time 706491776759 state 0x0 ref 1
00000100:00100000:0.0:1789760734.805106:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520921472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760734.805167:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21254144, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:0.0:1789760734.805176:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.805193:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:0.0:1789760734.805198:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760734.805204:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.805219:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760734.837098:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972509 is committed
00002000:00010000:2.0:1789760734.837527:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21254144 -> 21258240
00010000:00010000:2.0:1789760734.837543:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.837557:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.837565:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.837572:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760734.837577:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.837584:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.837602:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.837609:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c0c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21254144->21258239] (req 21254144->21258239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760734.837700:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520921472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32592us (33112us total) trans 4294972509 rc 0/0
00000100:00100000:2.0:1789760734.837711:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5222
00000100:00100000:2.0:1789760734.837720:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706456673885 time 706491776759 state 0x2 ref 0
00000100:00100000:1.0:1789760734.841671:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760734.841753:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520921600
00000100:00100000:3.0:1789760734.841768:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520921600
00000100:00100000:3.0:1789760734.841830:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706456673885 time 706491776759 state 0x0 ref 1
00000100:00100000:3.0:1789760734.841845:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706492037175 time 706491776759 state 0x1 ref 1
00000100:00100000:3.0:1789760734.841877:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706492037175 time 706528560236 state 0x0 ref 1
00000100:00100000:3.0:1789760734.841889:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520921600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760734.841938:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21258240, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:3.0:1789760734.841947:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.841962:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:3.0:1789760734.841966:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760734.841973:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760734.841987:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760734.845004:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1789760734.845028:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548750080:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1789760734.845107:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760734.845302:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548750080
00000100:00100000:0.0:1789760734.845338:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548750080
00000100:00100000:0.0:1789760734.845392:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421
00000100:00100000:0.0:1789760734.845401:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548750080:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1789760734.845587:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:0.0:1789760734.845648:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548750080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 249us (542us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760734.845656:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421
00000100:00100000:3.0:1789760734.845735:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548750080:0@lo:41:osp-pre-0-1.0
00000001:00080000:0.0:1789760734.877723:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972510 is committed
00002000:00010000:2.0:1789760734.877823:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21258240 -> 21262336
00010000:00010000:2.0:1789760734.877837:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.877851:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.877860:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.877866:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760734.877871:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.877881:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.877900:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.877913:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c0cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21258240->21262335] (req 21258240->21262335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760734.878004:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520921600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36113us (36342us total) trans 4294972510 rc 0/0
00000100:00100000:2.0:1789760734.878014:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5223
00000100:00100000:2.0:1789760734.878023:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706492037175 time 706528560236 state 0x2 ref 0
00000100:00100000:3.0:1789760734.882745:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760734.882839:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520921728
00000100:00100000:2.0:1789760734.882849:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520921728
00000100:00100000:2.0:1789760734.882903:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706492037175 time 706528560236 state 0x0 ref 1
00000100:00100000:2.0:1789760734.882919:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706528820652 time 706528560236 state 0x1 ref 1
00000100:00100000:2.0:1789760734.882947:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706528820652 time 706569629274 state 0x0 ref 1
00000100:00100000:2.0:1789760734.882960:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520921728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760734.883007:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21262336, mtime: 0x6aad94df, atime: 0x0, ctime: 0x6aad94df, blocks: 0xa807
00010000:00010000:2.0:1789760734.883016:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.883031:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:2.0:1789760734.883035:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760734.883041:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760734.883059:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760734.935996:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972511 is committed
00002000:00010000:0.0:1789760734.936275:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21262336 -> 21266432
00002000:00010000:0.0:1789760734.936280:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760735 -> 1789760736
00002000:00010000:0.0:1789760734.936283:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760735 -> 1789760736
00010000:00010000:0.0:1789760734.936295:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.936308:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.936346:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.936355:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760734.936359:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.936368:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.936389:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.936398:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c0d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21262336->21266431] (req 21262336->21266431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760734.936533:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520921728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53570us (53795us total) trans 4294972511 rc 0/0
00000100:00100000:0.0:1789760734.936544:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5224
00000100:00100000:0.0:1789760734.936554:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706528820652 time 706569629274 state 0x2 ref 0
00000100:00100000:0.0:1789760734.944704:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760734.944809:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520921856
00000100:00100000:1.0:1789760734.944819:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520921856
00000100:00100000:1.0:1789760734.944871:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706528820652 time 706569629274 state 0x0 ref 1
00000100:00100000:1.0:1789760734.944886:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706569889690 time 706569629274 state 0x1 ref 1
00000100:00100000:1.0:1789760734.944917:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706569889690 time 706631600079 state 0x0 ref 1
00000100:00100000:1.0:1789760734.944930:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520921856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760734.944977:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21266432, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760734.944986:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.945002:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:1.0:1789760734.945006:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760734.945013:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.945026:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760734.988162:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972512 is committed
00002000:00010000:1.0:1789760734.988581:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21266432 -> 21270528
00010000:00010000:1.0:1789760734.988598:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.988611:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.988621:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.988629:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760734.988635:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.988644:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.988665:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760734.988673:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c0d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21266432->21270527] (req 21266432->21270527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760734.988885:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520921856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43951us (44185us total) trans 4294972512 rc 0/0
00000100:00100000:1.0:1789760734.988897:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5225
00000100:00100000:1.0:1789760734.988906:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706569889690 time 706631600079 state 0x2 ref 0
00000100:00100000:1.0:1789760734.994860:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760734.994959:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520921984
00000100:00100000:0.0:1789760734.994968:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520921984
00000100:00100000:0.0:1789760734.995023:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706569889690 time 706631600079 state 0x0 ref 1
00000100:00100000:0.0:1789760734.995037:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706631860495 time 706631600079 state 0x1 ref 1
00000100:00100000:0.0:1789760734.995104:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706631860495 time 706681786295 state 0x0 ref 1
00000100:00100000:0.0:1789760734.995116:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520921984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760734.995187:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21270528, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:0.0:1789760734.995197:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.995215:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:0.0:1789760734.995219:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760734.995226:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760734.995241:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760735.025387:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21270528 -> 21274624
00010000:00010000:0.0:1789760735.025407:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.025420:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.025429:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.025437:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760735.025442:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.025450:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.025468:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.025476:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21270528->21274623] (req 21270528->21274623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760735.025569:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520921984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30449us (30711us total) trans 4294972513 rc 0/0
00000100:00100000:0.0:1789760735.025580:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5226
00000100:00100000:0.0:1789760735.025590:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706631860495 time 706681786295 state 0x2 ref 0
00000001:00080000:1.0:1789760735.025723:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972513 is committed
00000100:00100000:3.0:1789760735.031961:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760735.032273:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520922112
00000100:00100000:2.0:1789760735.032292:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520922112
00000100:00100000:2.0:1789760735.032479:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706631860495 time 706681786295 state 0x0 ref 1
00000100:00100000:2.0:1789760735.032494:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706682046711 time 706681786295 state 0x1 ref 1
00000100:00100000:2.0:1789760735.032578:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706682046711 time 706719259231 state 0x0 ref 1
00000100:00100000:2.0:1789760735.032591:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520922112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760735.032645:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21274624, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:2.0:1789760735.032655:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.032671:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:2.0:1789760735.032675:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760735.032682:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.032695:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760735.060470:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21274624 -> 21278720
00010000:00010000:3.0:1789760735.060491:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.060504:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.060513:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.060521:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760735.060526:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.060534:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.060551:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.060558:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c0e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21274624->21278719] (req 21274624->21278719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760735.060650:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520922112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28056us (28695us total) trans 4294972514 rc 0/0
00000100:00100000:3.0:1789760735.060660:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5227
00000100:00100000:3.0:1789760735.060670:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706682046711 time 706719259231 state 0x2 ref 0
00000001:00080000:0.0:1789760735.060751:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972514 is committed
00000100:00100000:3.0:1789760735.071667:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760735.071806:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520922240
00000100:00100000:2.0:1789760735.071819:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520922240
00000100:00100000:2.0:1789760735.071880:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706682046711 time 706719259231 state 0x0 ref 1
00000100:00100000:2.0:1789760735.071896:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706719519647 time 706719259231 state 0x1 ref 1
00000100:00100000:2.0:1789760735.071979:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706719519647 time 706758660777 state 0x0 ref 1
00000100:00100000:2.0:1789760735.071993:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520922240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760735.072041:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21278720, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:2.0:1789760735.072050:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.072067:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:2.0:1789760735.072072:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760735.072079:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.072093:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760735.117913:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972515 is committed
00002000:00010000:0.0:1789760735.118044:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21278720 -> 21282816
00010000:00010000:0.0:1789760735.118061:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.118076:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.118087:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.118096:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760735.118101:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.118112:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.118134:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.118148:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c0ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21278720->21282815] (req 21278720->21282815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760735.118251:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520922240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46254us (46589us total) trans 4294972515 rc 0/0
00000100:00100000:0.0:1789760735.118262:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5228
00000100:00100000:0.0:1789760735.118273:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706719519647 time 706758660777 state 0x2 ref 0
00000100:00100000:1.0:1789760735.122190:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760735.123634:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520922368
00000100:00100000:0.0:1789760735.123647:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520922368
00000100:00100000:0.0:1789760735.123709:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706719519647 time 706758660777 state 0x0 ref 1
00000100:00100000:0.0:1789760735.123725:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706758921193 time 706758660777 state 0x1 ref 1
00000100:00100000:0.0:1789760735.123876:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706758921193 time 706810557194 state 0x0 ref 1
00000100:00100000:0.0:1789760735.123890:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520922368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760735.123939:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21282816, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:0.0:1789760735.123948:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.123963:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:0.0:1789760735.123967:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760735.123973:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.123990:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760735.213149:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972516 is committed
00002000:00010000:0.0:1789760735.213633:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21282816 -> 21286912
00010000:00010000:0.0:1789760735.213651:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.213665:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.213673:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.213681:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760735.213685:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.213694:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.213714:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.213722:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21282816->21286911] (req 21282816->21286911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760735.213892:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520922368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 90001us (91707us total) trans 4294972516 rc 0/0
00000100:00100000:0.0:1789760735.213903:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5229
00000100:00100000:0.0:1789760735.213912:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706758921193 time 706810557194 state 0x2 ref 0
00000100:00100000:1.0:1789760735.222495:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760735.222642:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520922496
00000100:00100000:0.0:1789760735.222652:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520922496
00000100:00100000:0.0:1789760735.222713:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706758921193 time 706810557194 state 0x0 ref 1
00000100:00100000:0.0:1789760735.222728:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706810817610 time 706810557194 state 0x1 ref 1
00000100:00100000:0.0:1789760735.222762:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706810817610 time 706909444273 state 0x0 ref 1
00000100:00100000:0.0:1789760735.222941:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520922496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760735.222989:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21286912, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:0.0:1789760735.222998:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.223013:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:0.0:1789760735.223017:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760735.223023:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.223035:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760735.258962:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21286912 -> 21291008
00010000:00010000:1.0:1789760735.258982:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.258999:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.259008:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.259016:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.259022:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.259030:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.259048:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.259055:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c0fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21286912->21291007] (req 21286912->21291007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.259182:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520922496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36406us (36691us total) trans 4294972517 rc 0/0
00000100:00100000:1.0:1789760735.259193:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5230
00000100:00100000:1.0:1789760735.259203:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706810817610 time 706909444273 state 0x2 ref 0
00000001:00080000:1.0:1789760735.259239:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972517 is committed
00000100:00100000:3.0:1789760735.264657:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760735.264935:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520922624
00000100:00100000:2.0:1789760735.264945:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520922624
00000100:00100000:2.0:1789760735.264998:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706810817610 time 706909444273 state 0x0 ref 1
00000100:00100000:2.0:1789760735.265014:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706909704689 time 706909444273 state 0x1 ref 1
00000100:00100000:2.0:1789760735.265048:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706909704689 time 706951730373 state 0x0 ref 1
00000100:00100000:2.0:1789760735.265063:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520922624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760735.265109:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21291008, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:2.0:1789760735.265118:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.265133:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=706s v=(0 0)
00010000:00010000:2.0:1789760735.265138:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760735.265144:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.265158:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760735.317003:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972518 is committed
00002000:00010000:1.0:1789760735.317066:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21291008 -> 21295104
00010000:00010000:1.0:1789760735.317084:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.317107:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.317115:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.317122:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.317127:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.317135:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.317156:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.317173:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c103 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21291008->21295103] (req 21291008->21295103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.317263:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520922624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52197us (52610us total) trans 4294972518 rc 0/0
00000100:00100000:1.0:1789760735.317273:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5231
00000100:00100000:1.0:1789760735.317283:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706909704689 time 706951730373 state 0x2 ref 0
00000100:00100000:0.0:1789760735.321958:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760735.322060:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520922752
00000100:00100000:2.0:1789760735.322069:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520922752
00000100:00100000:2.0:1789760735.322123:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706909704689 time 706951730373 state 0x0 ref 1
00000100:00100000:2.0:1789760735.322138:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706951990789 time 706951730373 state 0x1 ref 1
00000100:00100000:2.0:1789760735.322202:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706951990789 time 707008884469 state 0x0 ref 1
00000100:00100000:2.0:1789760735.322215:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520922752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760735.322264:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21295104, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:2.0:1789760735.322274:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.322294:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:2.0:1789760735.322299:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760735.322305:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.322345:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760735.359484:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21295104 -> 21299200
00010000:00010000:3.0:1789760735.359503:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.359516:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.359526:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.359534:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760735.359539:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.359548:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.359569:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.359578:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c10a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21295104->21299199] (req 21295104->21299199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760735.359679:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520922752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37461us (37725us total) trans 4294972519 rc 0/0
00000100:00100000:3.0:1789760735.359688:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5232
00000100:00100000:3.0:1789760735.359698:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706951990789 time 707008884469 state 0x2 ref 0
00000001:00080000:1.0:1789760735.360184:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972519 is committed
00000100:00100000:3.0:1789760735.370202:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760735.370353:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520922880
00000100:00100000:0.0:1789760735.370363:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520922880
00000100:00100000:0.0:1789760735.370417:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 706951990789 time 707008884469 state 0x0 ref 1
00000100:00100000:0.0:1789760735.370432:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707009144885 time 707008884469 state 0x1 ref 1
00000100:00100000:0.0:1789760735.370463:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707009144885 time 707057145841 state 0x0 ref 1
00000100:00100000:0.0:1789760735.370476:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520922880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760735.370525:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21299200, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:0.0:1789760735.370534:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.370550:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:0.0:1789760735.370555:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760735.370562:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.370575:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760735.427678:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972520 is committed
00002000:00010000:1.0:1789760735.427749:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21299200 -> 21303296
00010000:00010000:1.0:1789760735.427765:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.427777:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.427799:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.427807:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.427812:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.427820:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.427841:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.427848:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c111 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21299200->21303295] (req 21299200->21303295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.427949:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520922880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57469us (57752us total) trans 4294972520 rc 0/0
00000100:00100000:1.0:1789760735.427960:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5233
00000100:00100000:1.0:1789760735.427970:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707009144885 time 707057145841 state 0x2 ref 0
00000100:00100000:2.0:1789760735.440798:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.441018:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520923008
00000100:00100000:1.0:1789760735.441027:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520923008
00000100:00100000:1.0:1789760735.441086:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707009144885 time 707057145841 state 0x0 ref 1
00000100:00100000:1.0:1789760735.441104:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707057406257 time 707057145841 state 0x1 ref 1
00000100:00100000:1.0:1789760735.441138:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707057406257 time 707127820102 state 0x0 ref 1
00000100:00100000:1.0:1789760735.441151:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520923008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.441201:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21303296, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.441211:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.441227:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.441232:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.441238:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.441251:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760735.476515:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972521 is committed
00002000:00010000:1.0:1789760735.476620:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21303296 -> 21307392
00010000:00010000:1.0:1789760735.476636:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.476649:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.476658:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.476665:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.476670:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.476680:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.476699:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.476707:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c118 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21303296->21307391] (req 21303296->21307391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.476806:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520923008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35653us (36023us total) trans 4294972521 rc 0/0
00000100:00100000:1.0:1789760735.476817:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5234
00000100:00100000:1.0:1789760735.476827:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707057406257 time 707127820102 state 0x2 ref 0
00000100:00100000:0.0:1789760735.482604:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.482707:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520923136
00000100:00100000:1.0:1789760735.482716:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520923136
00000100:00100000:1.0:1789760735.482770:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707057406257 time 707127820102 state 0x0 ref 1
00000100:00100000:1.0:1789760735.482797:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707128080518 time 707127820102 state 0x1 ref 1
00000100:00100000:1.0:1789760735.482857:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707128080518 time 707169539176 state 0x0 ref 1
00000100:00100000:1.0:1789760735.482870:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520923136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.482914:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21307392, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.482922:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.482937:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.482941:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.482947:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.482961:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760735.511579:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21307392 -> 21311488
00010000:00010000:1.0:1789760735.511597:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.511623:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.511633:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.511641:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.511646:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.511656:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.511675:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.511684:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c11f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21307392->21311487] (req 21307392->21311487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.511777:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520923136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28906us (29176us total) trans 4294972522 rc 0/0
00000100:00100000:1.0:1789760735.511802:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5235
00000100:00100000:1.0:1789760735.511811:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707128080518 time 707169539176 state 0x2 ref 0
00000001:00080000:2.0:1789760735.513308:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972522 is committed
00000100:00100000:2.0:1789760735.516822:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760735.516962:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520923264
00000100:00100000:3.0:1789760735.516972:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520923264
00000100:00100000:3.0:1789760735.517021:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707128080518 time 707169539176 state 0x0 ref 1
00000100:00100000:3.0:1789760735.517038:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707169799592 time 707169539176 state 0x1 ref 1
00000100:00100000:3.0:1789760735.517065:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707169799592 time 707203747878 state 0x0 ref 1
00000100:00100000:3.0:1789760735.517075:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520923264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760735.517119:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21311488, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:3.0:1789760735.517128:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.517144:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:3.0:1789760735.517148:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760735.517154:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.517167:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760735.547867:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972523 is committed
00002000:00010000:1.0:1789760735.547945:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21311488 -> 21315584
00010000:00010000:1.0:1789760735.547961:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.547975:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.547985:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.547994:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.547999:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.548008:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.548028:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.548036:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c126 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21311488->21315583] (req 21311488->21315583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.548165:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520923264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31085us (31347us total) trans 4294972523 rc 0/0
00000100:00100000:1.0:1789760735.548175:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5236
00000100:00100000:1.0:1789760735.548185:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707169799592 time 707203747878 state 0x2 ref 0
00000100:00100000:0.0:1789760735.552244:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.554631:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520923392
00000100:00100000:1.0:1789760735.554646:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520923392
00000100:00100000:1.0:1789760735.554710:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707169799592 time 707203747878 state 0x0 ref 1
00000100:00100000:1.0:1789760735.554728:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707204008294 time 707203747878 state 0x1 ref 1
00000100:00100000:1.0:1789760735.554763:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707204008294 time 707241445411 state 0x0 ref 1
00000100:00100000:1.0:1789760735.554774:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520923392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.554833:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21315584, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.554841:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.554856:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.554860:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.554866:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.554880:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760735.579584:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21315584 -> 21319680
00010000:00010000:1.0:1789760735.579682:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.579697:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.579706:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.579713:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.579718:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.579727:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.579747:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.579753:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c12d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21315584->21319679] (req 21315584->21319679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.579857:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520923392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25080us (27619us total) trans 4294972524 rc 0/0
00000100:00100000:1.0:1789760735.579872:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5237
00000100:00100000:1.0:1789760735.579881:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707204008294 time 707241445411 state 0x2 ref 0
00000001:00080000:2.0:1789760735.580500:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972524 is committed
00000100:00100000:1.0:1789760735.584271:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760735.584466:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520923520
00000100:00100000:2.0:1789760735.584476:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520923520
00000100:00100000:2.0:1789760735.584860:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707204008294 time 707241445411 state 0x0 ref 1
00000100:00100000:2.0:1789760735.584874:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707241705827 time 707241445411 state 0x1 ref 1
00000100:00100000:2.0:1789760735.584926:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707241705827 time 707271608154 state 0x0 ref 1
00000100:00100000:2.0:1789760735.584938:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520923520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760735.584980:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21319680, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:2.0:1789760735.584988:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.585008:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:2.0:1789760735.585012:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760735.585018:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.585031:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760735.619409:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972525 is committed
00002000:00010000:1.0:1789760735.619618:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21319680 -> 21323776
00010000:00010000:1.0:1789760735.619634:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.619645:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.619654:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.619661:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.619666:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.619674:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.619693:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.619701:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c134 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21319680->21323775] (req 21319680->21323775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.619802:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520923520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34860us (35532us total) trans 4294972525 rc 0/0
00000100:00100000:1.0:1789760735.619814:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5238
00000100:00100000:1.0:1789760735.619823:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707241705827 time 707271608154 state 0x2 ref 0
00000100:00100000:3.0:1789760735.624658:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.624715:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520923648
00000100:00100000:1.0:1789760735.624725:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520923648
00000100:00100000:1.0:1789760735.624779:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707241705827 time 707271608154 state 0x0 ref 1
00000100:00100000:1.0:1789760735.624806:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707271868570 time 707271608154 state 0x1 ref 1
00000100:00100000:1.0:1789760735.624842:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707271868570 time 707311524783 state 0x0 ref 1
00000100:00100000:1.0:1789760735.624854:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520923648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.624902:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21323776, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.624910:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.624926:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.624930:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.624937:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.624951:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760735.661273:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972526 is committed
00002000:00010000:1.0:1789760735.661534:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21323776 -> 21327872
00010000:00010000:1.0:1789760735.661550:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.661563:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.661571:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.661578:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.661583:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.661592:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.661611:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.661619:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c13b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21323776->21327871] (req 21323776->21327871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.661710:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520923648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36852us (37055us total) trans 4294972526 rc 0/0
00000100:00100000:1.0:1789760735.661723:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5239
00000100:00100000:1.0:1789760735.661731:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707271868570 time 707311524783 state 0x2 ref 0
00000100:00100000:0.0:1789760735.667799:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.667859:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520923776
00000100:00100000:1.0:1789760735.667869:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520923776
00000100:00100000:1.0:1789760735.667922:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707271868570 time 707311524783 state 0x0 ref 1
00000100:00100000:1.0:1789760735.667937:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707311785199 time 707311524783 state 0x1 ref 1
00000100:00100000:1.0:1789760735.668023:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707311785199 time 707354704793 state 0x0 ref 1
00000100:00100000:1.0:1789760735.668035:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520923776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.668085:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21327872, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.668094:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.668108:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.668113:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.668120:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.668134:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760735.696637:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972527 is committed
00002000:00010000:1.0:1789760735.696748:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21327872 -> 21331968
00010000:00010000:1.0:1789760735.696763:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.696775:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.696800:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.696807:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.696812:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.696821:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.696841:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.696849:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c142 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21327872->21331967] (req 21327872->21331967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.696938:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520923776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28901us (29158us total) trans 4294972527 rc 0/0
00000100:00100000:1.0:1789760735.697064:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5240
00000100:00100000:1.0:1789760735.697076:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707311785199 time 707354704793 state 0x2 ref 0
00000100:00100000:0.0:1789760735.702243:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.702306:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520923904
00000100:00100000:1.0:1789760735.702345:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520923904
00000100:00100000:1.0:1789760735.702399:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707311785199 time 707354704793 state 0x0 ref 1
00000100:00100000:1.0:1789760735.702413:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707354965209 time 707354704793 state 0x1 ref 1
00000100:00100000:1.0:1789760735.702451:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707354965209 time 707389133015 state 0x0 ref 1
00000100:00100000:1.0:1789760735.702463:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520923904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.702510:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21331968, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.702520:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.702535:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.702539:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.702545:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.702559:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760735.736098:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21331968 -> 21336064
00010000:00010000:1.0:1789760735.736119:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.736132:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.736147:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.736155:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.736161:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.736170:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.736188:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.736195:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c149 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21331968->21336063] (req 21331968->21336063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.736283:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520923904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33816us (34043us total) trans 4294972528 rc 0/0
00000100:00100000:1.0:1789760735.736294:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5241
00000100:00100000:1.0:1789760735.736304:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707354965209 time 707389133015 state 0x2 ref 0
00000001:00080000:0.0:1789760735.736590:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972528 is committed
00000100:00100000:2.0:1789760735.740630:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.740718:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520924032
00000100:00100000:1.0:1789760735.740727:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520924032
00000100:00100000:1.0:1789760735.740777:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707354965209 time 707389133015 state 0x0 ref 1
00000100:00100000:1.0:1789760735.740804:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707389393431 time 707389133015 state 0x1 ref 1
00000100:00100000:1.0:1789760735.740935:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707389393431 time 707427615966 state 0x0 ref 1
00000100:00100000:1.0:1789760735.740949:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520924032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.741000:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21336064, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.741009:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.741025:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.741029:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.741036:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.741051:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760735.776144:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21336064 -> 21340160
00010000:00010000:1.0:1789760735.776164:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.776176:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.776185:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.776192:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.776198:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.776207:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.776228:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.776233:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c150 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21336064->21340159] (req 21336064->21340159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760735.776722:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972529 is committed
00000100:00100000:1.0:1789760735.777170:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520924032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35362us (35686us total) trans 4294972529 rc 0/0
00000100:00100000:1.0:1789760735.777181:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5242
00000100:00100000:1.0:1789760735.777191:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707389393431 time 707427615966 state 0x2 ref 0
00000100:00100000:2.0:1789760735.781012:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760735.781570:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520924160
00000100:00100000:0.0:1789760735.781580:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520924160
00000100:00100000:0.0:1789760735.781638:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707389393431 time 707427615966 state 0x0 ref 1
00000100:00100000:0.0:1789760735.781653:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707427876382 time 707427615966 state 0x1 ref 1
00000100:00100000:1.0:1789760735.781716:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707427876382 time 707468395773 state 0x0 ref 1
00000100:00100000:1.0:1789760735.781730:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520924160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.781795:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21340160, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.781804:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.781819:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.781823:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.781831:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.781960:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760735.804096:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760735.820232:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972530 is committed
00002000:00010000:1.0:1789760735.820374:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21340160 -> 21344256
00010000:00010000:1.0:1789760735.820389:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.820401:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.820410:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.820417:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.820581:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.820592:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.820611:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.820618:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c157 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21340160->21344255] (req 21340160->21344255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.820700:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520924160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38968us (39695us total) trans 4294972530 rc 0/0
00000100:00100000:1.0:1789760735.820710:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5243
00000100:00100000:1.0:1789760735.820719:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707427876382 time 707468395773 state 0x2 ref 0
00000100:00100000:2.0:1789760735.828453:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760735.828540:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520924288
00000100:00100000:3.0:1789760735.828555:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520924288
00000100:00100000:3.0:1789760735.828617:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707427876382 time 707468395773 state 0x0 ref 1
00000100:00100000:3.0:1789760735.828636:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707468656189 time 707468395773 state 0x1 ref 1
00000100:00100000:3.0:1789760735.828671:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707468656189 time 707515352597 state 0x0 ref 1
00000100:00100000:3.0:1789760735.828740:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520924288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760735.828801:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21344256, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:3.0:1789760735.828812:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.828828:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:3.0:1789760735.828832:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760735.828838:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.828851:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760735.865522:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548750208:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760735.865593:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760735.865714:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548750208
00000100:00100000:2.0:1789760735.865722:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548750208
00000100:00100000:2.0:1789760735.865774:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422
00000100:00100000:2.0:1789760735.865795:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548750208:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1789760735.865835:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:2.0:1789760735.865897:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548750208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (304us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760735.865904:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422
00000100:00100000:0.0:1789760735.865995:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548750208:0@lo:41:osp-pre-1-0.0
00002000:00010000:3.0:1789760735.868773:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21344256 -> 21348352
00010000:00010000:3.0:1789760735.868804:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.868817:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.868827:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.868835:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760735.868840:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.868850:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.868870:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760735.868878:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c15e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21344256->21348351] (req 21344256->21348351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760735.868974:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520924288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40288us (40526us total) trans 4294972531 rc 0/0
00000100:00100000:3.0:1789760735.868984:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5244
00000100:00100000:3.0:1789760735.868993:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707468656189 time 707515352597 state 0x2 ref 0
00000001:00080000:0.0:1789760735.869904:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972531 is committed
00000100:00100000:0.0:1789760735.874729:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.874849:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520924416
00000100:00100000:1.0:1789760735.874859:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520924416
00000100:00100000:1.0:1789760735.874914:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707468656189 time 707515352597 state 0x0 ref 1
00000100:00100000:1.0:1789760735.874929:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707515613013 time 707515352597 state 0x1 ref 1
00000100:00100000:1.0:1789760735.874963:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707515613013 time 707561645731 state 0x0 ref 1
00000100:00100000:1.0:1789760735.874976:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520924416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.875027:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21348352, mtime: 0x6aad94e0, atime: 0x0, ctime: 0x6aad94e0, blocks: 0xa807
00010000:00010000:1.0:1789760735.875037:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.875053:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.875057:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.875063:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.875075:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760735.909812:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972532 is committed
00002000:00010000:1.0:1789760735.909897:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21348352 -> 21352448
00002000:00010000:1.0:1789760735.909902:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760736 -> 1789760737
00002000:00010000:1.0:1789760735.909905:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760736 -> 1789760737
00010000:00010000:1.0:1789760735.909918:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.909931:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.909940:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.909948:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760735.909953:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.909962:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.909980:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.909988:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c165 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21348352->21352447] (req 21348352->21352447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760735.910125:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520924416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35146us (35400us total) trans 4294972532 rc 0/0
00000100:00100000:1.0:1789760735.910136:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5245
00000100:00100000:1.0:1789760735.910145:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707515613013 time 707561645731 state 0x2 ref 0
00000100:00100000:2.0:1789760735.916940:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.917038:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520924544
00000100:00100000:1.0:1789760735.917047:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520924544
00000100:00100000:1.0:1789760735.917176:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707515613013 time 707561645731 state 0x0 ref 1
00000100:00100000:1.0:1789760735.917193:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707561906147 time 707561645731 state 0x1 ref 1
00000100:00100000:1.0:1789760735.917226:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707561906147 time 707603908117 state 0x0 ref 1
00000100:00100000:1.0:1789760735.917238:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520924544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.917287:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21352448, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:1.0:1789760735.917297:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.917495:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.917500:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.917508:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.917522:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760735.958015:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972533 is committed
00002000:00010000:2.0:1789760735.958099:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21352448 -> 21356544
00010000:00010000:2.0:1789760735.958114:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.958133:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.958143:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.958151:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760735.958155:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.958164:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.958183:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.958191:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c16c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21352448->21356543] (req 21352448->21356543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760735.958408:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520924544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41072us (41378us total) trans 4294972533 rc 0/0
00000100:00100000:2.0:1789760735.958593:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5246
00000100:00100000:2.0:1789760735.958605:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707561906147 time 707603908117 state 0x2 ref 0
00000100:00100000:2.0:1789760735.962141:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760735.962227:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520924672
00000100:00100000:1.0:1789760735.962237:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520924672
00000100:00100000:1.0:1789760735.962288:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707561906147 time 707603908117 state 0x0 ref 1
00000100:00100000:1.0:1789760735.962304:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707604168533 time 707603908117 state 0x1 ref 1
00000100:00100000:1.0:1789760735.962437:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707604168533 time 707649050156 state 0x0 ref 1
00000100:00100000:1.0:1789760735.962453:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520924672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760735.962501:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21356544, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:1.0:1789760735.962510:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.962524:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760735.962528:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760735.962535:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760735.962548:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760735.998037:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972534 is committed
00002000:00010000:2.0:1789760735.998203:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21356544 -> 21360640
00010000:00010000:2.0:1789760735.998218:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.998231:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.998240:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.998247:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760735.998251:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.998259:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.998278:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760735.998286:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c173 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21356544->21360639] (req 21356544->21360639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760735.998421:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520924672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35967us (36284us total) trans 4294972534 rc 0/0
00000100:00100000:2.0:1789760735.998433:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5247
00000100:00100000:2.0:1789760735.998442:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707604168533 time 707649050156 state 0x2 ref 0
00000100:00100000:0.0:1789760736.006819:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.007143:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520924800
00000100:00100000:3.0:1789760736.007153:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520924800
00000100:00100000:3.0:1789760736.007280:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707604168533 time 707649050156 state 0x0 ref 1
00000100:00100000:3.0:1789760736.007297:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707649310572 time 707649050156 state 0x1 ref 1
00000100:00100000:1.0:1789760736.007940:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707649310572 time 707694617984 state 0x0 ref 1
00000100:00100000:1.0:1789760736.007958:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520924800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760736.008009:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21360640, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:1.0:1789760736.008017:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.008033:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:1.0:1789760736.008038:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760736.008044:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.008056:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:2.0:1789760736.008795:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760736.048989:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972535 is committed
00002000:00010000:0.0:1789760736.049099:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21360640 -> 21364736
00010000:00010000:0.0:1789760736.049116:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.049128:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.049137:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.049145:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760736.049150:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.049158:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.049177:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.049185:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c17a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21360640->21364735] (req 21360640->21364735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760736.049282:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520924800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41323us (42468us total) trans 4294972535 rc 0/0
00000100:00100000:0.0:1789760736.049292:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5248
00000100:00100000:0.0:1789760736.049303:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707649310572 time 707694617984 state 0x2 ref 0
00000100:00100000:3.0:1789760736.057759:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760736.057890:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520924928
00000100:00100000:0.0:1789760736.057900:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520924928
00000100:00100000:0.0:1789760736.057952:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707649310572 time 707694617984 state 0x0 ref 1
00000100:00100000:0.0:1789760736.057967:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707694878400 time 707694617984 state 0x1 ref 1
00000100:00100000:0.0:1789760736.058044:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707694878400 time 707744725959 state 0x0 ref 1
00000100:00100000:0.0:1789760736.058062:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520924928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760736.058110:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21364736, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:0.0:1789760736.058120:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.058136:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:0.0:1789760736.058141:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760736.058147:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.058159:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760736.089573:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972536 is committed
00002000:00010000:2.0:1789760736.089670:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21364736 -> 21368832
00010000:00010000:2.0:1789760736.089686:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.089699:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.089707:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.089715:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760736.089720:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.089730:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.089823:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.089833:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c181 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21364736->21368831] (req 21364736->21368831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760736.089921:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520924928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31858us (32167us total) trans 4294972536 rc 0/0
00000100:00100000:2.0:1789760736.089935:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5249
00000100:00100000:2.0:1789760736.089944:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707694878400 time 707744725959 state 0x2 ref 0
00000100:00100000:2.0:1789760736.090930:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760736.091047:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760736.091121:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760736.091143:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.091245:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520925056
00000100:00100000:3.0:1789760736.091254:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520925056
00000100:00100000:3.0:1789760736.091301:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 468
00000100:00100000:3.0:1789760736.091327:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2407:x1876699520925056:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760736.091381:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2407:x1876699520925056:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (260us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760736.091389:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 468
00000100:00100000:0.0:1789760736.091605:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520925184
00000100:00100000:0.0:1789760736.091610:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520925184
00000100:00100000:0.0:1789760736.091690:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520925440
00000100:00100000:0.0:1789760736.091693:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520925440
00000100:00080000:3.0:1789760736.091720:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:2.0:1789760736.091805:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.091918:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520925312
00000100:00100000:3.0:1789760736.091922:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520925312
00000100:00100000:3.0:1789760736.091959:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520925568
00000100:00100000:3.0:1789760736.091962:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520925568
00000100:00100000:3.0:1789760736.091979:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 863
00000100:00100000:3.0:1789760736.091986:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2407:x1876699520925184:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760736.092024:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2407:x1876699520925184:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 39us (1099us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760736.092031:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 863
00000100:00100000:3.0:1789760736.092045:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 864
00000100:00100000:3.0:1789760736.092051:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520925312:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760736.092074:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520925312:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (931us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760736.092080:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 864
00000100:00100000:3.0:1789760736.092253:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 865
00000100:00100000:3.0:1789760736.092261:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520925568:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760736.092288:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520925568:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760736.092294:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 865
00000100:00080000:2.0:1789760736.092497:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1789760736.092592:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 866
00000100:00100000:0.0:1789760736.092601:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520925440:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760736.092632:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520925440:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (1585us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760736.092639:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 866
00000100:00100000:0.0:1789760736.097611:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.098713:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520925696
00000100:00100000:3.0:1789760736.098726:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520925696
00000100:00100000:3.0:1789760736.098855:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707694878400 time 707744725959 state 0x0 ref 1
00000100:00100000:3.0:1789760736.098871:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707744986375 time 707744725959 state 0x1 ref 1
00000100:00100000:3.0:1789760736.098899:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707744986375 time 707785581892 state 0x0 ref 1
00000100:00100000:3.0:1789760736.098913:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520925696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760736.099058:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21368832, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:3.0:1789760736.099068:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.099439:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:3.0:1789760736.099445:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760736.099453:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.099469:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760736.135631:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21368832 -> 21372928
00010000:00010000:0.0:1789760736.135650:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.135667:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.135676:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.135682:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760736.135690:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.135699:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.135721:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.135729:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c188 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21368832->21372927] (req 21368832->21372927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760736.135829:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520925696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36915us (38225us total) trans 4294972537 rc 0/0
00000100:00100000:0.0:1789760736.135845:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5250
00000100:00100000:0.0:1789760736.135855:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707744986375 time 707785581892 state 0x2 ref 0
00000001:00080000:3.0:1789760736.136371:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972537 is committed
00000100:00100000:0.0:1789760736.143672:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760736.143767:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520925824
00000100:00100000:2.0:1789760736.143791:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520925824
00000100:00100000:2.0:1789760736.143846:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707744986375 time 707785581892 state 0x0 ref 1
00000100:00100000:2.0:1789760736.143861:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707785842308 time 707785581892 state 0x1 ref 1
00000100:00100000:2.0:1789760736.143896:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707785842308 time 707830578501 state 0x0 ref 1
00000100:00100000:2.0:1789760736.143907:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520925824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760736.143958:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21372928, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:2.0:1789760736.143968:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.143989:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:2.0:1789760736.143993:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760736.143999:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.144018:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760736.205531:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972538 is committed
00002000:00010000:3.0:1789760736.205595:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21372928 -> 21377024
00010000:00010000:3.0:1789760736.205610:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.205627:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.205635:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.205642:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760736.205647:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.205655:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.205685:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.205697:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c18f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21372928->21377023] (req 21372928->21377023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760736.205800:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520925824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61889us (62131us total) trans 4294972538 rc 0/0
00000100:00100000:3.0:1789760736.205811:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5251
00000100:00100000:3.0:1789760736.205824:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707785842308 time 707830578501 state 0x2 ref 0
00000100:00100000:1.0:1789760736.209483:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760736.209991:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520925952
00000100:00100000:0.0:1789760736.210001:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520925952
00000100:00100000:0.0:1789760736.210069:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707785842308 time 707830578501 state 0x0 ref 1
00000100:00100000:0.0:1789760736.210086:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707830838917 time 707830578501 state 0x1 ref 1
00000100:00100000:0.0:1789760736.210114:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707830838917 time 707896796069 state 0x0 ref 1
00000100:00100000:0.0:1789760736.210127:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520925952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760736.210177:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21377024, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:0.0:1789760736.210186:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.210201:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:0.0:1789760736.210206:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760736.210213:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.210228:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760736.244546:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972539 is committed
00002000:00010000:2.0:1789760736.244666:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21377024 -> 21381120
00010000:00010000:2.0:1789760736.244682:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.244694:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.244703:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.244710:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760736.244714:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.244723:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.244741:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.244749:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c196 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21377024->21381119] (req 21377024->21381119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760736.244887:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520925952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34759us (35409us total) trans 4294972539 rc 0/0
00000100:00100000:2.0:1789760736.244898:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5252
00000100:00100000:2.0:1789760736.244908:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707830838917 time 707896796069 state 0x2 ref 0
00000100:00100000:0.0:1789760736.248865:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760736.249004:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520926080
00000100:00100000:2.0:1789760736.249013:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520926080
00000100:00100000:2.0:1789760736.249065:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707830838917 time 707896796069 state 0x0 ref 1
00000100:00100000:2.0:1789760736.249079:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707897056485 time 707896796069 state 0x1 ref 1
00000100:00100000:2.0:1789760736.249133:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707897056485 time 707935815916 state 0x0 ref 1
00000100:00100000:2.0:1789760736.249145:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520926080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760736.249190:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21381120, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:2.0:1789760736.249200:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.249217:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:2.0:1789760736.249222:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760736.249229:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.249243:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760736.282851:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972540 is committed
00002000:00010000:3.0:1789760736.282931:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21381120 -> 21385216
00010000:00010000:3.0:1789760736.282997:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.283009:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.283015:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.283020:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760736.283023:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.283029:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.283044:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.283049:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c19d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21381120->21385215] (req 21381120->21385215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760736.283170:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520926080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34020us (34306us total) trans 4294972540 rc 0/0
00000100:00100000:3.0:1789760736.283182:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5253
00000100:00100000:3.0:1789760736.283191:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707897056485 time 707935815916 state 0x2 ref 0
00000100:00100000:0.0:1789760736.288648:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.288770:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520926208
00000100:00100000:3.0:1789760736.288788:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520926208
00000100:00100000:3.0:1789760736.288844:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707897056485 time 707935815916 state 0x0 ref 1
00000100:00100000:3.0:1789760736.288859:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707936076332 time 707935815916 state 0x1 ref 1
00000100:00100000:3.0:1789760736.288889:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707936076332 time 707975571539 state 0x0 ref 1
00000100:00100000:3.0:1789760736.288901:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520926208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760736.289057:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21385216, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:3.0:1789760736.289067:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.289082:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=707s v=(0 0)
00010000:00010000:3.0:1789760736.289086:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760736.289092:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.289105:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760736.321837:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21385216 -> 21389312
00010000:00010000:0.0:1789760736.321855:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.321875:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.321884:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.321891:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760736.321896:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.321919:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.321941:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.321956:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c1a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21385216->21389311] (req 21385216->21389311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760736.322053:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520926208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33148us (33411us total) trans 4294972541 rc 0/0
00000100:00100000:0.0:1789760736.322063:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5254
00000100:00100000:0.0:1789760736.322073:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707936076332 time 707975571539 state 0x2 ref 0
00000001:00080000:3.0:1789760736.325593:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972541 is committed
00000100:00100000:1.0:1789760736.326304:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.326590:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520926336
00000100:00100000:3.0:1789760736.326600:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520926336
00000100:00100000:3.0:1789760736.326649:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707936076332 time 707975571539 state 0x0 ref 1
00000100:00100000:3.0:1789760736.326664:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707975831955 time 707975571539 state 0x1 ref 1
00000100:00100000:3.0:1789760736.326694:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707975831955 time 708013376600 state 0x0 ref 1
00000100:00100000:3.0:1789760736.326706:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520926336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760736.326751:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21389312, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:3.0:1789760736.326760:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.326785:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:3.0:1789760736.326790:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760736.326797:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.326811:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760736.352405:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972542 is committed
00002000:00010000:3.0:1789760736.352703:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21389312 -> 21393408
00010000:00010000:3.0:1789760736.352720:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.352734:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.352743:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.352751:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760736.352756:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.352765:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.352794:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.352802:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21389312->21393407] (req 21389312->21393407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760736.352891:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520926336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26182us (26587us total) trans 4294972542 rc 0/0
00000100:00100000:3.0:1789760736.352902:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5255
00000100:00100000:3.0:1789760736.352911:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707975831955 time 708013376600 state 0x2 ref 0
00000100:00100000:1.0:1789760736.356198:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760736.356281:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520926464
00000100:00100000:0.0:1789760736.356290:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520926464
00000100:00100000:0.0:1789760736.356381:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 707975831955 time 708013376600 state 0x0 ref 1
00000100:00100000:0.0:1789760736.356396:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708013637016 time 708013376600 state 0x1 ref 1
00000100:00100000:0.0:1789760736.356431:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708013637016 time 708043113173 state 0x0 ref 1
00000100:00100000:0.0:1789760736.356443:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520926464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760736.356491:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21393408, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:0.0:1789760736.356501:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.356516:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:0.0:1789760736.356521:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760736.356528:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.356541:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760736.378745:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789760736.378766:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548750336:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1789760736.378843:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760736.378919:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548750336
00000100:00100000:2.0:1789760736.378926:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548750336
00000100:00100000:2.0:1789760736.378988:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354
00000100:00100000:2.0:1789760736.378997:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548750336:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1789760736.379018:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527630336 pending 1703936 free 3836739584 avail 3809476608
00000100:00100000:2.0:1789760736.379064:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548750336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (221us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760736.379072:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354
00000100:00080000:2.0:1789760736.379091:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789760736.379127:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548750336:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1789760736.379585:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548750464:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760736.379617:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760736.379649:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548750464
00000100:00100000:3.0:1789760736.379653:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548750464
00000100:00100000:3.0:1789760736.379680:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355
00000100:00100000:3.0:1789760736.379686:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548750464:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1789760736.379697:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527630336 pending 1703936 free 3836739584 avail 3809476608
00000100:00100000:3.0:1789760736.379728:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548750464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (110us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760736.379734:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355
00000100:00100000:3.0:1789760736.379760:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548750464:0@lo:13:osp-pre-0-0.0
00000100:00080000:2.0:1789760736.379819:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:1.0:1789760736.390588:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21393408 -> 21397504
00010000:00010000:1.0:1789760736.390608:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.390621:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.390630:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.390638:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760736.390643:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.390653:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.390671:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.390678:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c1b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21393408->21397503] (req 21393408->21397503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760736.390766:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520926464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34320us (34570us total) trans 4294972543 rc 0/0
00000100:00100000:1.0:1789760736.390785:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5256
00000100:00100000:1.0:1789760736.390794:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708013637016 time 708043113173 state 0x2 ref 0
00000001:00080000:3.0:1789760736.390857:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972543 is committed
00000100:00100000:1.0:1789760736.395534:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760736.395627:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520926592
00000100:00100000:2.0:1789760736.395637:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520926592
00000100:00100000:2.0:1789760736.395690:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708013637016 time 708043113173 state 0x0 ref 1
00000100:00100000:2.0:1789760736.395704:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708043373589 time 708043113173 state 0x1 ref 1
00000100:00100000:2.0:1789760736.395774:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708043373589 time 708082455254 state 0x0 ref 1
00000100:00100000:2.0:1789760736.395797:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520926592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760736.395845:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21397504, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:2.0:1789760736.395856:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.395872:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:2.0:1789760736.395876:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760736.395882:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.395896:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760736.432809:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972544 is committed
00002000:00010000:2.0:1789760736.432893:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21397504 -> 21401600
00010000:00010000:2.0:1789760736.432909:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.432923:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.432932:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.432940:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760736.432944:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.432954:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.432978:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.432986:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c1b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21397504->21401599] (req 21397504->21401599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760736.433080:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520926592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37281us (37550us total) trans 4294972544 rc 0/0
00000100:00100000:2.0:1789760736.433090:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5257
00000100:00100000:2.0:1789760736.433099:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708043373589 time 708082455254 state 0x2 ref 0
00000100:00100000:0.0:1789760736.440597:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760736.440649:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520926720
00000100:00100000:1.0:1789760736.440660:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520926720
00000100:00100000:1.0:1789760736.440720:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708043373589 time 708082455254 state 0x0 ref 1
00000100:00100000:1.0:1789760736.440737:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708082715670 time 708082455254 state 0x1 ref 1
00000100:00100000:1.0:1789760736.440770:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708082715670 time 708127452785 state 0x0 ref 1
00000100:00100000:1.0:1789760736.440794:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520926720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760736.440846:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21401600, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:1.0:1789760736.440854:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.440870:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760736.440875:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760736.440881:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.440895:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760736.503804:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972545 is committed
00002000:00010000:1.0:1789760736.503886:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21401600 -> 21405696
00010000:00010000:1.0:1789760736.503901:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.503914:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.503923:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.503931:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760736.503935:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.503944:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.503964:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.503972:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21401600->21405695] (req 21401600->21405695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760736.504093:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520926720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63297us (63505us total) trans 4294972545 rc 0/0
00000100:00100000:1.0:1789760736.504103:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5258
00000100:00100000:1.0:1789760736.504112:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708082715670 time 708127452785 state 0x2 ref 0
00000100:00100000:0.0:1789760736.512496:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.512794:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520926848
00000100:00100000:3.0:1789760736.512805:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520926848
00000100:00100000:3.0:1789760736.512857:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708082715670 time 708127452785 state 0x0 ref 1
00000100:00100000:3.0:1789760736.512871:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708127713201 time 708127452785 state 0x1 ref 1
00000100:00100000:3.0:1789760736.513007:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708127713201 time 708199688492 state 0x0 ref 1
00000100:00100000:3.0:1789760736.513020:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520926848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760736.513067:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21405696, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:3.0:1789760736.513075:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.513090:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:3.0:1789760736.513094:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760736.513099:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.513112:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760736.557835:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972546 is committed
00002000:00010000:3.0:1789760736.557936:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21405696 -> 21409792
00010000:00010000:3.0:1789760736.557952:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.557969:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.557977:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.557983:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760736.557988:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.557996:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.558013:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.558020:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21405696->21409791] (req 21405696->21409791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760736.558113:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520926848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45091us (45621us total) trans 4294972546 rc 0/0
00000100:00100000:3.0:1789760736.558123:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5259
00000100:00100000:3.0:1789760736.558133:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708127713201 time 708199688492 state 0x2 ref 0
00000100:00100000:2.0:1789760736.562072:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760736.562157:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520926976
00000100:00100000:0.0:1789760736.562166:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520926976
00000100:00100000:0.0:1789760736.562226:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708127713201 time 708199688492 state 0x0 ref 1
00000100:00100000:0.0:1789760736.562240:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708199948908 time 708199688492 state 0x1 ref 1
00000100:00100000:0.0:1789760736.562275:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708199948908 time 708248956828 state 0x0 ref 1
00000100:00100000:0.0:1789760736.562286:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520926976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760736.562368:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21409792, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:0.0:1789760736.562377:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.562393:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:0.0:1789760736.562398:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760736.562404:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.562427:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760736.591758:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972547 is committed
00002000:00010000:1.0:1789760736.591843:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21409792 -> 21413888
00010000:00010000:1.0:1789760736.591858:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.591871:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.591949:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.591958:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760736.591964:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.591978:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.591998:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.592006:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c1ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21409792->21413887] (req 21409792->21413887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760736.592132:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520926976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29842us (30063us total) trans 4294972547 rc 0/0
00000100:00100000:1.0:1789760736.592143:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5260
00000100:00100000:1.0:1789760736.592153:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708199948908 time 708248956828 state 0x2 ref 0
00000100:00100000:1.0:1789760736.599553:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760736.602080:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520927104
00000100:00100000:2.0:1789760736.602095:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520927104
00000100:00100000:2.0:1789760736.602157:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708199948908 time 708248956828 state 0x0 ref 1
00000100:00100000:2.0:1789760736.602273:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708249217244 time 708248956828 state 0x1 ref 1
00000100:00100000:2.0:1789760736.602383:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708249217244 time 708289064230 state 0x0 ref 1
00000100:00100000:2.0:1789760736.602398:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520927104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760736.602449:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21413888, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:2.0:1789760736.602458:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.602479:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:2.0:1789760736.602483:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760736.602490:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760736.602502:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760736.657935:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21413888 -> 21417984
00010000:00010000:1.0:1789760736.657955:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.657969:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.657978:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.657991:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760736.657995:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.658004:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.658023:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.658031:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c1d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21413888->21417983] (req 21413888->21417983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760736.658287:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520927104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55886us (58737us total) trans 4294972548 rc 0/0
00000100:00100000:1.0:1789760736.658297:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5261
00000100:00100000:1.0:1789760736.658349:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708249217244 time 708289064230 state 0x2 ref 0
00000001:00080000:2.0:1789760736.658475:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972548 is committed
00000100:00100000:0.0:1789760736.666626:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760736.668857:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520927232
00000100:00100000:1.0:1789760736.668871:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520927232
00000100:00100000:1.0:1789760736.668929:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708249217244 time 708289064230 state 0x0 ref 1
00000100:00100000:1.0:1789760736.668946:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708289324646 time 708289064230 state 0x1 ref 1
00000100:00100000:1.0:1789760736.668981:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708289324646 time 708355663105 state 0x0 ref 1
00000100:00100000:1.0:1789760736.669002:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520927232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760736.669053:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21417984, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:1.0:1789760736.669061:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.669077:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760736.669081:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760736.669087:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.669101:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760736.712433:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972549 is committed
00002000:00010000:1.0:1789760736.712501:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21417984 -> 21422080
00010000:00010000:1.0:1789760736.712515:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.712533:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.712542:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.712549:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760736.712554:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.712564:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.712583:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.712591:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21417984->21422079] (req 21417984->21422079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760736.712682:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520927232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43682us (46060us total) trans 4294972549 rc 0/0
00000100:00100000:1.0:1789760736.712693:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5262
00000100:00100000:1.0:1789760736.712702:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708289324646 time 708355663105 state 0x2 ref 0
00000100:00100000:0.0:1789760736.717892:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.717982:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520927360
00000100:00100000:3.0:1789760736.717992:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520927360
00000100:00100000:3.0:1789760736.718044:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708289324646 time 708355663105 state 0x0 ref 1
00000100:00100000:3.0:1789760736.718059:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708355923521 time 708355663105 state 0x1 ref 1
00000100:00100000:3.0:1789760736.718085:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708355923521 time 708404768258 state 0x0 ref 1
00000100:00100000:3.0:1789760736.718106:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520927360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760736.718161:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21422080, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:3.0:1789760736.718171:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.718187:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:3.0:1789760736.718192:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760736.718199:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.718214:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760736.749151:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21422080 -> 21426176
00010000:00010000:3.0:1789760736.749173:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.749185:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.749198:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.749206:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760736.749211:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.749232:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.749251:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.749268:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21422080->21426175] (req 21422080->21426175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760736.749497:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520927360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31388us (31608us total) trans 4294972550 rc 0/0
00000100:00100000:3.0:1789760736.749508:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5263
00000100:00100000:3.0:1789760736.749518:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708355923521 time 708404768258 state 0x2 ref 0
00000001:00080000:0.0:1789760736.749794:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972550 is committed
00000100:00100000:0.0:1789760736.753648:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760736.753757:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520927488
00000100:00100000:1.0:1789760736.753767:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520927488
00000100:00100000:1.0:1789760736.753832:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708355923521 time 708404768258 state 0x0 ref 1
00000100:00100000:1.0:1789760736.753848:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708405028674 time 708404768258 state 0x1 ref 1
00000100:00100000:1.0:1789760736.753877:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708405028674 time 708440559515 state 0x0 ref 1
00000100:00100000:1.0:1789760736.753890:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520927488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760736.753938:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21426176, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:1.0:1789760736.753947:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.753964:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760736.753969:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760736.753976:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.753990:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760736.801978:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972551 is committed
00002000:00010000:0.0:1789760736.802420:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21426176 -> 21430272
00010000:00010000:0.0:1789760736.802436:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.802449:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.802463:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.802470:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760736.802475:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.802486:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.802509:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.802519:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c1ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21426176->21430271] (req 21426176->21430271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760736.802623:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520927488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48729us (48981us total) trans 4294972551 rc 0/0
00000100:00100000:0.0:1789760736.802636:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5264
00000100:00100000:0.0:1789760736.802646:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708405028674 time 708440559515 state 0x2 ref 0
00000100:00100000:0.0:1789760736.805898:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760736.805984:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520927616
00000100:00100000:1.0:1789760736.805994:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520927616
00000100:00100000:1.0:1789760736.806047:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708405028674 time 708440559515 state 0x0 ref 1
00000100:00100000:1.0:1789760736.806061:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708440819931 time 708440559515 state 0x1 ref 1
00000100:00100000:1.0:1789760736.806086:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708440819931 time 708492769000 state 0x0 ref 1
00000100:00100000:1.0:1789760736.806095:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520927616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760736.806148:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21430272, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:1.0:1789760736.806158:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.806176:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760736.806181:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760736.806188:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.806207:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.826214:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760736.840525:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972552 is committed
00002000:00010000:1.0:1789760736.840627:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21430272 -> 21434368
00010000:00010000:1.0:1789760736.840644:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.840658:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.840667:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.840674:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760736.840679:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.840688:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.840709:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.840717:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c1f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21430272->21434367] (req 21430272->21434367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760736.840823:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520927616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34722us (34929us total) trans 4294972552 rc 0/0
00000100:00100000:1.0:1789760736.840834:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5265
00000100:00100000:1.0:1789760736.840844:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708440819931 time 708492769000 state 0x2 ref 0
00000100:00100000:3.0:1789760736.848366:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760736.848498:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520927744
00000100:00100000:0.0:1789760736.848513:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520927744
00000100:00100000:0.0:1789760736.848582:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708440819931 time 708492769000 state 0x0 ref 1
00000100:00100000:0.0:1789760736.848597:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708493029416 time 708492769000 state 0x1 ref 1
00000100:00100000:0.0:1789760736.848638:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708493029416 time 708535319753 state 0x0 ref 1
00000100:00100000:0.0:1789760736.848651:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520927744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760736.848708:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21434368, mtime: 0x6aad94e1, atime: 0x0, ctime: 0x6aad94e1, blocks: 0xa807
00010000:00010000:0.0:1789760736.848717:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.848991:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:0.0:1789760736.848996:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760736.849002:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760736.849016:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760736.891950:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21434368 -> 21438464
00002000:00010000:1.0:1789760736.891965:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760737 -> 1789760738
00002000:00010000:1.0:1789760736.891968:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760737 -> 1789760738
00010000:00010000:1.0:1789760736.891987:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.892005:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.892016:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.892025:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760736.892031:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.892042:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.892068:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.892078:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c1f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21434368->21438463] (req 21434368->21438463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760736.892203:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520927744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43548us (43890us total) trans 4294972553 rc 0/0
00000100:00100000:1.0:1789760736.892216:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5266
00000100:00100000:1.0:1789760736.892229:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708493029416 time 708535319753 state 0x2 ref 0
00000001:00080000:3.0:1789760736.893953:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972553 is committed
00000100:00100000:0.0:1789760736.895250:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760736.895645:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520927872
00000100:00100000:3.0:1789760736.895658:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520927872
00000100:00100000:3.0:1789760736.895731:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708493029416 time 708535319753 state 0x0 ref 1
00000100:00100000:3.0:1789760736.895750:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708535580169 time 708535319753 state 0x1 ref 1
00000100:00100000:3.0:1789760736.895832:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708535580169 time 708582513064 state 0x0 ref 1
00000100:00100000:3.0:1789760736.895847:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520927872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760736.895912:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21438464, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:3.0:1789760736.895923:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.895943:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:3.0:1789760736.895948:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760736.895955:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.895973:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760736.933275:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972554 is committed
00002000:00010000:3.0:1789760736.933337:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21438464 -> 21442560
00010000:00010000:3.0:1789760736.933359:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.933375:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.933391:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.933400:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760736.933405:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.933416:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.933441:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.933460:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c1ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21438464->21442559] (req 21438464->21442559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760736.933595:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520927872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37743us (38351us total) trans 4294972554 rc 0/0
00000100:00100000:3.0:1789760736.933606:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5267
00000100:00100000:3.0:1789760736.933618:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708535580169 time 708582513064 state 0x2 ref 0
00000100:00100000:0.0:1789760736.936610:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760736.936733:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520928000
00000100:00100000:1.0:1789760736.936745:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520928000
00000100:00100000:1.0:1789760736.936839:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708535580169 time 708582513064 state 0x0 ref 1
00000100:00100000:1.0:1789760736.936859:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708582773480 time 708582513064 state 0x1 ref 1
00000100:00100000:1.0:1789760736.936894:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708582773480 time 708623576082 state 0x0 ref 1
00000100:00100000:1.0:1789760736.936908:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520928000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760736.936971:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21442560, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760736.936983:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.937004:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760736.937009:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760736.937017:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.937038:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760736.986073:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972555 is committed
00002000:00010000:3.0:1789760736.989000:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21442560 -> 21446656
00010000:00010000:3.0:1789760736.989031:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.989061:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.989072:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.989080:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760736.989086:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.989097:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.989124:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760736.989134:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c206 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21442560->21446655] (req 21442560->21446655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760736.989466:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520928000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52551us (52861us total) trans 4294972555 rc 0/0
00000100:00100000:3.0:1789760736.989480:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5268
00000100:00100000:3.0:1789760736.989493:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708582773480 time 708623576082 state 0x2 ref 0
00000100:00100000:0.0:1789760736.992980:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760736.993099:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520928128
00000100:00100000:1.0:1789760736.993111:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520928128
00000100:00100000:1.0:1789760736.993179:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708582773480 time 708623576082 state 0x0 ref 1
00000100:00100000:1.0:1789760736.993195:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708623836498 time 708623576082 state 0x1 ref 1
00000100:00100000:1.0:1789760736.993254:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708623836498 time 708679935715 state 0x0 ref 1
00000100:00100000:1.0:1789760736.993268:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520928128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760736.993535:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21446656, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760736.993548:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.993568:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760736.993573:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760736.993580:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760736.993597:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760737.030203:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972556 is committed
00002000:00010000:3.0:1789760737.030514:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21446656 -> 21450752
00010000:00010000:3.0:1789760737.030535:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.030551:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.030561:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.030571:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760737.030577:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.030587:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.030613:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.030621:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c20d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21446656->21450751] (req 21446656->21450751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760737.030808:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520928128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37534us (37836us total) trans 4294972556 rc 0/0
00000100:00100000:3.0:1789760737.030822:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5269
00000100:00100000:3.0:1789760737.030834:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708623836498 time 708679935715 state 0x2 ref 0
00000100:00100000:0.0:1789760737.035552:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760737.035850:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520928256
00000100:00100000:1.0:1789760737.035865:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520928256
00000100:00100000:1.0:1789760737.035940:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708623836498 time 708679935715 state 0x0 ref 1
00000100:00100000:1.0:1789760737.035959:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708680196131 time 708679935715 state 0x1 ref 1
00000100:00100000:1.0:1789760737.035990:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708680196131 time 708722671758 state 0x0 ref 1
00000100:00100000:1.0:1789760737.036004:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520928256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760737.036073:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21450752, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760737.036085:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.036104:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760737.036109:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760737.036116:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.036133:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760737.077503:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972557 is committed
00002000:00010000:0.0:1789760737.077627:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21450752 -> 21454848
00010000:00010000:0.0:1789760737.077645:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.077656:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.077663:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.077668:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760737.077673:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.077680:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.077700:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.077707:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c214 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21450752->21454847] (req 21450752->21454847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760737.077905:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520928256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41896us (42360us total) trans 4294972557 rc 0/0
00000100:00100000:0.0:1789760737.077918:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5270
00000100:00100000:0.0:1789760737.077934:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708680196131 time 708722671758 state 0x2 ref 0
00000100:00100000:0.0:1789760737.079998:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760737.080109:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520928384
00000100:00100000:3.0:1789760737.080121:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520928384
00000100:00100000:3.0:1789760737.080200:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708680196131 time 708722671758 state 0x0 ref 1
00000100:00100000:3.0:1789760737.080219:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708722932174 time 708722671758 state 0x1 ref 1
00000100:00100000:3.0:1789760737.080256:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708722932174 time 708766938287 state 0x0 ref 1
00000100:00100000:3.0:1789760737.080270:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520928384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760737.080875:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21454848, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:2.0:1789760737.080885:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.080901:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:2.0:1789760737.080905:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760737.080911:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.080923:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760737.118810:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972558 is committed
00002000:00010000:2.0:1789760737.118914:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21454848 -> 21458944
00010000:00010000:2.0:1789760737.118934:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.118950:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.118963:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.118972:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760737.118978:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.118989:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.119014:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.119023:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c21b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21454848->21458943] (req 21454848->21458943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760737.119194:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520928384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38919us (39208us total) trans 4294972558 rc 0/0
00000100:00100000:2.0:1789760737.119206:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5271
00000100:00100000:2.0:1789760737.119218:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708722932174 time 708766938287 state 0x2 ref 0
00000100:00100000:3.0:1789760737.129264:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760737.135911:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520928512
00000100:00100000:1.0:1789760737.135935:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520928512
00000100:00100000:1.0:1789760737.136026:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708722932174 time 708766938287 state 0x0 ref 1
00000100:00100000:1.0:1789760737.136048:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708767198703 time 708766938287 state 0x1 ref 1
00000100:00100000:1.0:1789760737.136158:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708767198703 time 708822839175 state 0x0 ref 1
00000100:00100000:1.0:1789760737.136180:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520928512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760737.136252:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21458944, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760737.136265:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.136286:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760737.136292:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760737.136300:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.136352:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760737.187025:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972559 is committed
00002000:00010000:0.0:1789760737.187360:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21458944 -> 21463040
00010000:00010000:0.0:1789760737.187380:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.187397:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.187569:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.187579:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760737.187585:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.187595:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.187621:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.187630:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c222 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21458944->21463039] (req 21458944->21463039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760737.187754:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520928512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51571us (58497us total) trans 4294972559 rc 0/0
00000100:00100000:0.0:1789760737.187779:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5272
00000100:00100000:0.0:1789760737.187793:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708767198703 time 708822839175 state 0x2 ref 0
00000100:00100000:0.0:1789760737.193760:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760737.194355:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520928640
00000100:00100000:1.0:1789760737.194371:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520928640
00000100:00100000:1.0:1789760737.194458:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708767198703 time 708822839175 state 0x0 ref 1
00000100:00100000:1.0:1789760737.194477:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708823099591 time 708822839175 state 0x1 ref 1
00000100:00100000:1.0:1789760737.194514:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708823099591 time 708881195994 state 0x0 ref 1
00000100:00100000:1.0:1789760737.194528:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520928640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760737.194595:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21463040, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760737.194605:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.194631:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:1.0:1789760737.194636:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760737.194644:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.194659:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760737.236603:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21463040 -> 21467136
00010000:00010000:1.0:1789760737.236632:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.236647:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.236657:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.236666:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760737.236671:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.236681:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.236716:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.236727:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c229 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21463040->21467135] (req 21463040->21467135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760737.236866:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520928640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42333us (43112us total) trans 4294972560 rc 0/0
00000100:00100000:1.0:1789760737.236878:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5273
00000100:00100000:1.0:1789760737.236891:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708823099591 time 708881195994 state 0x2 ref 0
00000001:00080000:2.0:1789760737.238945:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972560 is committed
00000100:00100000:2.0:1789760737.240230:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760737.240376:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520928768
00000100:00100000:0.0:1789760737.240392:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520928768
00000100:00100000:0.0:1789760737.240480:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708823099591 time 708881195994 state 0x0 ref 1
00000100:00100000:0.0:1789760737.240500:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708881456410 time 708881195994 state 0x1 ref 1
00000100:00100000:0.0:1789760737.240537:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708881456410 time 708927219086 state 0x0 ref 1
00000100:00100000:0.0:1789760737.240557:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520928768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760737.240621:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21467136, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:0.0:1789760737.240632:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.240651:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=708s v=(0 0)
00010000:00010000:0.0:1789760737.240657:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760737.240665:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.240683:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760737.319151:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972561 is committed
00002000:00010000:0.0:1789760737.319261:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21467136 -> 21471232
00010000:00010000:0.0:1789760737.319276:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.319289:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.319308:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.319345:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760737.319350:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.319361:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.319382:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.319391:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c230 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21467136->21471231] (req 21467136->21471231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760737.319478:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520928768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 78925us (79253us total) trans 4294972561 rc 0/0
00000100:00100000:0.0:1789760737.319489:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5274
00000100:00100000:0.0:1789760737.319498:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708881456410 time 708927219086 state 0x2 ref 0
00000100:00100000:0.0:1789760737.329572:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760737.329674:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520928896
00000100:00100000:2.0:1789760737.329683:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520928896
00000100:00100000:2.0:1789760737.329734:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708881456410 time 708927219086 state 0x0 ref 1
00000100:00100000:2.0:1789760737.329750:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708927479502 time 708927219086 state 0x1 ref 1
00000100:00100000:2.0:1789760737.329791:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708927479502 time 709016473377 state 0x0 ref 1
00000100:00100000:2.0:1789760737.329804:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520928896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760737.329851:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21471232, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:2.0:1789760737.329860:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.329874:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:2.0:1789760737.329878:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760737.329884:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.329897:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760737.390310:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972562 is committed
00002000:00010000:2.0:1789760737.390470:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21471232 -> 21475328
00010000:00010000:2.0:1789760737.390486:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.390497:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.390505:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.390513:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760737.390517:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.390526:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.390545:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.390554:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c237 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21471232->21475327] (req 21471232->21475327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760737.390649:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520928896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60842us (61081us total) trans 4294972562 rc 0/0
00000100:00100000:2.0:1789760737.390659:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5275
00000100:00100000:2.0:1789760737.390669:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708927479502 time 709016473377 state 0x2 ref 0
00000100:00100000:1.0:1789760737.400786:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760737.400874:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520929024
00000100:00100000:0.0:1789760737.400884:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520929024
00000100:00100000:0.0:1789760737.400932:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 708927479502 time 709016473377 state 0x0 ref 1
00000100:00100000:0.0:1789760737.400946:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709016733793 time 709016473377 state 0x1 ref 1
00000100:00100000:0.0:1789760737.401001:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709016733793 time 709087684228 state 0x0 ref 1
00000100:00100000:0.0:1789760737.401013:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520929024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760737.401059:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21475328, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:0.0:1789760737.401067:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.401094:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:0.0:1789760737.401099:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760737.401105:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.401119:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760737.405126:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548750976:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405194:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405253:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548751488:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.405268:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548750976
00000100:00100000:1.0:1789760737.405277:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548750976
00000100:00100000:0.0:1789760737.405288:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405308:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548752000:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.405348:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867
00000100:00100000:0.0:1789760737.405354:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760737.405362:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548750976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405386:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0]
00000100:00100000:0.0:1789760737.405394:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548750592:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405430:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760737.405448:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548750976:12345-0@lo:400:kworker.0 Request processed in 90us (253us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760737.405458:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867
00000100:00100000:0.0:1789760737.405467:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548751104:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.405491:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548751488
00000100:00100000:0.0:1789760737.405496:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760737.405497:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548751488
00000100:00100000:0.0:1789760737.405519:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548751616:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.405530:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548752000
00000100:00100000:1.0:1789760737.405535:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548752000
00000100:00100000:0.0:1789760737.405545:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405567:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548752128:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.405569:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548751616
00000100:00100000:1.0:1789760737.405574:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548751616
00000100:00100000:0.0:1789760737.405595:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760737.405598:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280
00000100:00100000:1.0:1789760737.405610:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548751488:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405626:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548750976:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405651:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548750720:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405673:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405687:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548751232:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405704:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405715:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548751744:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405735:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405749:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548752256:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760737.405779:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405798:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2]
00000100:00100000:0.0:1789760737.405803:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548750848:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405824:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405838:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548751360:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405857:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405871:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548751872:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.405891:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405901:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548752384:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760737.405922:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760737.405952:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548751104
00000100:00100000:0.0:1789760737.405957:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548751104
00000100:00100000:0.0:1789760737.405984:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548750848
00000100:00100000:0.0:1789760737.405987:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548750848
00000100:00100000:0.0:1789760737.406000:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423
00000100:00100000:0.0:1789760737.406006:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548751104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.406044:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548751488:12345-0@lo:400:kworker.0 Request processed in 434us (753us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760737.406049:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548751104:12345-0@lo:400:kworker.0 Request processed in 40us (552us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760737.406056:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280
00000100:00100000:0.0:1789760737.406061:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423
00000100:00100000:0.0:1789760737.406091:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424
00000100:00100000:0.0:1789760737.406097:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548750848:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.406129:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548750848:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760737.406134:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424
00000100:00100000:0.0:1789760737.406158:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548752128
00000100:00100000:0.0:1789760737.406161:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548752128
00000100:00100000:0.0:1789760737.406177:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281
00000100:00100000:0.0:1789760737.406181:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548752000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.406202:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548752000:12345-0@lo:400:kworker.0 Request processed in 22us (850us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760737.406209:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281
00000100:00100000:0.0:1789760737.406215:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282
00000100:00100000:0.0:1789760737.406218:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548751616:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.406231:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548751616:12345-0@lo:400:kworker.0 Request processed in 13us (688us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760737.406234:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282
00000100:00100000:0.0:1789760737.406240:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283
00000100:00100000:0.0:1789760737.406243:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548752128:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.406254:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548752128:12345-0@lo:400:kworker.0 Request processed in 11us (661us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760737.406257:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283
00000100:00100000:0.0:1789760737.406268:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548750720
00000100:00100000:0.0:1789760737.406270:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548750720
00000100:00100000:3.0:1789760737.406424:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548750592
00000100:00100000:3.0:1789760737.406428:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548750592
00000100:00100000:3.0:1789760737.406459:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469
00000100:00100000:3.0:1789760737.406466:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548750592:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760737.406501:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548750592:12345-0@lo:400:kworker.0 Request processed in 36us (1071us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760737.406507:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469
00000100:00100000:0.0:1789760737.406667:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548751232
00000100:00100000:0.0:1789760737.406671:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548751232
00000100:00100000:0.0:1789760737.406687:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548751744
00000100:00100000:0.0:1789760737.406689:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548751744
00000100:00100000:0.0:1789760737.406702:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548751360
00000100:00100000:0.0:1789760737.406704:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548751360
00000100:00100000:0.0:1789760737.406718:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548751872
00000100:00100000:0.0:1789760737.406721:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548751872
00000100:00100000:0.0:1789760737.406735:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868
00000100:00100000:0.0:1789760737.406742:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548750720:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.406763:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869
00000100:00100000:1.0:1789760737.406787:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548751232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.406800:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548750720:12345-0@lo:400:kworker.0 Request processed in 57us (1123us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760737.406806:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868
00000100:00100000:0.0:1789760737.406824:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870
00000100:00100000:0.0:1789760737.406835:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548751744:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.406835:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548751232:12345-0@lo:400:kworker.0 Request processed in 60us (1126us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760737.406850:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869
00000100:00100000:0.0:1789760737.406876:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548751744:12345-0@lo:400:kworker.0 Request processed in 44us (1139us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760737.406877:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871
00000100:00100000:0.0:1789760737.406888:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870
00000100:00100000:1.0:1789760737.406892:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548751360:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.406909:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872
00000100:00100000:0.0:1789760737.406919:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548751872:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.406932:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548751360:12345-0@lo:400:kworker.0 Request processed in 44us (1072us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760737.406939:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871
00000100:00100000:0.0:1789760737.406957:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548751872:12345-0@lo:400:kworker.0 Request processed in 40us (1064us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760737.406964:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872
00000100:00100000:0.0:1789760737.406988:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548752256
00000100:00100000:0.0:1789760737.406991:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548752256
00000100:00100000:0.0:1789760737.407021:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548752384
00000100:00100000:0.0:1789760737.407024:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548752384
00000100:00100000:0.0:1789760737.407038:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356
00000100:00100000:0.0:1789760737.407044:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548752256:12345-0@lo:13:osp-pre-1-0.0
00000100:00100000:3.0:1789760737.407055:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357
00000100:00100000:3.0:1789760737.407068:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548752384:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1789760737.407070:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00002000:00000024:3.0:1789760737.407092:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760737.407107:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548752256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (1336us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760737.407113:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356
00000100:00100000:3.0:1789760737.407136:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548752384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (1211us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760737.407144:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357
00000100:00100000:0.0:1789760737.407167:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548750848:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.407181:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548751360:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.407190:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548751872:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.407205:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548752384:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760737.407215:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548750720:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.407227:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548751232:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.407236:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548751744:0@lo:400:kworker.0
00000100:00100000:0.0:1789760737.407247:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548752256:0@lo:13:osp-pre-1-0.0
00000100:00080000:1.0:1789760737.407263:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1789760737.407270:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:1.0:1789760737.407274:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789760737.407331:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548750592:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.407347:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548751104:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.407359:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548751616:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.407376:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548752128:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.407393:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548751488:0@lo:400:kworker.0
00000100:00100000:1.0:1789760737.407402:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548752000:0@lo:400:kworker.0
00000001:00080000:2.0:1789760737.450789:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972563 is committed
00002000:00010000:0.0:1789760737.451030:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21475328 -> 21479424
00010000:00010000:0.0:1789760737.451046:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.451058:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.451068:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.451074:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760737.451079:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.451089:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.451107:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.452128:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c23e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21475328->21479423] (req 21475328->21479423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760737.452242:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520929024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51226us (51469us total) trans 4294972563 rc 0/0
00000100:00100000:0.0:1789760737.452253:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5276
00000100:00100000:0.0:1789760737.452262:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709016733793 time 709087684228 state 0x2 ref 0
00000100:00100000:0.0:1789760737.455875:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760737.456004:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520929152
00000100:00100000:1.0:1789760737.456014:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520929152
00000100:00100000:1.0:1789760737.456066:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709016733793 time 709087684228 state 0x0 ref 1
00000100:00100000:1.0:1789760737.456081:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709087944644 time 709087684228 state 0x1 ref 1
00000100:00100000:1.0:1789760737.456225:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709087944644 time 709142906206 state 0x0 ref 1
00000100:00100000:1.0:1789760737.456238:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520929152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760737.456291:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21479424, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760737.456300:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.456355:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:1.0:1789760737.456360:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760737.456367:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.456380:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760737.483373:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972564 is committed
00002000:00010000:1.0:1789760737.483525:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21479424 -> 21483520
00010000:00010000:1.0:1789760737.483541:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.483554:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.483569:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.483577:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760737.483581:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.483591:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.483609:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.483616:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c245 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21479424->21483519] (req 21479424->21483519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760737.483751:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520929152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27509us (27879us total) trans 4294972564 rc 0/0
00000100:00100000:1.0:1789760737.483763:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5277
00000100:00100000:1.0:1789760737.483782:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709087944644 time 709142906206 state 0x2 ref 0
00000100:00100000:3.0:1789760737.487755:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760737.488588:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520929280
00000100:00100000:1.0:1789760737.488598:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520929280
00000100:00100000:0.0:1789760737.488931:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709087944644 time 709142906206 state 0x0 ref 1
00000100:00100000:0.0:1789760737.488946:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709143166622 time 709142906206 state 0x1 ref 1
00000100:00100000:0.0:1789760737.489008:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709143166622 time 709175690641 state 0x0 ref 1
00000100:00100000:0.0:1789760737.489021:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520929280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760737.489069:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21483520, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:0.0:1789760737.489079:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.489093:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:0.0:1789760737.489098:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760737.489104:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.489117:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760737.514088:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972565 is committed
00002000:00010000:0.0:1789760737.514194:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21483520 -> 21487616
00010000:00010000:0.0:1789760737.514211:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.514223:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.514233:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.514241:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760737.514246:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.514256:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.514277:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.514284:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c24c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21483520->21487615] (req 21483520->21487615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760737.514425:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520929280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25401us (26675us total) trans 4294972565 rc 0/0
00000100:00100000:0.0:1789760737.514440:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5278
00000100:00100000:0.0:1789760737.514449:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709143166622 time 709175690641 state 0x2 ref 0
00000100:00100000:0.0:1789760737.520653:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760737.520726:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520929408
00000100:00100000:2.0:1789760737.520736:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520929408
00000100:00100000:2.0:1789760737.520796:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709143166622 time 709175690641 state 0x0 ref 1
00000100:00100000:2.0:1789760737.520811:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709175951057 time 709175690641 state 0x1 ref 1
00000100:00100000:2.0:1789760737.520844:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709175951057 time 709207526208 state 0x0 ref 1
00000100:00100000:2.0:1789760737.520856:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520929408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760737.520905:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21487616, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:2.0:1789760737.520914:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.520929:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:2.0:1789760737.520933:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760737.520939:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.520952:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760737.562485:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21487616 -> 21491712
00010000:00010000:3.0:1789760737.562505:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.562518:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.562527:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.562534:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760737.562538:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.562547:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.562565:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.562572:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c253 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21487616->21491711] (req 21487616->21491711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760737.562663:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520929408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41804us (42013us total) trans 4294972566 rc 0/0
00000100:00100000:3.0:1789760737.562673:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5279
00000100:00100000:3.0:1789760737.562683:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709175951057 time 709207526208 state 0x2 ref 0
00000001:00080000:0.0:1789760737.563848:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972566 is committed
00000100:00100000:0.0:1789760737.568805:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760737.568901:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520929536
00000100:00100000:1.0:1789760737.568911:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520929536
00000100:00100000:1.0:1789760737.568967:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709175951057 time 709207526208 state 0x0 ref 1
00000100:00100000:1.0:1789760737.568982:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709207786624 time 709207526208 state 0x1 ref 1
00000100:00100000:1.0:1789760737.570603:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709207786624 time 709257277006 state 0x0 ref 1
00000100:00100000:1.0:1789760737.570630:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520929536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760737.570690:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21491712, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760737.570700:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.570715:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:1.0:1789760737.570719:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760737.570725:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.570739:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760737.685489:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972567 is committed
00002000:00010000:2.0:1789760737.686031:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21491712 -> 21495808
00010000:00010000:2.0:1789760737.686053:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.686066:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.686074:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.686082:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760737.686087:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.686096:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.686114:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.686121:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c25a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21491712->21495807] (req 21491712->21495807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760737.686216:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520929536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 115593us (117415us total) trans 4294972567 rc 0/0
00000100:00100000:2.0:1789760737.686227:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5280
00000100:00100000:2.0:1789760737.686391:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709207786624 time 709257277006 state 0x2 ref 0
00000100:00100000:2.0:1789760737.698148:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760737.698310:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520929664
00000100:00100000:1.0:1789760737.698347:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520929664
00000100:00100000:1.0:1789760737.698398:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709207786624 time 709257277006 state 0x0 ref 1
00000100:00100000:1.0:1789760737.698413:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709257537422 time 709257277006 state 0x1 ref 1
00000100:00100000:1.0:1789760737.698804:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709257537422 time 709385484501 state 0x0 ref 1
00000100:00100000:1.0:1789760737.698819:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520929664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760737.698871:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21495808, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760737.698881:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.698896:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:1.0:1789760737.698901:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760737.698907:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.698920:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760737.738113:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21495808 -> 21499904
00010000:00010000:3.0:1789760737.738135:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.738150:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.738159:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.738166:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760737.738171:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.738179:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.738199:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.738206:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c261 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21495808->21499903] (req 21495808->21499903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760737.738343:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520929664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39493us (40169us total) trans 4294972568 rc 0/0
00000100:00100000:3.0:1789760737.738359:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5281
00000100:00100000:3.0:1789760737.738368:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709257537422 time 709385484501 state 0x2 ref 0
00000001:00080000:0.0:1789760737.740810:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972568 is committed
00000100:00100000:1.0:1789760737.747485:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760737.747730:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520929792
00000100:00100000:0.0:1789760737.747741:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520929792
00000100:00100000:0.0:1789760737.747814:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709257537422 time 709385484501 state 0x0 ref 1
00000100:00100000:0.0:1789760737.747831:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709385744917 time 709385484501 state 0x1 ref 1
00000100:00100000:0.0:1789760737.747907:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709385744917 time 709434589046 state 0x0 ref 1
00000100:00100000:0.0:1789760737.747921:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520929792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760737.747971:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21499904, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:0.0:1789760737.747980:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.747997:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:0.0:1789760737.748001:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760737.748008:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.748023:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760737.776007:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972569 is committed
00002000:00010000:3.0:1789760737.776259:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21499904 -> 21504000
00010000:00010000:3.0:1789760737.776275:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.776288:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.776306:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.776348:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760737.776354:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.776364:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.776383:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.776391:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c268 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21499904->21503999] (req 21499904->21503999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760737.777681:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520929792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29756us (30199us total) trans 4294972569 rc 0/0
00000100:00100000:0.0:1789760737.777692:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5282
00000100:00100000:0.0:1789760737.777703:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709385744917 time 709434589046 state 0x2 ref 0
00000100:00100000:2.0:1789760737.790252:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760737.790451:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520929920
00000100:00100000:3.0:1789760737.790461:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520929920
00000100:00100000:0.0:1789760737.790626:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709385744917 time 709434589046 state 0x0 ref 1
00000100:00100000:0.0:1789760737.790641:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709434849462 time 709434589046 state 0x1 ref 1
00000100:00100000:0.0:1789760737.790672:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709434849462 time 709477354315 state 0x0 ref 1
00000100:00100000:0.0:1789760737.790712:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520929920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760737.790762:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21504000, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:0.0:1789760737.790779:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.790795:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:0.0:1789760737.790799:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760737.790805:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.790819:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760737.829586:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21504000 -> 21508096
00010000:00010000:2.0:1789760737.829607:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.829620:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.829634:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.829642:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760737.829646:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.829654:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.829673:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760737.829680:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c26f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21504000->21508095] (req 21504000->21508095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760737.829798:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520929920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39085us (39552us total) trans 4294972570 rc 0/0
00000100:00100000:2.0:1789760737.829809:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5283
00000100:00100000:2.0:1789760737.829818:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709434849462 time 709477354315 state 0x2 ref 0
00000001:00080000:2.0:1789760737.829865:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972570 is committed
00000100:00100000:2.0:1789760737.833614:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760737.833742:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520930048
00000100:00100000:1.0:1789760737.833752:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520930048
00000100:00100000:1.0:1789760737.833814:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709434849462 time 709477354315 state 0x0 ref 1
00000100:00100000:1.0:1789760737.833829:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709477614731 time 709477354315 state 0x1 ref 1
00000100:00100000:1.0:1789760737.833867:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709477614731 time 709520549222 state 0x0 ref 1
00000100:00100000:1.0:1789760737.833879:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520930048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760737.833927:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21508096, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:1.0:1789760737.833937:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.833959:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:1.0:1789760737.833963:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760737.833970:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.833983:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.849830:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760737.875287:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972571 is committed
00002000:00010000:3.0:1789760737.875494:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21508096 -> 21512192
00010000:00010000:3.0:1789760737.875511:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.875531:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.875542:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.875549:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760737.875556:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.875565:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.875592:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.875600:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c276 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21508096->21512191] (req 21508096->21512191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760737.875726:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520930048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41842us (42115us total) trans 4294972571 rc 0/0
00000100:00100000:3.0:1789760737.875740:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5284
00000100:00100000:3.0:1789760737.875751:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709477614731 time 709520549222 state 0x2 ref 0
00000100:00100000:1.0:1789760737.888735:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760737.890931:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520930176
00000100:00100000:3.0:1789760737.890947:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520930176
00000100:00100000:3.0:1789760737.891011:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709477614731 time 709520549222 state 0x0 ref 1
00000100:00100000:3.0:1789760737.891027:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709520809638 time 709520549222 state 0x1 ref 1
00000100:00100000:3.0:1789760737.891121:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709520809638 time 709577803587 state 0x0 ref 1
00000100:00100000:3.0:1789760737.891135:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520930176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760737.891183:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21512192, mtime: 0x6aad94e2, atime: 0x0, ctime: 0x6aad94e2, blocks: 0xa807
00010000:00010000:3.0:1789760737.891193:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.891208:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:3.0:1789760737.891213:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760737.891219:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760737.891233:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760737.943825:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972572 is committed
00002000:00010000:1.0:1789760737.943940:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21512192 -> 21516288
00002000:00010000:1.0:1789760737.943951:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760738 -> 1789760739
00002000:00010000:1.0:1789760737.943955:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760738 -> 1789760739
00010000:00010000:1.0:1789760737.943977:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.943994:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.944004:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.944012:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760737.944019:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.944034:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.944069:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760737.944078:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c27d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21512192->21516287] (req 21512192->21516287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760737.944221:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520930176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53080us (55485us total) trans 4294972572 rc 0/0
00000100:00100000:1.0:1789760737.944236:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5285
00000100:00100000:1.0:1789760737.944251:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709520809638 time 709577803587 state 0x2 ref 0
00000100:00100000:1.0:1789760737.953847:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760737.953950:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520930304
00000100:00100000:0.0:1789760737.953961:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520930304
00000100:00100000:0.0:1789760737.954015:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709520809638 time 709577803587 state 0x0 ref 1
00000100:00100000:0.0:1789760737.954031:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709578064003 time 709577803587 state 0x1 ref 1
00000100:00100000:0.0:1789760737.954062:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709578064003 time 709640744247 state 0x0 ref 1
00000100:00100000:0.0:1789760737.954075:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520930304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760737.954126:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21516288, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760737.954136:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.954152:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:0.0:1789760737.954156:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760737.954162:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.954176:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760737.994231:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972573 is committed
00002000:00010000:0.0:1789760737.994310:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21516288 -> 21520384
00010000:00010000:0.0:1789760737.994373:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.994392:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.994400:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.994406:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760737.994411:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.994419:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.994439:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760737.994446:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c284 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21516288->21520383] (req 21516288->21520383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760737.994532:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520930304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40455us (40692us total) trans 4294972573 rc 0/0
00000100:00100000:0.0:1789760737.994542:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5286
00000100:00100000:0.0:1789760737.994551:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709578064003 time 709640744247 state 0x2 ref 0
00000100:00100000:2.0:1789760738.001996:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.002165:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520930432
00000100:00100000:0.0:1789760738.002175:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520930432
00000100:00100000:0.0:1789760738.002254:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709578064003 time 709640744247 state 0x0 ref 1
00000100:00100000:0.0:1789760738.002270:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709641004663 time 709640744247 state 0x1 ref 1
00000100:00100000:0.0:1789760738.002309:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709641004663 time 709688983178 state 0x0 ref 1
00000100:00100000:0.0:1789760738.002743:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520930432:12345-192.168.203.16@tcp:4:dd.0
00000100:00080000:1.0:1789760738.003009:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:0.0:1789760738.003187:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21520384, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.003197:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.003216:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:0.0:1789760738.003221:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.003228:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.003242:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760738.040860:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972574 is committed
00002000:00010000:0.0:1789760738.040977:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21520384 -> 21524480
00010000:00010000:0.0:1789760738.040992:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.041005:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.041018:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.041025:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760738.041030:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.041039:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.041057:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.041153:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c28b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21520384->21524479] (req 21520384->21524479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760738.041242:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520930432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38892us (39252us total) trans 4294972574 rc 0/0
00000100:00100000:0.0:1789760738.041252:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5287
00000100:00100000:0.0:1789760738.041261:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709641004663 time 709688983178 state 0x2 ref 0
00000100:00100000:1.0:1789760738.043913:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760738.043994:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520930560
00000100:00100000:3.0:1789760738.044004:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520930560
00000100:00100000:3.0:1789760738.044055:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709641004663 time 709688983178 state 0x0 ref 1
00000100:00100000:3.0:1789760738.044143:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709689243594 time 709688983178 state 0x1 ref 1
00000100:00100000:3.0:1789760738.044171:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709689243594 time 709730853535 state 0x0 ref 1
00000100:00100000:3.0:1789760738.044184:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520930560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760738.044231:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21524480, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:3.0:1789760738.044240:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.044254:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:3.0:1789760738.044259:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760738.044266:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.044281:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760738.076941:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21524480 -> 21528576
00010000:00010000:0.0:1789760738.076961:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.076981:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.076990:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.076999:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760738.077003:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.077012:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.077033:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.077041:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c292 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21524480->21528575] (req 21524480->21528575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760738.077137:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520930560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32950us (33228us total) trans 4294972575 rc 0/0
00000100:00100000:0.0:1789760738.077148:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5288
00000100:00100000:0.0:1789760738.077158:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709689243594 time 709730853535 state 0x2 ref 0
00000001:00080000:2.0:1789760738.078736:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972575 is committed
00000100:00100000:1.0:1789760738.080654:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760738.080791:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520930688
00000100:00100000:3.0:1789760738.080801:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520930688
00000100:00100000:3.0:1789760738.080863:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709689243594 time 709730853535 state 0x0 ref 1
00000100:00100000:3.0:1789760738.080880:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709731113951 time 709730853535 state 0x1 ref 1
00000100:00100000:3.0:1789760738.080983:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709731113951 time 709767664658 state 0x0 ref 1
00000100:00100000:3.0:1789760738.080997:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520930688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760738.081047:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21528576, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:3.0:1789760738.081057:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.081074:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:3.0:1789760738.081078:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760738.081085:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.081098:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760738.109546:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972576 is committed
00002000:00010000:1.0:1789760738.109629:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21528576 -> 21532672
00010000:00010000:1.0:1789760738.109644:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.109658:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.109673:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.109681:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760738.109685:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.109695:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.109715:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.109723:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c299 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21528576->21532671] (req 21528576->21532671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760738.109829:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520930688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28830us (29180us total) trans 4294972576 rc 0/0
00000100:00100000:1.0:1789760738.109839:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5289
00000100:00100000:1.0:1789760738.109848:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709731113951 time 709767664658 state 0x2 ref 0
00000100:00100000:1.0:1789760738.113842:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.113956:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520930816
00000100:00100000:0.0:1789760738.113967:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520930816
00000100:00100000:0.0:1789760738.114030:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709731113951 time 709767664658 state 0x0 ref 1
00000100:00100000:0.0:1789760738.114044:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709767925074 time 709767664658 state 0x1 ref 1
00000100:00100000:0.0:1789760738.114178:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709767925074 time 709800858572 state 0x0 ref 1
00000100:00100000:0.0:1789760738.114191:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520930816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.114241:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21532672, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.114250:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.114267:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:0.0:1789760738.114271:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.114277:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.114292:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760738.158905:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21532672 -> 21536768
00010000:00010000:0.0:1789760738.158925:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.158938:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.158952:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.158960:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760738.158964:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.158973:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.158992:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.158999:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21532672->21536767] (req 21532672->21536767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760738.159095:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520930816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44903us (45259us total) trans 4294972577 rc 0/0
00000100:00100000:0.0:1789760738.159106:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5290
00000100:00100000:0.0:1789760738.159116:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709767925074 time 709800858572 state 0x2 ref 0
00000001:00080000:1.0:1789760738.161895:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972577 is committed
00000100:00100000:1.0:1789760738.162524:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.162593:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520930944
00000100:00100000:0.0:1789760738.162602:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520930944
00000100:00100000:0.0:1789760738.162654:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709767925074 time 709800858572 state 0x0 ref 1
00000100:00100000:0.0:1789760738.162668:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709801118988 time 709800858572 state 0x1 ref 1
00000100:00100000:0.0:1789760738.162697:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709801118988 time 709849379492 state 0x0 ref 1
00000100:00100000:0.0:1789760738.162708:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520930944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.162755:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21536768, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.162772:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.162787:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:0.0:1789760738.162793:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.162799:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.162812:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760738.193694:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972578 is committed
00002000:00010000:0.0:1789760738.193802:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21536768 -> 21540864
00010000:00010000:0.0:1789760738.193818:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.193832:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.193842:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.193850:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760738.193856:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.193865:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.193883:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.193890:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c2a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21536768->21540863] (req 21536768->21540863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760738.193983:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520930944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31270us (31456us total) trans 4294972578 rc 0/0
00000100:00100000:0.0:1789760738.193996:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5291
00000100:00100000:0.0:1789760738.194005:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709801118988 time 709849379492 state 0x2 ref 0
00000100:00100000:1.0:1789760738.197926:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760738.198047:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520931072
00000100:00100000:3.0:1789760738.198069:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520931072
00000100:00100000:3.0:1789760738.198123:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709801118988 time 709849379492 state 0x0 ref 1
00000100:00100000:3.0:1789760738.198139:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709849639908 time 709849379492 state 0x1 ref 1
00000100:00100000:3.0:1789760738.198208:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709849639908 time 709884888917 state 0x0 ref 1
00000100:00100000:3.0:1789760738.198222:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520931072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760738.198271:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21540864, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:3.0:1789760738.198279:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.198305:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:3.0:1789760738.198310:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760738.198348:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.198362:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760738.238353:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21540864 -> 21544960
00010000:00010000:1.0:1789760738.238375:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.238388:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.238397:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.238404:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760738.238409:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.238417:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.238435:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.238442:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c2ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21540864->21544959] (req 21540864->21544959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760738.238530:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520931072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40307us (40610us total) trans 4294972579 rc 0/0
00000100:00100000:1.0:1789760738.238541:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5292
00000100:00100000:1.0:1789760738.238552:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709849639908 time 709884888917 state 0x2 ref 0
00000001:00080000:3.0:1789760738.238627:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972579 is committed
00000100:00100000:1.0:1789760738.241998:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760738.242558:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520931200
00000100:00100000:3.0:1789760738.242567:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520931200
00000100:00100000:3.0:1789760738.242622:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709849639908 time 709884888917 state 0x0 ref 1
00000100:00100000:3.0:1789760738.242637:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709885149333 time 709884888917 state 0x1 ref 1
00000100:00100000:3.0:1789760738.242710:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709885149333 time 709929391233 state 0x0 ref 1
00000100:00100000:3.0:1789760738.242724:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520931200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760738.242780:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21544960, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:3.0:1789760738.242790:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.242812:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:3.0:1789760738.242817:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760738.242824:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.242837:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760738.275099:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972580 is committed
00002000:00010000:3.0:1789760738.275265:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21544960 -> 21549056
00010000:00010000:3.0:1789760738.275282:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.275444:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.275455:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.275463:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760738.275468:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.275478:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.275502:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760738.275512:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c2b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21544960->21549055] (req 21544960->21549055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760738.275731:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520931200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33004us (33748us total) trans 4294972580 rc 0/0
00000100:00100000:2.0:1789760738.275743:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5293
00000100:00100000:2.0:1789760738.275753:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709885149333 time 709929391233 state 0x2 ref 0
00000100:00100000:0.0:1789760738.282005:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760738.283202:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520931328
00000100:00100000:2.0:1789760738.283215:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520931328
00000100:00100000:2.0:1789760738.283276:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709885149333 time 709929391233 state 0x0 ref 1
00000100:00100000:2.0:1789760738.283304:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709929651649 time 709929391233 state 0x1 ref 1
00000100:00100000:2.0:1789760738.283377:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709929651649 time 709970058568 state 0x0 ref 1
00000100:00100000:2.0:1789760738.283390:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520931328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760738.283437:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21549056, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:2.0:1789760738.283447:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.283462:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=709s v=(0 0)
00010000:00010000:2.0:1789760738.283467:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760738.283473:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.283487:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760738.346118:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21549056 -> 21553152
00010000:00010000:2.0:1789760738.346137:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.346149:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.346158:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.346166:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760738.346170:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.346179:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.346202:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.346210:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c2bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21549056->21553151] (req 21549056->21553151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760738.346348:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520931328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62922us (64314us total) trans 4294972581 rc 0/0
00000100:00100000:2.0:1789760738.346362:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5294
00000100:00100000:2.0:1789760738.346371:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709929651649 time 709970058568 state 0x2 ref 0
00000001:00080000:3.0:1789760738.347087:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972581 is committed
00000100:00100000:1.0:1789760738.349257:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.349581:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520931456
00000100:00100000:0.0:1789760738.349591:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520931456
00000100:00100000:0.0:1789760738.349653:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709929651649 time 709970058568 state 0x0 ref 1
00000100:00100000:0.0:1789760738.349672:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709970318984 time 709970058568 state 0x1 ref 1
00000100:00100000:0.0:1789760738.349738:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709970318984 time 710036420100 state 0x0 ref 1
00000100:00100000:0.0:1789760738.349751:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520931456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.349814:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21553152, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.349823:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.349840:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760738.349844:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.349850:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.349863:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760738.383105:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972582 is committed
00002000:00010000:1.0:1789760738.383176:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21553152 -> 21557248
00010000:00010000:1.0:1789760738.383192:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.383204:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.383214:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.383221:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760738.383226:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.383235:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.383254:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.383262:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c2c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21553152->21557247] (req 21553152->21557247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760738.383465:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520931456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33710us (34210us total) trans 4294972582 rc 0/0
00000100:00100000:1.0:1789760738.383477:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5295
00000100:00100000:1.0:1789760738.383486:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709970318984 time 710036420100 state 0x2 ref 0
00000100:00100000:1.0:1789760738.394678:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.394938:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520931584
00000100:00100000:0.0:1789760738.394948:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520931584
00000100:00100000:0.0:1789760738.395003:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 709970318984 time 710036420100 state 0x0 ref 1
00000100:00100000:0.0:1789760738.395019:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710036680516 time 710036420100 state 0x1 ref 1
00000100:00100000:0.0:1789760738.395101:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710036680516 time 710081783617 state 0x0 ref 1
00000100:00100000:0.0:1789760738.395115:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520931584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.395164:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21557248, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.395173:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.395528:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760738.395533:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.395540:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.395555:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760738.440524:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972583 is committed
00002000:00010000:1.0:1789760738.440589:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21557248 -> 21561344
00010000:00010000:1.0:1789760738.440604:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.440618:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.440627:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.440639:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760738.440645:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.440654:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.440673:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.440682:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c2ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21557248->21561343] (req 21557248->21561343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760738.440896:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520931584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45779us (46222us total) trans 4294972583 rc 0/0
00000100:00100000:1.0:1789760738.440906:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5296
00000100:00100000:1.0:1789760738.440915:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710036680516 time 710081783617 state 0x2 ref 0
00000100:00100000:0.0:1789760738.443737:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760738.443905:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520931712
00000100:00100000:2.0:1789760738.443915:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520931712
00000100:00100000:2.0:1789760738.443979:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710036680516 time 710081783617 state 0x0 ref 1
00000100:00100000:2.0:1789760738.443999:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710082044033 time 710081783617 state 0x1 ref 1
00000100:00100000:2.0:1789760738.444031:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710082044033 time 710130713681 state 0x0 ref 1
00000100:00100000:2.0:1789760738.444044:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520931712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760738.444112:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21561344, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:2.0:1789760738.444122:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.444138:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:2.0:1789760738.444143:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760738.444149:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.444164:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760738.472339:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972584 is committed
00002000:00010000:2.0:1789760738.472477:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21561344 -> 21565440
00010000:00010000:2.0:1789760738.472493:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.472507:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.472515:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.472522:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760738.472527:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.472536:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.472568:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.472576:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c2d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21561344->21565439] (req 21561344->21565439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760738.472669:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520931712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28622us (28936us total) trans 4294972584 rc 0/0
00000100:00100000:2.0:1789760738.472679:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5297
00000100:00100000:2.0:1789760738.472689:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710082044033 time 710130713681 state 0x2 ref 0
00000100:00100000:2.0:1789760738.478739:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.478849:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520931840
00000100:00100000:0.0:1789760738.478859:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520931840
00000100:00100000:0.0:1789760738.478919:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710082044033 time 710130713681 state 0x0 ref 1
00000100:00100000:0.0:1789760738.478936:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710130974097 time 710130713681 state 0x1 ref 1
00000100:00100000:0.0:1789760738.478966:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710130974097 time 710165649023 state 0x0 ref 1
00000100:00100000:0.0:1789760738.478979:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520931840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.479026:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21565440, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.479036:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.479052:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760738.479056:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.479064:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.479079:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760738.518965:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21565440 -> 21569536
00010000:00010000:1.0:1789760738.518985:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.518999:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.519009:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.519017:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760738.519022:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.519032:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.519064:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.519073:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c2d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21565440->21569535] (req 21565440->21569535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760738.519160:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520931840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40178us (40426us total) trans 4294972585 rc 0/0
00000100:00100000:1.0:1789760738.519171:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5298
00000100:00100000:1.0:1789760738.519180:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710130974097 time 710165649023 state 0x2 ref 0
00000001:00080000:1.0:1789760738.519216:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972585 is committed
00000100:00100000:1.0:1789760738.524637:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.524716:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520931968
00000100:00100000:0.0:1789760738.524726:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520931968
00000100:00100000:0.0:1789760738.524789:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710130974097 time 710165649023 state 0x0 ref 1
00000100:00100000:0.0:1789760738.524804:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710165909439 time 710165649023 state 0x1 ref 1
00000100:00100000:0.0:1789760738.524834:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710165909439 time 710211516848 state 0x0 ref 1
00000100:00100000:0.0:1789760738.524846:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520931968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.524904:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21569536, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.524914:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.524939:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760738.524944:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.524951:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.524966:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760738.566752:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972586 is committed
00002000:00010000:0.0:1789760738.567005:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21569536 -> 21573632
00010000:00010000:0.0:1789760738.567020:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.567033:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.567042:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.567049:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760738.567053:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.567062:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.567079:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.567087:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21569536->21573631] (req 21569536->21573631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760738.567249:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520931968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42399us (42616us total) trans 4294972586 rc 0/0
00000100:00100000:0.0:1789760738.567263:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5299
00000100:00100000:0.0:1789760738.567273:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710165909439 time 710211516848 state 0x2 ref 0
00000100:00100000:0.0:1789760738.569955:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760738.570030:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520932096
00000100:00100000:1.0:1789760738.570041:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520932096
00000100:00100000:1.0:1789760738.570105:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710165909439 time 710211516848 state 0x0 ref 1
00000100:00100000:1.0:1789760738.570120:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710211777264 time 710211516848 state 0x1 ref 1
00000100:00100000:1.0:1789760738.570157:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710211777264 time 710256839095 state 0x0 ref 1
00000100:00100000:1.0:1789760738.570171:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520932096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760738.571342:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21573632, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:1.0:1789760738.571357:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.571379:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:1.0:1789760738.571383:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760738.571390:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.571404:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760738.629105:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972587 is committed
00002000:00010000:0.0:1789760738.629429:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21573632 -> 21577728
00010000:00010000:0.0:1789760738.629444:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.629456:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.629465:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.629472:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760738.629477:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.629486:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.629504:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.629511:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c2e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21573632->21577727] (req 21573632->21577727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760738.629607:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520932096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59435us (59656us total) trans 4294972587 rc 0/0
00000100:00100000:0.0:1789760738.629617:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5300
00000100:00100000:0.0:1789760738.629626:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710211777264 time 710256839095 state 0x2 ref 0
00000100:00100000:2.0:1789760738.638168:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.638360:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520932224
00000100:00100000:0.0:1789760738.638371:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520932224
00000100:00100000:0.0:1789760738.638424:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710211777264 time 710256839095 state 0x0 ref 1
00000100:00100000:0.0:1789760738.638440:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710257099511 time 710256839095 state 0x1 ref 1
00000100:00100000:0.0:1789760738.638472:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710257099511 time 710325155151 state 0x0 ref 1
00000100:00100000:0.0:1789760738.638485:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520932224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.638533:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21577728, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.638543:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.638559:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760738.638564:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.638571:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.638585:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760738.685071:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21577728 -> 21581824
00010000:00010000:2.0:1789760738.685092:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.685105:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.685113:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.685119:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760738.685124:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.685133:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.685153:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.685160:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c2ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21577728->21581823] (req 21577728->21581823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760738.685253:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520932224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46765us (47091us total) trans 4294972588 rc 0/0
00000100:00100000:2.0:1789760738.685267:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5301
00000100:00100000:2.0:1789760738.685276:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710257099511 time 710325155151 state 0x2 ref 0
00000001:00080000:1.0:1789760738.685968:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972588 is committed
00000100:00100000:1.0:1789760738.692994:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.693197:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520932352
00000100:00100000:0.0:1789760738.693206:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520932352
00000100:00100000:0.0:1789760738.693259:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710257099511 time 710325155151 state 0x0 ref 1
00000100:00100000:0.0:1789760738.693273:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710325415567 time 710325155151 state 0x1 ref 1
00000100:00100000:0.0:1789760738.693598:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710325415567 time 710380278439 state 0x0 ref 1
00000100:00100000:0.0:1789760738.693616:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520932352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.693672:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21581824, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.693681:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.693697:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760738.693701:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.693707:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.693721:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760738.722857:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972589 is committed
00002000:00010000:0.0:1789760738.723138:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21581824 -> 21585920
00010000:00010000:0.0:1789760738.723153:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.723173:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.723182:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.723190:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760738.723194:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.723203:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.723222:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.723230:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c2f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21581824->21585919] (req 21581824->21585919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760738.723467:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520932352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29850us (30476us total) trans 4294972589 rc 0/0
00000100:00100000:0.0:1789760738.723478:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5302
00000100:00100000:0.0:1789760738.723488:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710325415567 time 710380278439 state 0x2 ref 0
00000100:00100000:0.0:1789760738.728534:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760738.728627:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520932480
00000100:00100000:2.0:1789760738.728638:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520932480
00000100:00100000:2.0:1789760738.728693:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710325415567 time 710380278439 state 0x0 ref 1
00000100:00100000:2.0:1789760738.728709:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710380538855 time 710380278439 state 0x1 ref 1
00000100:00100000:2.0:1789760738.728776:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710380538855 time 710415458468 state 0x0 ref 1
00000100:00100000:2.0:1789760738.728789:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520932480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760738.728960:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21585920, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:2.0:1789760738.729266:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.729283:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:2.0:1789760738.729447:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760738.729454:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.729466:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760738.767486:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972590 is committed
00002000:00010000:2.0:1789760738.767504:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21585920 -> 21590016
00010000:00010000:2.0:1789760738.767527:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.767537:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.767544:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.767556:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760738.767560:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.767569:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.767589:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.767604:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c2fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21585920->21590015] (req 21585920->21590015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760738.767698:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520932480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38907us (39170us total) trans 4294972590 rc 0/0
00000100:00100000:2.0:1789760738.767709:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5303
00000100:00100000:2.0:1789760738.767718:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710380538855 time 710415458468 state 0x2 ref 0
00000100:00100000:2.0:1789760738.771064:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760738.771491:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520932608
00000100:00100000:1.0:1789760738.771503:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520932608
00000100:00100000:1.0:1789760738.771556:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710380538855 time 710415458468 state 0x0 ref 1
00000100:00100000:1.0:1789760738.771573:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710415718884 time 710415458468 state 0x1 ref 1
00000100:00100000:1.0:1789760738.771602:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710415718884 time 710458285045 state 0x0 ref 1
00000100:00100000:1.0:1789760738.771615:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520932608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760738.771667:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21590016, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:1.0:1789760738.771676:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.771693:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:1.0:1789760738.771698:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760738.771704:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.771718:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760738.833848:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21590016 -> 21594112
00010000:00010000:1.0:1789760738.833867:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.833881:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.833891:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.833899:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760738.833904:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.833914:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.833933:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.833941:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c302 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21590016->21594111] (req 21590016->21594111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760738.834099:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520932608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62480us (63037us total) trans 4294972591 rc 0/0
00000100:00100000:1.0:1789760738.834110:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5304
00000100:00100000:1.0:1789760738.834120:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710415718884 time 710458285045 state 0x2 ref 0
00000001:00080000:1.0:1789760738.834166:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972591 is committed
00000100:00100000:1.0:1789760738.840747:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760738.840816:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520932736
00000100:00100000:0.0:1789760738.840826:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520932736
00000100:00100000:0.0:1789760738.840879:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710415718884 time 710458285045 state 0x0 ref 1
00000100:00100000:0.0:1789760738.840896:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710458545461 time 710458285045 state 0x1 ref 1
00000100:00100000:0.0:1789760738.840927:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710458545461 time 710527609858 state 0x0 ref 1
00000100:00100000:0.0:1789760738.840941:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520932736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760738.840992:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21594112, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:0.0:1789760738.841001:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.841017:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760738.841022:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760738.841029:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760738.841042:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760738.874086:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:2.0:1789760738.916454:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21594112 -> 21598208
00010000:00010000:2.0:1789760738.916475:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.916488:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.916497:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.916504:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760738.916508:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.916517:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.916535:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.916543:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c309 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21594112->21598207] (req 21594112->21598207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760738.916652:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520932736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 75708us (75909us total) trans 4294972592 rc 0/0
00000100:00100000:2.0:1789760738.916663:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5305
00000100:00100000:2.0:1789760738.916672:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710458545461 time 710527609858 state 0x2 ref 0
00000001:00080000:1.0:1789760738.917143:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972592 is committed
00000100:00100000:0.0:1789760738.920063:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760738.920150:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520932864
00000100:00100000:2.0:1789760738.920160:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520932864
00000100:00100000:2.0:1789760738.920214:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710458545461 time 710527609858 state 0x0 ref 1
00000100:00100000:2.0:1789760738.920229:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710527870274 time 710527609858 state 0x1 ref 1
00000100:00100000:2.0:1789760738.920262:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710527870274 time 710606944228 state 0x0 ref 1
00000100:00100000:2.0:1789760738.920274:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520932864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760738.920348:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21598208, mtime: 0x6aad94e3, atime: 0x0, ctime: 0x6aad94e3, blocks: 0xa807
00010000:00010000:2.0:1789760738.920357:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.920373:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:2.0:1789760738.920378:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760738.920385:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.920399:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760738.983656:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972593 is committed
00002000:00010000:2.0:1789760738.983771:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21598208 -> 21602304
00002000:00010000:2.0:1789760738.983777:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760739 -> 1789760740
00002000:00010000:2.0:1789760738.983780:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760739 -> 1789760740
00010000:00010000:2.0:1789760738.983793:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.983813:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.983823:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.983831:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760738.983836:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.983855:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.983875:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.983884:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c310 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21598208->21602303] (req 21598208->21602303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760738.983978:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520932864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63701us (63920us total) trans 4294972593 rc 0/0
00000100:00100000:2.0:1789760738.983989:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5306
00000100:00100000:2.0:1789760738.983998:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710527870274 time 710606944228 state 0x2 ref 0
00000100:00100000:3.0:1789760738.993387:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760738.993482:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520932992
00000100:00100000:2.0:1789760738.993493:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520932992
00000100:00100000:2.0:1789760738.993542:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710527870274 time 710606944228 state 0x0 ref 1
00000100:00100000:2.0:1789760738.993557:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710607204644 time 710606944228 state 0x1 ref 1
00000100:00100000:2.0:1789760738.993578:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710607204644 time 710680261355 state 0x0 ref 1
00000100:00100000:2.0:1789760738.993589:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520932992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760738.993639:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21602304, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:2.0:1789760738.993648:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.993663:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:2.0:1789760738.993667:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760738.993674:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760738.993687:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760739.023832:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21602304 -> 21606400
00010000:00010000:0.0:1789760739.023925:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.023946:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.023956:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.023964:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760739.023968:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.023977:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.023997:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.024004:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c317 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21602304->21606399] (req 21602304->21606399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760739.024097:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520932992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30504us (30717us total) trans 4294972594 rc 0/0
00000100:00100000:0.0:1789760739.024108:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5307
00000100:00100000:0.0:1789760739.024117:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710607204644 time 710680261355 state 0x2 ref 0
00000001:00080000:3.0:1789760739.024191:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972594 is committed
00000100:00100000:0.0:1789760739.032901:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760739.033125:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520933120
00000100:00100000:1.0:1789760739.033134:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520933120
00000100:00100000:1.0:1789760739.033186:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710607204644 time 710680261355 state 0x0 ref 1
00000100:00100000:1.0:1789760739.033202:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710680521771 time 710680261355 state 0x1 ref 1
00000100:00100000:1.0:1789760739.033234:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710680521771 time 710719916230 state 0x0 ref 1
00000100:00100000:1.0:1789760739.033247:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520933120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760739.033572:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21606400, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:1.0:1789760739.033583:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.033600:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:1.0:1789760739.033605:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760739.033611:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.033626:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.077716:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972595 is committed
00002000:00010000:1.0:1789760739.078102:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21606400 -> 21610496
00010000:00010000:1.0:1789760739.078118:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.078131:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.078140:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.078148:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.078153:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.078162:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.078241:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.078249:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c31e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21606400->21610495] (req 21606400->21610495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.078611:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520933120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45360us (45714us total) trans 4294972595 rc 0/0
00000100:00100000:1.0:1789760739.078623:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5308
00000100:00100000:1.0:1789760739.078633:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710680521771 time 710719916230 state 0x2 ref 0
00000100:00100000:1.0:1789760739.085671:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760739.085746:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520933248
00000100:00100000:0.0:1789760739.085765:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520933248
00000100:00100000:0.0:1789760739.085814:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710680521771 time 710719916230 state 0x0 ref 1
00000100:00100000:0.0:1789760739.085828:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710720176646 time 710719916230 state 0x1 ref 1
00000100:00100000:0.0:1789760739.085862:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710720176646 time 710772538735 state 0x0 ref 1
00000100:00100000:0.0:1789760739.085874:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520933248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760739.085918:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21610496, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:0.0:1789760739.085933:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.085948:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760739.085953:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760739.085958:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.085971:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.126164:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972596 is committed
00002000:00010000:1.0:1789760739.127507:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21610496 -> 21614592
00010000:00010000:1.0:1789760739.127526:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.127539:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.127549:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.127558:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.127564:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.127584:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.127606:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.127620:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c325 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21610496->21614591] (req 21610496->21614591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.127720:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520933248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41841us (42052us total) trans 4294972596 rc 0/0
00000100:00100000:1.0:1789760739.127730:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5309
00000100:00100000:1.0:1789760739.127739:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710720176646 time 710772538735 state 0x2 ref 0
00000100:00100000:2.0:1789760739.132220:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760739.132492:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520933376
00000100:00100000:0.0:1789760739.132502:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520933376
00000100:00100000:0.0:1789760739.132555:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710720176646 time 710772538735 state 0x0 ref 1
00000100:00100000:0.0:1789760739.132569:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710772799151 time 710772538735 state 0x1 ref 1
00000100:00100000:0.0:1789760739.132601:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710772799151 time 710819283823 state 0x0 ref 1
00000100:00100000:0.0:1789760739.132614:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520933376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760739.132662:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21614592, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:0.0:1789760739.132672:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.132687:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:0.0:1789760739.132692:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760739.132698:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.132711:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.208768:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972597 is committed
00002000:00010000:0.0:1789760739.209174:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21614592 -> 21618688
00010000:00010000:0.0:1789760739.209191:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.209203:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.209211:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.209218:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760739.209222:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.209231:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.209251:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.209260:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c32c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21614592->21618687] (req 21614592->21618687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760739.210506:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520933376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 77885us (78287us total) trans 4294972597 rc 0/0
00000100:00100000:0.0:1789760739.210520:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5310
00000100:00100000:0.0:1789760739.210530:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710772799151 time 710819283823 state 0x2 ref 0
00000100:00100000:0.0:1789760739.220530:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760739.223186:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520933504
00000100:00100000:2.0:1789760739.223200:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520933504
00000100:00100000:2.0:1789760739.223262:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710772799151 time 710819283823 state 0x0 ref 1
00000100:00100000:2.0:1789760739.223277:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710819544239 time 710819283823 state 0x1 ref 1
00000100:00100000:2.0:1789760739.223863:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710819544239 time 710910542481 state 0x0 ref 1
00000100:00100000:2.0:1789760739.223882:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520933504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760739.223930:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21618688, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:2.0:1789760739.223939:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.223955:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:2.0:1789760739.223960:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760739.223967:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.225431:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.282265:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972598 is committed
00002000:00010000:0.0:1789760739.282473:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21618688 -> 21622784
00010000:00010000:0.0:1789760739.282487:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.282501:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.282511:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.282526:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760739.282531:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.282540:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.282558:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.282567:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c333 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21618688->21622783] (req 21618688->21622783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760739.282687:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520933504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58806us (62162us total) trans 4294972598 rc 0/0
00000100:00100000:0.0:1789760739.282697:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5311
00000100:00100000:0.0:1789760739.282706:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710819544239 time 710910542481 state 0x2 ref 0
00000100:00100000:3.0:1789760739.286486:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760739.286605:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520933632
00000100:00100000:1.0:1789760739.286614:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520933632
00000100:00100000:1.0:1789760739.286665:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710819544239 time 710910542481 state 0x0 ref 1
00000100:00100000:1.0:1789760739.286680:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710910802897 time 710910542481 state 0x1 ref 1
00000100:00100000:1.0:1789760739.286707:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710910802897 time 710973389991 state 0x0 ref 1
00000100:00100000:1.0:1789760739.286719:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520933632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760739.286776:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21622784, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:1.0:1789760739.286786:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.286802:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=710s v=(0 0)
00010000:00010000:1.0:1789760739.286806:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760739.286813:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.286834:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760739.329702:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972599 is committed
00002000:00010000:3.0:1789760739.329857:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21622784 -> 21626880
00010000:00010000:3.0:1789760739.329872:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.329886:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.329895:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.329902:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760739.329906:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.329915:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.329936:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.329944:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c33a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21622784->21626879] (req 21622784->21626879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760739.330037:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520933632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43314us (43554us total) trans 4294972599 rc 0/0
00000100:00100000:3.0:1789760739.330048:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5312
00000100:00100000:3.0:1789760739.330058:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710910802897 time 710973389991 state 0x2 ref 0
00000100:00100000:0.0:1789760739.333580:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760739.333684:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520933760
00000100:00100000:1.0:1789760739.333694:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520933760
00000100:00100000:1.0:1789760739.333752:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710910802897 time 710973389991 state 0x0 ref 1
00000100:00100000:1.0:1789760739.333780:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710973650407 time 710973389991 state 0x1 ref 1
00000100:00100000:1.0:1789760739.333842:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710973650407 time 711020524090 state 0x0 ref 1
00000100:00100000:1.0:1789760739.333855:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520933760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760739.333904:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21626880, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:1.0:1789760739.333913:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.333928:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:1.0:1789760739.333933:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760739.333939:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.333952:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760739.375371:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21626880 -> 21630976
00010000:00010000:3.0:1789760739.375404:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.375419:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.375427:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.375435:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760739.375440:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.375454:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.375475:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.375483:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c341 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21626880->21630975] (req 21626880->21630975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760739.375589:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520933760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41730us (42013us total) trans 4294972600 rc 0/0
00000100:00100000:3.0:1789760739.375600:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5313
00000100:00100000:3.0:1789760739.375610:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710973650407 time 711020524090 state 0x2 ref 0
00000001:00080000:0.0:1789760739.377295:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972600 is committed
00000100:00100000:0.0:1789760739.383663:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760739.383820:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520933888
00000100:00100000:2.0:1789760739.383830:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520933888
00000100:00100000:2.0:1789760739.383889:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 710973650407 time 711020524090 state 0x0 ref 1
00000100:00100000:2.0:1789760739.383905:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711020784506 time 711020524090 state 0x1 ref 1
00000100:00100000:2.0:1789760739.383934:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711020784506 time 711070617119 state 0x0 ref 1
00000100:00100000:2.0:1789760739.383946:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520933888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760739.383997:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21630976, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:2.0:1789760739.384007:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.384027:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:2.0:1789760739.384032:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760739.384038:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.384052:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760739.429615:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972601 is committed
00002000:00010000:2.0:1789760739.429748:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21630976 -> 21635072
00010000:00010000:2.0:1789760739.429774:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.429786:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.429794:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.429801:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760739.429806:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.429815:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.429833:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760739.429841:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c348 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21630976->21635071] (req 21630976->21635071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760739.429934:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520933888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45985us (46276us total) trans 4294972601 rc 0/0
00000100:00100000:2.0:1789760739.429944:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5314
00000100:00100000:2.0:1789760739.429954:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711020784506 time 711070617119 state 0x2 ref 0
00000100:00100000:1.0:1789760739.434811:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760739.435555:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520934016
00000100:00100000:0.0:1789760739.435565:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520934016
00000100:00100000:0.0:1789760739.435619:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711020784506 time 711070617119 state 0x0 ref 1
00000100:00100000:0.0:1789760739.435700:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711070877535 time 711070617119 state 0x1 ref 1
00000100:00100000:0.0:1789760739.435731:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711070877535 time 711122414145 state 0x0 ref 1
00000100:00100000:0.0:1789760739.435743:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760739.435801:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21635072, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:0.0:1789760739.435811:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.435828:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:0.0:1789760739.435833:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760739.435839:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.435852:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760739.473604:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972602 is committed
00002000:00010000:0.0:1789760739.473777:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21635072 -> 21639168
00010000:00010000:0.0:1789760739.473794:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.473807:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.473816:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.473823:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760739.473829:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.473838:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.473857:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.473864:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c34f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21635072->21639167] (req 21635072->21639167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760739.473961:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38214us (39154us total) trans 4294972602 rc 0/0
00000100:00100000:0.0:1789760739.473972:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5315
00000100:00100000:0.0:1789760739.473982:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711070877535 time 711122414145 state 0x2 ref 0
00000100:00100000:1.0:1789760739.478367:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760739.478572:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520934144
00000100:00100000:3.0:1789760739.478582:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520934144
00000100:00100000:3.0:1789760739.478708:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711070877535 time 711122414145 state 0x0 ref 1
00000100:00100000:3.0:1789760739.478725:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711122674561 time 711122414145 state 0x1 ref 1
00000100:00100000:3.0:1789760739.478766:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711122674561 time 711165448652 state 0x0 ref 1
00000100:00100000:3.0:1789760739.478780:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760739.478838:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21639168, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:3.0:1789760739.478847:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.478864:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:3.0:1789760739.478868:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760739.478874:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.478888:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760739.512258:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972603 is committed
00002000:00010000:1.0:1789760739.512519:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21639168 -> 21643264
00010000:00010000:1.0:1789760739.512537:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.512552:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.512563:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.512571:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.512577:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.512592:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.512613:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.512621:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c356 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21639168->21643263] (req 21639168->21643263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.512842:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34060us (34478us total) trans 4294972603 rc 0/0
00000100:00100000:1.0:1789760739.512854:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5316
00000100:00100000:1.0:1789760739.512864:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711122674561 time 711165448652 state 0x2 ref 0
00000100:00100000:1.0:1789760739.518020:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760739.518612:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520934272
00000100:00100000:3.0:1789760739.518624:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520934272
00000100:00100000:3.0:1789760739.518772:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711122674561 time 711165448652 state 0x0 ref 1
00000100:00100000:3.0:1789760739.518788:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711165709068 time 711165448652 state 0x1 ref 1
00000100:00100000:3.0:1789760739.518866:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711165709068 time 711205548334 state 0x0 ref 1
00000100:00100000:3.0:1789760739.518880:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760739.518932:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21643264, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:3.0:1789760739.518941:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.518956:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:3.0:1789760739.518960:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760739.518966:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.518985:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.553719:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972604 is committed
00002000:00010000:1.0:1789760739.553963:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21643264 -> 21647360
00010000:00010000:1.0:1789760739.553979:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.553989:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.553995:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.553999:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.554005:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.554014:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.554035:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.554048:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c35d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21643264->21647359] (req 21643264->21647359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.554149:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35266us (36145us total) trans 4294972604 rc 0/0
00000100:00100000:1.0:1789760739.554160:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5317
00000100:00100000:1.0:1789760739.554169:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711165709068 time 711205548334 state 0x2 ref 0
00000100:00100000:3.0:1789760739.559172:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760739.559274:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520934400
00000100:00100000:0.0:1789760739.559284:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520934400
00000100:00100000:0.0:1789760739.559438:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711165709068 time 711205548334 state 0x0 ref 1
00000100:00100000:0.0:1789760739.559454:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711205808750 time 711205548334 state 0x1 ref 1
00000100:00100000:0.0:1789760739.559474:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711205808750 time 711246157354 state 0x0 ref 1
00000100:00100000:0.0:1789760739.559487:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760739.559539:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21647360, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:0.0:1789760739.559548:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.559565:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:0.0:1789760739.559569:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760739.559575:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.559590:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760739.589259:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972605 is committed
00002000:00010000:1.0:1789760739.589775:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21647360 -> 21651456
00010000:00010000:1.0:1789760739.589793:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.589806:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.589886:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.589895:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.589901:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.589911:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.589937:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.589946:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c364 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21647360->21651455] (req 21647360->21651455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.590076:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30587us (30910us total) trans 4294972605 rc 0/0
00000100:00100000:1.0:1789760739.590089:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5318
00000100:00100000:1.0:1789760739.590099:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711205808750 time 711246157354 state 0x2 ref 0
00000100:00100000:3.0:1789760739.595443:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760739.595643:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520934528
00000100:00100000:0.0:1789760739.595654:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520934528
00000100:00100000:0.0:1789760739.595724:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711205808750 time 711246157354 state 0x0 ref 1
00000100:00100000:0.0:1789760739.595739:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711246417770 time 711246157354 state 0x1 ref 1
00000100:00100000:0.0:1789760739.595817:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711246417770 time 711282499002 state 0x0 ref 1
00000100:00100000:0.0:1789760739.595831:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760739.595884:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21651456, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:0.0:1789760739.595893:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.595910:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:0.0:1789760739.595914:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760739.595921:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.595934:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.629060:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972606 is committed
00002000:00010000:1.0:1789760739.629646:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21651456 -> 21655552
00010000:00010000:1.0:1789760739.629662:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.629676:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.629686:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.629695:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.629700:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.629715:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.629817:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.629825:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c36b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21651456->21655551] (req 21651456->21655551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.629922:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34087us (34480us total) trans 4294972606 rc 0/0
00000100:00100000:1.0:1789760739.629931:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5319
00000100:00100000:1.0:1789760739.629940:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711246417770 time 711282499002 state 0x2 ref 0
00000100:00100000:1.0:1789760739.633433:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760739.633548:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520934656
00000100:00100000:3.0:1789760739.633558:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520934656
00000100:00100000:3.0:1789760739.633703:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711246417770 time 711282499002 state 0x0 ref 1
00000100:00100000:3.0:1789760739.633798:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711282759418 time 711282499002 state 0x1 ref 1
00000100:00100000:3.0:1789760739.633831:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711282759418 time 711320512734 state 0x0 ref 1
00000100:00100000:3.0:1789760739.633844:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520934656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760739.633896:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21655552, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:3.0:1789760739.633906:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.633924:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:3.0:1789760739.633929:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760739.633936:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.633952:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.671651:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972607 is committed
00002000:00010000:1.0:1789760739.671748:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21655552 -> 21659648
00010000:00010000:1.0:1789760739.671778:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.671791:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.671800:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.671814:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.671819:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.671828:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.671850:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.671858:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c372 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21655552->21659647] (req 21655552->21659647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.671947:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520934656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38102us (38520us total) trans 4294972607 rc 0/0
00000100:00100000:1.0:1789760739.671958:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5320
00000100:00100000:1.0:1789760739.671968:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711282759418 time 711320512734 state 0x2 ref 0
00000100:00100000:3.0:1789760739.676842:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760739.677050:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520934784
00000100:00100000:1.0:1789760739.677061:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520934784
00000100:00100000:1.0:1789760739.677119:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711282759418 time 711320512734 state 0x0 ref 1
00000100:00100000:1.0:1789760739.677135:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711320773150 time 711320512734 state 0x1 ref 1
00000100:00100000:1.0:1789760739.677171:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711320773150 time 711363853463 state 0x0 ref 1
00000100:00100000:1.0:1789760739.677186:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760739.677235:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21659648, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:1.0:1789760739.677245:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.677260:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:1.0:1789760739.677263:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760739.677269:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.677282:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760739.721569:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972608 is committed
00002000:00010000:1.0:1789760739.721676:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21659648 -> 21663744
00010000:00010000:1.0:1789760739.721691:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.721705:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.721714:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.721721:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.721726:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.721735:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.721765:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.721782:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c379 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21659648->21663743] (req 21659648->21663743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.721882:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520934784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44693us (45044us total) trans 4294972608 rc 0/0
00000100:00100000:1.0:1789760739.721892:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5321
00000100:00100000:1.0:1789760739.721904:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711320773150 time 711363853463 state 0x2 ref 0
00000100:00100000:3.0:1789760739.725504:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760739.725648:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520934912
00000100:00100000:1.0:1789760739.725657:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520934912
00000100:00100000:1.0:1789760739.725708:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711320773150 time 711363853463 state 0x0 ref 1
00000100:00100000:1.0:1789760739.725722:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711364113879 time 711363853463 state 0x1 ref 1
00000100:00100000:1.0:1789760739.725761:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711364113879 time 711412434820 state 0x0 ref 1
00000100:00100000:1.0:1789760739.725917:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520934912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760739.725970:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21663744, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:1.0:1789760739.725979:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.725996:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:1.0:1789760739.726001:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760739.726007:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.726021:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760739.755815:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972609 is committed
00002000:00010000:3.0:1789760739.755978:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21663744 -> 21667840
00010000:00010000:3.0:1789760739.755995:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.756007:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.756016:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.756023:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760739.756027:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.756036:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.756056:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.756063:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c380 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21663744->21667839] (req 21663744->21667839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760739.756166:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520934912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30388us (30665us total) trans 4294972609 rc 0/0
00000100:00100000:3.0:1789760739.756177:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5322
00000100:00100000:3.0:1789760739.756186:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711364113879 time 711412434820 state 0x2 ref 0
00000100:00100000:0.0:1789760739.762866:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760739.763172:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520935040
00000100:00100000:1.0:1789760739.763181:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520935040
00000100:00100000:1.0:1789760739.763227:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711364113879 time 711412434820 state 0x0 ref 1
00000100:00100000:1.0:1789760739.763237:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711412695236 time 711412434820 state 0x1 ref 1
00000100:00100000:1.0:1789760739.763261:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711412695236 time 711449944644 state 0x0 ref 1
00000100:00100000:1.0:1789760739.763269:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760739.763309:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21667840, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:1.0:1789760739.763344:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.763356:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:1.0:1789760739.763360:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760739.763365:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.763379:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.799107:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972610 is committed
00002000:00010000:0.0:1789760739.799217:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21667840 -> 21671936
00010000:00010000:0.0:1789760739.799233:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.799246:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.799255:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.799263:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760739.799268:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.799277:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.799384:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.799393:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c387 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21667840->21671935] (req 21667840->21671935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760739.799525:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36251us (36672us total) trans 4294972610 rc 0/0
00000100:00100000:0.0:1789760739.799536:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5323
00000100:00100000:0.0:1789760739.799546:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711412695236 time 711449944644 state 0x2 ref 0
00000100:00100000:1.0:1789760739.805964:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760739.806044:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520935168
00000100:00100000:3.0:1789760739.806054:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520935168
00000100:00100000:3.0:1789760739.806108:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711412695236 time 711449944644 state 0x0 ref 1
00000100:00100000:3.0:1789760739.806123:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711450205060 time 711449944644 state 0x1 ref 1
00000100:00100000:3.0:1789760739.806155:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711450205060 time 711492837170 state 0x0 ref 1
00000100:00100000:3.0:1789760739.806167:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760739.806225:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21671936, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:3.0:1789760739.806235:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.806252:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:3.0:1789760739.806257:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760739.806264:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.806277:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760739.852385:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972611 is committed
00002000:00010000:3.0:1789760739.852537:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21671936 -> 21676032
00010000:00010000:3.0:1789760739.852553:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.852567:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.852575:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.852582:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760739.852587:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.852595:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.852614:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760739.852622:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c38e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21671936->21676031] (req 21671936->21676031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760739.852715:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46546us (46757us total) trans 4294972611 rc 0/0
00000100:00100000:3.0:1789760739.852727:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5324
00000100:00100000:3.0:1789760739.852736:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711450205060 time 711492837170 state 0x2 ref 0
00000100:00100000:3.0:1789760739.862212:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760739.862360:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520935296
00000100:00100000:1.0:1789760739.862370:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520935296
00000100:00100000:1.0:1789760739.862426:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711450205060 time 711492837170 state 0x0 ref 1
00000100:00100000:1.0:1789760739.862442:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711493097586 time 711492837170 state 0x1 ref 1
00000100:00100000:1.0:1789760739.862464:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711493097586 time 711549146588 state 0x0 ref 1
00000100:00100000:1.0:1789760739.862477:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520935296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760739.862525:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21676032, mtime: 0x6aad94e4, atime: 0x0, ctime: 0x6aad94e4, blocks: 0xa807
00010000:00010000:1.0:1789760739.862535:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.862551:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:1.0:1789760739.862555:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760739.862562:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.862576:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.897478:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760739.909461:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972612 is committed
00002000:00010000:0.0:1789760739.909644:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21676032 -> 21680128
00002000:00010000:0.0:1789760739.909648:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760740 -> 1789760741
00002000:00010000:0.0:1789760739.909650:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760740 -> 1789760741
00010000:00010000:0.0:1789760739.909661:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.909671:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.909678:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.909685:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760739.909690:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.909705:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.909725:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.909732:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c395 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21676032->21680127] (req 21676032->21680127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760739.909957:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520935296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47467us (47739us total) trans 4294972612 rc 0/0
00000100:00100000:0.0:1789760739.909967:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5325
00000100:00100000:0.0:1789760739.909975:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711493097586 time 711549146588 state 0x2 ref 0
00000100:00100000:0.0:1789760739.914177:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760739.914643:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520935424
00000100:00100000:1.0:1789760739.914653:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520935424
00000100:00100000:1.0:1789760739.914710:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711493097586 time 711549146588 state 0x0 ref 1
00000100:00100000:1.0:1789760739.914726:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711549407004 time 711549146588 state 0x1 ref 1
00000100:00100000:1.0:1789760739.914802:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711549407004 time 711601483641 state 0x0 ref 1
00000100:00100000:1.0:1789760739.914815:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520935424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760739.914862:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21680128, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760739.914871:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.914887:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:1.0:1789760739.914891:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760739.914898:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.914912:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760739.961649:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1789760739.961673:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548752512:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1789760739.961742:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760739.961822:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548752512
00000100:00100000:0.0:1789760739.961829:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548752512
00000100:00100000:0.0:1789760739.961873:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425
00000100:00100000:0.0:1789760739.961882:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548752512:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1789760739.961919:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:0.0:1789760739.961967:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548752512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (225us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760739.961976:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425
00000100:00100000:0.0:1789760739.962022:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548752512:0@lo:41:osp-pre-0-1.0
00002000:00010000:1.0:1789760739.967911:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21680128 -> 21684224
00010000:00010000:1.0:1789760739.967933:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.967950:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.967958:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.967965:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760739.967970:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.967979:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.967999:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760739.968007:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c39c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21680128->21684223] (req 21680128->21684223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760739.968103:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520935424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53285us (53929us total) trans 4294972613 rc 0/0
00000100:00100000:1.0:1789760739.968114:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5326
00000100:00100000:1.0:1789760739.968123:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711549407004 time 711601483641 state 0x2 ref 0
00000001:00080000:0.0:1789760739.968914:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972613 is committed
00000100:00100000:1.0:1789760739.971991:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760739.972089:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520935552
00000100:00100000:0.0:1789760739.972099:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520935552
00000100:00100000:0.0:1789760739.972152:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711549407004 time 711601483641 state 0x0 ref 1
00000100:00100000:0.0:1789760739.972167:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711601744057 time 711601483641 state 0x1 ref 1
00000100:00100000:0.0:1789760739.972236:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711601744057 time 711658918835 state 0x0 ref 1
00000100:00100000:0.0:1789760739.972257:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520935552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760739.972305:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21684224, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:0.0:1789760739.972347:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.972362:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:0.0:1789760739.972366:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760739.972373:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760739.972386:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760740.034537:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21684224 -> 21688320
00010000:00010000:0.0:1789760740.034556:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.034569:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.034579:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.034587:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.034592:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.034602:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.034621:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.034629:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c3a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21684224->21688319] (req 21684224->21688319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.034719:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520935552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62467us (62734us total) trans 4294972614 rc 0/0
00000100:00100000:0.0:1789760740.034729:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5327
00000100:00100000:0.0:1789760740.034738:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711601744057 time 711658918835 state 0x2 ref 0
00000001:00080000:1.0:1789760740.035967:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972614 is committed
00000100:00100000:0.0:1789760740.039577:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760740.039731:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520935680
00000100:00100000:3.0:1789760740.039816:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520935680
00000100:00080000:1.0:1789760740.040009:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760740.040065:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711601744057 time 711658918835 state 0x0 ref 1
00000100:00100000:3.0:1789760740.040080:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711659179251 time 711658918835 state 0x1 ref 1
00000100:00100000:3.0:1789760740.040108:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711659179251 time 711726791294 state 0x0 ref 1
00000100:00100000:3.0:1789760740.040122:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760740.040167:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21688320, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:3.0:1789760740.040177:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.040191:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:3.0:1789760740.040195:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760740.040201:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.040215:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760740.073699:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972615 is committed
00002000:00010000:3.0:1789760740.073807:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21688320 -> 21692416
00010000:00010000:3.0:1789760740.073821:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.073834:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.073843:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.073922:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760740.073928:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.073937:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.073957:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.073962:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21688320->21692415] (req 21688320->21692415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760740.074070:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33948us (34499us total) trans 4294972615 rc 0/0
00000100:00100000:3.0:1789760740.074085:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5328
00000100:00100000:3.0:1789760740.074094:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711659179251 time 711726791294 state 0x2 ref 0
00000100:00100000:2.0:1789760740.076903:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760740.076971:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520935808
00000100:00100000:1.0:1789760740.076979:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520935808
00000100:00100000:1.0:1789760740.077022:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711659179251 time 711726791294 state 0x0 ref 1
00000100:00100000:1.0:1789760740.077033:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711727051710 time 711726791294 state 0x1 ref 1
00000100:00100000:1.0:1789760740.077057:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711727051710 time 711763740877 state 0x0 ref 1
00000100:00100000:1.0:1789760740.077065:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760740.077111:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21692416, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760740.077119:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.077133:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:1.0:1789760740.077136:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760740.077143:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.077155:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760740.102270:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972616 is committed
00002000:00010000:0.0:1789760740.102361:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21692416 -> 21696512
00010000:00010000:0.0:1789760740.102377:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.102391:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.102400:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.102406:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.102411:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.102420:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.102439:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.102447:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c3b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21692416->21696511] (req 21692416->21696511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.102530:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25460us (25631us total) trans 4294972616 rc 0/0
00000100:00100000:0.0:1789760740.102541:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5329
00000100:00100000:0.0:1789760740.102551:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711727051710 time 711763740877 state 0x2 ref 0
00000100:00100000:1.0:1789760740.106475:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760740.106620:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520935936
00000100:00100000:3.0:1789760740.106630:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520935936
00000100:00100000:3.0:1789760740.106684:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711727051710 time 711763740877 state 0x0 ref 1
00000100:00100000:3.0:1789760740.106699:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711764001293 time 711763740877 state 0x1 ref 1
00000100:00100000:3.0:1789760740.106728:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711764001293 time 711793411131 state 0x0 ref 1
00000100:00100000:3.0:1789760740.106742:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760740.106801:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21696512, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:3.0:1789760740.106819:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.106835:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:3.0:1789760740.106839:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760740.106845:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.106858:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760740.146800:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21696512 -> 21700608
00010000:00010000:0.0:1789760740.146820:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.146835:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760740.146922:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972617 is committed
00010000:00010000:0.0:1789760740.146957:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.146965:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.146970:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.146979:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.146998:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.147006:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c3b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21696512->21700607] (req 21696512->21700607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.147251:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520935936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40507us (40780us total) trans 4294972617 rc 0/0
00000100:00100000:0.0:1789760740.147267:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5330
00000100:00100000:0.0:1789760740.147278:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711764001293 time 711793411131 state 0x2 ref 0
00000100:00100000:0.0:1789760740.156080:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760740.156451:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520936064
00000100:00100000:1.0:1789760740.156461:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520936064
00000100:00100000:1.0:1789760740.156520:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711764001293 time 711793411131 state 0x0 ref 1
00000100:00100000:1.0:1789760740.156536:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711793671547 time 711793411131 state 0x1 ref 1
00000100:00100000:1.0:1789760740.156565:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711793671547 time 711843247528 state 0x0 ref 1
00000100:00100000:1.0:1789760740.156578:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520936064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760740.156623:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21700608, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760740.156642:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.156658:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:1.0:1789760740.156662:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760740.156668:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.156681:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760740.200027:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972618 is committed
00002000:00010000:0.0:1789760740.200216:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21700608 -> 21704704
00010000:00010000:0.0:1789760740.200232:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.200243:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.200251:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.200258:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.200263:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.200273:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.200300:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.200308:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c3bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21700608->21704703] (req 21700608->21704703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.200430:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520936064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43849us (44364us total) trans 4294972618 rc 0/0
00000100:00100000:0.0:1789760740.200441:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5331
00000100:00100000:0.0:1789760740.200450:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711793671547 time 711843247528 state 0x2 ref 0
00000100:00100000:2.0:1789760740.205688:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760740.207263:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520936192
00000100:00100000:3.0:1789760740.207280:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520936192
00000100:00100000:3.0:1789760740.207489:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711793671547 time 711843247528 state 0x0 ref 1
00000100:00100000:3.0:1789760740.207508:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711843507944 time 711843247528 state 0x1 ref 1
00000100:00100000:3.0:1789760740.207554:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711843507944 time 711894236482 state 0x0 ref 1
00000100:00100000:2.0:1789760740.207680:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520936192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760740.207765:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21704704, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:2.0:1789760740.207776:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.207797:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:2.0:1789760740.207802:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760740.207809:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.207826:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760740.263578:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972619 is committed
00002000:00010000:3.0:1789760740.263844:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21704704 -> 21708800
00010000:00010000:3.0:1789760740.263860:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.263872:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.263881:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.263888:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760740.263893:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.263901:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.263920:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.263928:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c3c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21704704->21708799] (req 21704704->21708799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760740.264020:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520936192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56449us (58341us total) trans 4294972619 rc 0/0
00000100:00100000:3.0:1789760740.264030:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5332
00000100:00100000:3.0:1789760740.264040:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711843507944 time 711894236482 state 0x2 ref 0
00000100:00100000:1.0:1789760740.270406:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760740.270499:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520936320
00000100:00100000:0.0:1789760740.270521:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520936320
00000100:00100000:0.0:1789760740.270573:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711843507944 time 711894236482 state 0x0 ref 1
00000100:00100000:0.0:1789760740.270589:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711894496898 time 711894236482 state 0x1 ref 1
00000100:00100000:0.0:1789760740.270618:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711894496898 time 711957301196 state 0x0 ref 1
00000100:00100000:0.0:1789760740.270630:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520936320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760740.270678:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21708800, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:0.0:1789760740.270687:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.270703:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=711s v=(0 0)
00010000:00010000:0.0:1789760740.270707:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760740.270712:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.270723:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760740.300774:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972620 is committed
00002000:00010000:0.0:1789760740.304158:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21708800 -> 21712896
00010000:00010000:0.0:1789760740.304179:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.304202:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.304212:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.304220:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.304224:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.304233:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.304251:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.304259:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c3cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21708800->21712895] (req 21708800->21712895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760740.304423:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520936320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33787us (34019us total) trans 4294972620 rc 0/0
00000100:00100000:1.0:1789760740.304435:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5333
00000100:00100000:1.0:1789760740.304444:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711894496898 time 711957301196 state 0x2 ref 0
00000100:00100000:0.0:1789760740.315831:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760740.315900:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520936448
00000100:00100000:3.0:1789760740.315910:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520936448
00000100:00100000:3.0:1789760740.316021:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711894496898 time 711957301196 state 0x0 ref 1
00000100:00100000:3.0:1789760740.316036:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711957561612 time 711957301196 state 0x1 ref 1
00000100:00100000:3.0:1789760740.316068:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711957561612 time 712002751029 state 0x0 ref 1
00000100:00100000:3.0:1789760740.316080:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520936448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760740.316131:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21712896, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:3.0:1789760740.316141:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.316155:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:3.0:1789760740.316159:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760740.316165:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.316180:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760740.352761:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972621 is committed
00002000:00010000:0.0:1789760740.352843:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21712896 -> 21716992
00010000:00010000:0.0:1789760740.352860:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.352873:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.352882:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.352889:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.352895:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.352904:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.352992:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.353002:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c3d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21712896->21716991] (req 21712896->21716991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.353134:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520936448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37051us (37308us total) trans 4294972621 rc 0/0
00000100:00100000:0.0:1789760740.353145:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5334
00000100:00100000:0.0:1789760740.353156:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711957561612 time 712002751029 state 0x2 ref 0
00000100:00100000:2.0:1789760740.362146:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760740.362248:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520936576
00000100:00100000:1.0:1789760740.362258:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520936576
00000100:00100000:1.0:1789760740.362400:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 711957561612 time 712002751029 state 0x0 ref 1
00000100:00100000:1.0:1789760740.362418:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712003011445 time 712002751029 state 0x1 ref 1
00000100:00100000:1.0:1789760740.362493:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712003011445 time 712049175484 state 0x0 ref 1
00000100:00100000:1.0:1789760740.362506:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520936576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760740.362555:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21716992, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760740.362565:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.362579:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760740.362582:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760740.362588:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.362613:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760740.418432:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21716992 -> 21721088
00010000:00010000:1.0:1789760740.418453:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.418467:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.418482:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.418490:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760740.418494:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.418502:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.418522:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.418529:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21716992->21721087] (req 21716992->21721087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760740.418620:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520936576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56111us (56479us total) trans 4294972622 rc 0/0
00000100:00100000:1.0:1789760740.418631:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5335
00000100:00100000:1.0:1789760740.418640:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712003011445 time 712049175484 state 0x2 ref 0
00000001:00080000:3.0:1789760740.419125:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972622 is committed
00000100:00100000:1.0:1789760740.425428:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760740.425766:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520936704
00000100:00100000:2.0:1789760740.425775:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520936704
00000100:00100000:2.0:1789760740.425827:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712003011445 time 712049175484 state 0x0 ref 1
00000100:00100000:2.0:1789760740.425842:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712049435900 time 712049175484 state 0x1 ref 1
00000100:00100000:2.0:1789760740.425989:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712049435900 time 712112670604 state 0x0 ref 1
00000100:00100000:2.0:1789760740.426003:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520936704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760740.426050:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21721088, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:2.0:1789760740.426059:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.426074:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:2.0:1789760740.426078:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760740.426084:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.426099:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760740.462417:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21721088 -> 21725184
00010000:00010000:2.0:1789760740.462435:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.462449:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.462465:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.462473:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760740.462478:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.462487:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.462506:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.462514:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21721088->21725183] (req 21721088->21725183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760740.462593:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520936704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36588us (37170us total) trans 4294972623 rc 0/0
00000100:00100000:2.0:1789760740.462604:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5336
00000100:00100000:2.0:1789760740.462614:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712049435900 time 712112670604 state 0x2 ref 0
00000001:00080000:3.0:1789760740.463125:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972623 is committed
00000100:00100000:0.0:1789760740.465712:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760740.465941:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520936832
00000100:00100000:1.0:1789760740.465951:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520936832
00000100:00100000:1.0:1789760740.466008:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712049435900 time 712112670604 state 0x0 ref 1
00000100:00100000:1.0:1789760740.466027:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712112931020 time 712112670604 state 0x1 ref 1
00000100:00100000:1.0:1789760740.466048:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712112931020 time 712152731454 state 0x0 ref 1
00000100:00100000:1.0:1789760740.466061:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520936832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760740.466108:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21725184, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760740.466118:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.466134:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760740.466138:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760740.466144:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.466159:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760740.508701:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972624 is committed
00002000:00010000:1.0:1789760740.508858:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21725184 -> 21729280
00010000:00010000:1.0:1789760740.508874:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.508886:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.508895:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.508908:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760740.508913:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.508923:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.508942:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.508951:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c3e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21725184->21729279] (req 21725184->21729279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760740.509083:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520936832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43019us (43377us total) trans 4294972624 rc 0/0
00000100:00100000:1.0:1789760740.509095:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5337
00000100:00100000:1.0:1789760740.509106:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712112931020 time 712152731454 state 0x2 ref 0
00000100:00100000:2.0:1789760740.518451:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760740.521479:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520936960
00000100:00100000:0.0:1789760740.521491:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520936960
00000100:00100000:2.0:1789760740.522899:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712112931020 time 712152731454 state 0x0 ref 1
00000100:00100000:2.0:1789760740.522915:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712152991870 time 712152731454 state 0x1 ref 1
00000100:00100000:2.0:1789760740.522949:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712152991870 time 712209632052 state 0x0 ref 1
00000100:00100000:2.0:1789760740.522961:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520936960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760740.523008:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21729280, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:2.0:1789760740.523017:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.523032:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:2.0:1789760740.523036:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760740.523042:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.523055:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760740.551093:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972625 is committed
00002000:00010000:1.0:1789760740.551478:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21729280 -> 21733376
00010000:00010000:1.0:1789760740.551494:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.551507:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.551524:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.551532:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760740.551537:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.551546:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.551565:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.551574:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c3f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21729280->21733375] (req 21729280->21733375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760740.551801:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520936960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28838us (33353us total) trans 4294972625 rc 0/0
00000100:00100000:1.0:1789760740.551812:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5338
00000100:00100000:1.0:1789760740.551821:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712152991870 time 712209632052 state 0x2 ref 0
00000100:00100000:2.0:1789760740.561539:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760740.561648:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520937088
00000100:00100000:0.0:1789760740.561660:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520937088
00000100:00100000:0.0:1789760740.561733:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712152991870 time 712209632052 state 0x0 ref 1
00000100:00100000:0.0:1789760740.561762:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712209892468 time 712209632052 state 0x1 ref 1
00000100:00100000:0.0:1789760740.561794:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712209892468 time 712248476769 state 0x0 ref 1
00000100:00100000:0.0:1789760740.561807:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760740.561872:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21733376, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:0.0:1789760740.561883:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.561902:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:0.0:1789760740.561907:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760740.561915:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.561931:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760740.597471:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972626 is committed
00002000:00010000:1.0:1789760740.597646:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21733376 -> 21737472
00010000:00010000:1.0:1789760740.597666:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.597686:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.597696:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.597704:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760740.597710:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.597719:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.597741:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.597763:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c3f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21733376->21737471] (req 21733376->21737471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760740.597935:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36122us (36401us total) trans 4294972626 rc 0/0
00000100:00100000:1.0:1789760740.597947:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5339
00000100:00100000:1.0:1789760740.597960:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712209892468 time 712248476769 state 0x2 ref 0
00000100:00100000:0.0:1789760740.601165:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760740.601541:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520937216
00000100:00100000:3.0:1789760740.601555:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520937216
00000100:00100000:2.0:1789760740.601770:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712209892468 time 712248476769 state 0x0 ref 1
00000100:00100000:2.0:1789760740.601842:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712248737185 time 712248476769 state 0x1 ref 1
00000100:00100000:2.0:1789760740.601913:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712248737185 time 712288595021 state 0x0 ref 1
00000100:00100000:2.0:1789760740.601928:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760740.601992:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21737472, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:2.0:1789760740.602004:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.602024:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:2.0:1789760740.602030:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760740.602036:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.602051:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760740.653522:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972627 is committed
00002000:00010000:0.0:1789760740.653860:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21737472 -> 21741568
00010000:00010000:0.0:1789760740.653884:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.653899:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.653910:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.653919:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.653926:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.653937:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.653964:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.653982:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c3fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21737472->21741567] (req 21737472->21741567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.654109:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52176us (52951us total) trans 4294972627 rc 0/0
00000100:00100000:0.0:1789760740.654122:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5340
00000100:00100000:0.0:1789760740.654136:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712248737185 time 712288595021 state 0x2 ref 0
00000100:00100000:2.0:1789760740.659530:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760740.659989:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520937344
00000100:00100000:1.0:1789760740.660002:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520937344
00000100:00100000:1.0:1789760740.660084:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712248737185 time 712288595021 state 0x0 ref 1
00000100:00100000:1.0:1789760740.660102:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712288855437 time 712288595021 state 0x1 ref 1
00000100:00100000:1.0:1789760740.660976:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712288855437 time 712347652510 state 0x0 ref 1
00000100:00100000:1.0:1789760740.661000:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760740.661070:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21741568, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760740.661082:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.661102:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760740.661107:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760740.661115:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.661132:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760740.697453:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21741568 -> 21745664
00010000:00010000:1.0:1789760740.697493:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.697512:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.697530:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.697539:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760740.697545:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.697555:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.697580:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.697589:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c405 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21741568->21745663] (req 21741568->21745663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760740.697718:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520937344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36718us (38193us total) trans 4294972628 rc 0/0
00000100:00100000:1.0:1789760740.697730:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5341
00000100:00100000:1.0:1789760740.697742:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712288855437 time 712347652510 state 0x2 ref 0
00000001:00080000:0.0:1789760740.698411:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972628 is committed
00000100:00100000:2.0:1789760740.701662:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760740.701771:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520937472
00000100:00100000:1.0:1789760740.701784:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520937472
00000100:00100000:1.0:1789760740.701854:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712288855437 time 712347652510 state 0x0 ref 1
00000100:00100000:1.0:1789760740.701874:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712347912926 time 712347652510 state 0x1 ref 1
00000100:00100000:1.0:1789760740.701910:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712347912926 time 712388592090 state 0x0 ref 1
00000100:00100000:1.0:1789760740.701927:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760740.701994:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21745664, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760740.702006:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.702026:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760740.702032:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760740.702039:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.702056:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760740.733505:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972629 is committed
00002000:00010000:2.0:1789760740.733651:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21745664 -> 21749760
00010000:00010000:2.0:1789760740.733672:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.733687:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.733698:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.733707:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760740.733713:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.733734:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.733769:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.733790:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c40c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21745664->21749759] (req 21745664->21749759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760740.733912:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31981us (32256us total) trans 4294972629 rc 0/0
00000100:00100000:2.0:1789760740.733924:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5342
00000100:00100000:2.0:1789760740.733936:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712347912926 time 712388592090 state 0x2 ref 0
00000100:00100000:2.0:1789760740.741780:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760740.741880:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520937600
00000100:00100000:0.0:1789760740.741891:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520937600
00000100:00100000:0.0:1789760740.741962:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712347912926 time 712388592090 state 0x0 ref 1
00000100:00100000:0.0:1789760740.741981:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712388852506 time 712388592090 state 0x1 ref 1
00000100:00100000:0.0:1789760740.742015:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712388852506 time 712428697319 state 0x0 ref 1
00000100:00100000:0.0:1789760740.742029:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520937600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760740.742094:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21749760, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:0.0:1789760740.742106:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.742125:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:0.0:1789760740.742131:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760740.742140:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.742156:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760740.772742:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972630 is committed
00002000:00010000:0.0:1789760740.772910:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21749760 -> 21753856
00010000:00010000:0.0:1789760740.772931:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.772954:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.772965:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.772973:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.772980:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.772990:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.773016:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.773026:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c413 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21749760->21753855] (req 21749760->21753855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.773146:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520937600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31113us (31374us total) trans 4294972630 rc 0/0
00000100:00100000:0.0:1789760740.773158:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5343
00000100:00100000:0.0:1789760740.773170:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712388852506 time 712428697319 state 0x2 ref 0
00000100:00100000:0.0:1789760740.777819:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760740.777978:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520937728
00000100:00100000:1.0:1789760740.777992:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520937728
00000100:00100000:1.0:1789760740.778068:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712388852506 time 712428697319 state 0x0 ref 1
00000100:00100000:1.0:1789760740.778088:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712428957735 time 712428697319 state 0x1 ref 1
00000100:00100000:1.0:1789760740.778125:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712428957735 time 712464806712 state 0x0 ref 1
00000100:00100000:1.0:1789760740.778138:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520937728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760740.778208:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21753856, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760740.778221:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.778244:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760740.778249:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760740.778258:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.778286:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760740.804678:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972631 is committed
00002000:00010000:1.0:1789760740.804930:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21753856 -> 21757952
00010000:00010000:1.0:1789760740.804948:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.804959:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.804965:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.804970:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760740.804975:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.804982:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.805008:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.805014:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c41a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21753856->21757951] (req 21753856->21757951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760740.805116:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520937728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26973us (27305us total) trans 4294972631 rc 0/0
00000100:00100000:1.0:1789760740.805129:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5344
00000100:00100000:1.0:1789760740.805140:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712428957735 time 712464806712 state 0x2 ref 0
00000100:00100000:1.0:1789760740.808287:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760740.808512:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520937856
00000100:00100000:0.0:1789760740.808525:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520937856
00000100:00100000:0.0:1789760740.808600:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712428957735 time 712464806712 state 0x0 ref 1
00000100:00100000:0.0:1789760740.808618:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712465067128 time 712464806712 state 0x1 ref 1
00000100:00100000:0.0:1789760740.808646:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712465067128 time 712495328765 state 0x0 ref 1
00000100:00100000:0.0:1789760740.808660:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520937856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760740.808725:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21757952, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:0.0:1789760740.808736:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.808767:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:0.0:1789760740.808772:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760740.808780:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.808797:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760740.853429:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972632 is committed
00002000:00010000:0.0:1789760740.853754:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21757952 -> 21762048
00010000:00010000:0.0:1789760740.853775:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.853889:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.853900:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.853909:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.853915:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.853925:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.853955:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.853964:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c421 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21757952->21762047] (req 21757952->21762047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.854111:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520937856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45445us (45835us total) trans 4294972632 rc 0/0
00000100:00100000:0.0:1789760740.854196:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5345
00000100:00100000:0.0:1789760740.854211:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712465067128 time 712495328765 state 0x2 ref 0
00000100:00100000:2.0:1789760740.858146:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760740.858241:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520937984
00000100:00100000:1.0:1789760740.858254:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520937984
00000100:00100000:1.0:1789760740.858531:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712465067128 time 712495328765 state 0x0 ref 1
00000100:00100000:1.0:1789760740.858551:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712495589181 time 712495328765 state 0x1 ref 1
00000100:00100000:1.0:1789760740.858619:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712495589181 time 712545300158 state 0x0 ref 1
00000100:00100000:1.0:1789760740.858634:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760740.858701:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21762048, mtime: 0x6aad94e5, atime: 0x0, ctime: 0x6aad94e5, blocks: 0xa807
00010000:00010000:1.0:1789760740.858715:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.858751:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760740.858758:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760740.858765:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760740.858802:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760740.922373:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1789760740.924525:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21762048 -> 21766144
00002000:00010000:0.0:1789760740.924542:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760741 -> 1789760742
00002000:00010000:0.0:1789760740.924545:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760741 -> 1789760742
00010000:00010000:0.0:1789760740.924572:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760740.924586:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972633 is committed
00010000:00010000:0.0:1789760740.924588:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.924602:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.924611:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760740.924618:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.924631:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.924657:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.924666:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c428 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21762048->21766143] (req 21762048->21766143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760740.924796:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520937984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66157us (66659us total) trans 4294972633 rc 0/0
00000100:00100000:0.0:1789760740.924809:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5346
00000100:00100000:0.0:1789760740.924821:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712495589181 time 712545300158 state 0x2 ref 0
00000100:00100000:2.0:1789760740.928782:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760740.928849:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520938112
00000100:00100000:0.0:1789760740.928864:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520938112
00000100:00100000:0.0:1789760740.928944:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712495589181 time 712545300158 state 0x0 ref 1
00000100:00100000:0.0:1789760740.928965:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712545560574 time 712545300158 state 0x1 ref 1
00000100:00100000:0.0:1789760740.929006:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712545560574 time 712615687551 state 0x0 ref 1
00000100:00100000:0.0:1789760740.929022:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760740.929097:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21766144, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:0.0:1789760740.929110:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.929132:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:0.0:1789760740.929138:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760740.929146:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.929164:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760740.972451:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972634 is committed
00002000:00010000:2.0:1789760740.972628:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21766144 -> 21770240
00010000:00010000:2.0:1789760740.972647:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.972662:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.972673:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.972692:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760740.972697:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.972707:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.972733:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760740.972751:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c42f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21766144->21770239] (req 21766144->21770239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760740.974197:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45152us (45404us total) trans 4294972634 rc 0/0
00000100:00100000:2.0:1789760740.974215:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5347
00000100:00100000:2.0:1789760740.974227:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712545560574 time 712615687551 state 0x2 ref 0
00000100:00100000:1.0:1789760740.983972:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760740.984118:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520938240
00000100:00100000:0.0:1789760740.984131:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520938240
00000100:00100000:0.0:1789760740.984287:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712545560574 time 712615687551 state 0x0 ref 1
00000100:00100000:0.0:1789760740.984308:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712615947967 time 712615687551 state 0x1 ref 1
00000100:00100000:0.0:1789760740.984390:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712615947967 time 712671071950 state 0x0 ref 1
00000100:00100000:0.0:1789760740.984409:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760740.984478:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21770240, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:0.0:1789760740.984490:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.984511:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:0.0:1789760740.984516:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760740.984524:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760740.984542:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760740.986233:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1789760740.986261:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548752640:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1789760740.986423:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760740.987199:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548752640
00000100:00100000:2.0:1789760740.987211:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548752640
00000100:00100000:2.0:1789760740.987274:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426
00000100:00100000:2.0:1789760740.987287:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548752640:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1789760740.987367:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:2.0:1789760740.987467:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548752640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (1044us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760740.987479:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426
00000100:00100000:1.0:1789760740.987580:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548752640:0@lo:41:osp-pre-1-0.0
00000001:00080000:3.0:1789760741.049613:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972635 is committed
00002000:00010000:2.0:1789760741.049786:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21770240 -> 21774336
00010000:00010000:2.0:1789760741.049808:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.049824:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.049835:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.049843:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760741.049848:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.049859:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.049884:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.049892:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c436 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21770240->21774335] (req 21770240->21774335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760741.050066:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65653us (66102us total) trans 4294972635 rc 0/0
00000100:00100000:2.0:1789760741.050081:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5348
00000100:00100000:2.0:1789760741.050094:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712615947967 time 712671071950 state 0x2 ref 0
00000100:00100000:0.0:1789760741.060581:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760741.061425:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520938368
00000100:00100000:1.0:1789760741.061440:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520938368
00000100:00100000:1.0:1789760741.061516:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712615947967 time 712671071950 state 0x0 ref 1
00000100:00100000:1.0:1789760741.061537:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712671332366 time 712671071950 state 0x1 ref 1
00000100:00100000:1.0:1789760741.061573:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712671332366 time 712748255665 state 0x0 ref 1
00000100:00100000:1.0:1789760741.061588:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760741.061653:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21774336, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:1.0:1789760741.061664:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.061685:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760741.061691:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760741.061699:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.061717:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760741.116169:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972636 is committed
00002000:00010000:1.0:1789760741.116503:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21774336 -> 21778432
00010000:00010000:1.0:1789760741.116525:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.116542:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.116553:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.116562:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760741.116568:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.116579:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.116606:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.116617:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c43d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21774336->21778431] (req 21774336->21778431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.116796:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55203us (56221us total) trans 4294972636 rc 0/0
00000100:00100000:1.0:1789760741.116810:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5349
00000100:00100000:1.0:1789760741.116822:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712671332366 time 712748255665 state 0x2 ref 0
00000100:00100000:0.0:1789760741.119827:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760741.119923:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520938496
00000100:00100000:1.0:1789760741.119936:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520938496
00000100:00100000:1.0:1789760741.120006:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712671332366 time 712748255665 state 0x0 ref 1
00000100:00100000:1.0:1789760741.120025:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712748516081 time 712748255665 state 0x1 ref 1
00000100:00100000:1.0:1789760741.120098:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712748516081 time 712806779414 state 0x0 ref 1
00000100:00100000:1.0:1789760741.120113:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760741.120179:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21778432, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:1.0:1789760741.120191:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.120212:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760741.120217:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760741.120224:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.120246:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760741.150475:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21778432 -> 21782528
00010000:00010000:0.0:1789760741.150501:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.150517:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.150528:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.150536:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760741.150543:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.150553:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.150576:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.150584:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c444 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21778432->21782527] (req 21778432->21782527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760741.150709:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520938496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30592us (30889us total) trans 4294972637 rc 0/0
00000100:00100000:0.0:1789760741.150722:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5350
00000100:00100000:0.0:1789760741.150734:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712748516081 time 712806779414 state 0x2 ref 0
00000001:00080000:3.0:1789760741.150889:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972637 is committed
00000100:00100000:2.0:1789760741.153727:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.154086:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520938624
00000100:00100000:0.0:1789760741.154099:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520938624
00000100:00100000:0.0:1789760741.154174:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712748516081 time 712806779414 state 0x0 ref 1
00000100:00100000:0.0:1789760741.154193:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712807039830 time 712806779414 state 0x1 ref 1
00000100:00100000:0.0:1789760741.154230:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712807039830 time 712840911731 state 0x0 ref 1
00000100:00100000:0.0:1789760741.154245:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760741.154670:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21782528, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:1.0:1789760741.154683:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.154704:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:1.0:1789760741.154709:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760741.154718:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.154813:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760741.204014:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972638 is committed
00002000:00010000:0.0:1789760741.204191:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21782528 -> 21786624
00010000:00010000:0.0:1789760741.204212:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.204238:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.204249:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.204267:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760741.204279:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.204291:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.204579:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.204590:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c44b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21782528->21786623] (req 21782528->21786623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.205112:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50860us (51389us total) trans 4294972638 rc 0/0
00000100:00100000:1.0:1789760741.205129:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5351
00000100:00100000:1.0:1789760741.205141:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712807039830 time 712840911731 state 0x2 ref 0
00000100:00100000:1.0:1789760741.210949:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.211618:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520938752
00000100:00100000:0.0:1789760741.211633:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520938752
00000100:00100000:0.0:1789760741.211714:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712807039830 time 712840911731 state 0x0 ref 1
00000100:00100000:0.0:1789760741.211734:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712841172147 time 712840911731 state 0x1 ref 1
00000100:00100000:0.0:1789760741.211781:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712841172147 time 712898463300 state 0x0 ref 1
00000100:00100000:0.0:1789760741.211796:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760741.211868:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21786624, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:0.0:1789760741.211879:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.211899:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:0.0:1789760741.211904:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760741.211911:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.211928:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760741.216951:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760741.217001:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760741.217099:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760741.220023:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760741.220377:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520938880
00000100:00100000:3.0:1789760741.220391:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520938880
00000100:00100000:3.0:1789760741.220451:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 470
00000100:00100000:3.0:1789760741.220576:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2407:x1876699520938880:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760741.220674:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2407:x1876699520938880:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 212us (3584us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760741.220682:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 470
00000100:00100000:2.0:1789760741.221510:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.222191:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520939008
00000100:00100000:1.0:1789760741.222202:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520939264
00000100:00100000:0.0:1789760741.222203:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520939008
00000100:00100000:1.0:1789760741.222211:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520939264
00000100:00100000:0.0:1789760741.222239:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520939136
00000100:00100000:0.0:1789760741.222599:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520939136
00000100:00100000:0.0:1789760741.222675:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 873
00000100:00100000:1.0:1789760741.222684:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 874
00000100:00100000:0.0:1789760741.222689:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520939136:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760741.222699:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520939264:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760741.222790:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520939264:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 95us (5787us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760741.222798:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 874
00000100:00100000:0.0:1789760741.225064:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520939136:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 2364us (5037us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760741.225081:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 873
00000100:00080000:0.0:1789760741.225127:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:0.0:1789760741.225135:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:0.0:1789760741.225214:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 875
00000100:00100000:0.0:1789760741.225224:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2407:x1876699520939008:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760741.225536:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2407:x1876699520939008:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 313us (8599us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760741.225544:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 875
00000100:00080000:0.0:1789760741.225560:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:0.0:1789760741.226681:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520939392
00000100:00100000:0.0:1789760741.226696:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520939392
00000100:00100000:0.0:1789760741.226782:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 876
00000100:00100000:0.0:1789760741.226792:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520939392:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760741.226856:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699520939392:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 65us (5349us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760741.226863:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 876
00000100:00080000:2.0:1789760741.227004:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000001:00080000:3.0:1789760741.256972:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972639 is committed
00002000:00010000:1.0:1789760741.258068:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21786624 -> 21790720
00010000:00010000:1.0:1789760741.258093:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.258120:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.258130:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.258139:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760741.258145:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.258156:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.258183:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.258192:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c452 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21786624->21790719] (req 21786624->21790719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.258675:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520938752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46872us (47733us total) trans 4294972639 rc 0/0
00000100:00100000:1.0:1789760741.258691:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5352
00000100:00100000:1.0:1789760741.258704:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712841172147 time 712898463300 state 0x2 ref 0
00000100:00100000:1.0:1789760741.262566:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760741.262663:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520939520
00000100:00100000:2.0:1789760741.262674:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520939520
00000100:00100000:2.0:1789760741.262762:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712841172147 time 712898463300 state 0x0 ref 1
00000100:00100000:2.0:1789760741.262783:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712898723716 time 712898463300 state 0x1 ref 1
00000100:00100000:2.0:1789760741.262826:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712898723716 time 712949504643 state 0x0 ref 1
00000100:00100000:2.0:1789760741.262841:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520939520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760741.262907:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21790720, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:2.0:1789760741.262919:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.262938:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=712s v=(0 0)
00010000:00010000:2.0:1789760741.262942:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760741.262950:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.262963:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760741.315506:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972640 is committed
00002000:00010000:1.0:1789760741.315720:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21790720 -> 21794816
00010000:00010000:1.0:1789760741.315749:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.315764:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.315775:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.315784:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760741.315789:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.315800:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.315827:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.315836:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c459 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21790720->21794815] (req 21790720->21794815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.315967:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520939520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53122us (53408us total) trans 4294972640 rc 0/0
00000100:00100000:1.0:1789760741.315980:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5353
00000100:00100000:1.0:1789760741.315993:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712898723716 time 712949504643 state 0x2 ref 0
00000100:00100000:2.0:1789760741.318717:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760741.318972:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520939648
00000100:00100000:1.0:1789760741.318988:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520939648
00000100:00100000:1.0:1789760741.319174:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712898723716 time 712949504643 state 0x0 ref 1
00000100:00100000:1.0:1789760741.319192:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712949765059 time 712949504643 state 0x1 ref 1
00000100:00100000:1.0:1789760741.319230:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712949765059 time 713005912009 state 0x0 ref 1
00000100:00100000:1.0:1789760741.319244:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520939648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760741.319308:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21794816, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:1.0:1789760741.319402:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.319422:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:1.0:1789760741.319427:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760741.319435:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.319451:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760741.366786:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972641 is committed
00002000:00010000:1.0:1789760741.367057:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21794816 -> 21798912
00010000:00010000:1.0:1789760741.367078:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.367094:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.367103:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.367112:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760741.367118:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.367128:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.367153:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.367162:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c460 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21794816->21798911] (req 21794816->21798911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.367635:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520939648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48384us (48921us total) trans 4294972641 rc 0/0
00000100:00100000:1.0:1789760741.367653:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5354
00000100:00100000:1.0:1789760741.367665:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712949765059 time 713005912009 state 0x2 ref 0
00000100:00100000:3.0:1789760741.370583:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760741.370682:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520939776
00000100:00100000:1.0:1789760741.370695:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520939776
00000100:00100000:1.0:1789760741.370776:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 712949765059 time 713005912009 state 0x0 ref 1
00000100:00100000:1.0:1789760741.370796:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713006172425 time 713005912009 state 0x1 ref 1
00000100:00100000:1.0:1789760741.370835:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713006172425 time 713057517525 state 0x0 ref 1
00000100:00100000:1.0:1789760741.370850:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520939776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760741.370915:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21798912, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:1.0:1789760741.370926:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.370947:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:1.0:1789760741.370952:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760741.370960:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.370978:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760741.408047:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972642 is committed
00002000:00010000:1.0:1789760741.408170:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21798912 -> 21803008
00010000:00010000:1.0:1789760741.408191:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.408205:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.408215:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.408223:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760741.408228:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.408237:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.408262:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.408414:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c467 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21798912->21803007] (req 21798912->21803007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.408718:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520939776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37863us (38141us total) trans 4294972642 rc 0/0
00000100:00100000:1.0:1789760741.408731:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5355
00000100:00100000:1.0:1789760741.408751:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713006172425 time 713057517525 state 0x2 ref 0
00000100:00100000:2.0:1789760741.412700:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.412824:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520939904
00000100:00100000:0.0:1789760741.412839:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520939904
00000100:00100000:0.0:1789760741.412920:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713006172425 time 713057517525 state 0x0 ref 1
00000100:00100000:0.0:1789760741.412940:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713057777941 time 713057517525 state 0x1 ref 1
00000100:00100000:0.0:1789760741.412988:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713057777941 time 713099670184 state 0x0 ref 1
00000100:00100000:0.0:1789760741.413005:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520939904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760741.413088:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21803008, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:0.0:1789760741.413100:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.413128:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:0.0:1789760741.413133:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760741.413146:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.413163:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760741.464360:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972643 is committed
00002000:00010000:1.0:1789760741.464792:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21803008 -> 21807104
00010000:00010000:1.0:1789760741.464812:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.464838:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.464848:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.464856:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760741.464862:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.464872:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.464898:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.464907:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c46e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21803008->21807103] (req 21803008->21807103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.465037:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520939904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52028us (52345us total) trans 4294972643 rc 0/0
00000100:00100000:1.0:1789760741.465051:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5356
00000100:00100000:1.0:1789760741.465063:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713057777941 time 713099670184 state 0x2 ref 0
00000100:00100000:2.0:1789760741.471140:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760741.471238:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520940032
00000100:00100000:1.0:1789760741.471253:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520940032
00000100:00100000:1.0:1789760741.471434:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713057777941 time 713099670184 state 0x0 ref 1
00000100:00100000:1.0:1789760741.471456:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713099930600 time 713099670184 state 0x1 ref 1
00000100:00100000:2.0:1789760741.471590:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713099930600 time 713158268977 state 0x0 ref 1
00000100:00100000:2.0:1789760741.471608:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520940032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760741.471678:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21807104, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:2.0:1789760741.471690:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.471710:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:2.0:1789760741.471715:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760741.471723:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.471750:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760741.498097:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548752768:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1789760741.498191:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760741.498281:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1789760741.498288:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548752896:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1789760741.498342:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760741.498426:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548752768
00000100:00100000:2.0:1789760741.498436:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548752768
00000100:00100000:2.0:1789760741.498498:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548752896
00000100:00100000:2.0:1789760741.498502:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548752896
00000100:00100000:2.0:1789760741.498522:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358
00000100:00100000:2.0:1789760741.498531:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548752768:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1789760741.498561:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527499264 pending 1703936 free 3836739584 avail 3831496704
00000100:00100000:2.0:1789760741.498633:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548752768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (442us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760741.498641:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358
00000100:00100000:2.0:1789760741.498658:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359
00000100:00100000:2.0:1789760741.498664:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548752896:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1789760741.498673:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527499264 pending 1703936 free 3836739584 avail 3831496704
00000100:00100000:2.0:1789760741.498695:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548752896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (353us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760741.498701:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359
00000100:00100000:2.0:1789760741.498762:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548752896:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1789760741.498776:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548752768:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1789760741.498841:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760741.520511:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972644 is committed
00002000:00010000:1.0:1789760741.520672:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21807104 -> 21811200
00010000:00010000:1.0:1789760741.520692:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.520707:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.520718:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.520726:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760741.520732:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.520752:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.520776:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.520785:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c475 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21807104->21811199] (req 21807104->21811199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.520936:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520940032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49326us (49804us total) trans 4294972644 rc 0/0
00000100:00100000:1.0:1789760741.520954:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5357
00000100:00100000:1.0:1789760741.520966:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713099930600 time 713158268977 state 0x2 ref 0
00000100:00100000:3.0:1789760741.525115:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760741.525233:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520940160
00000100:00100000:2.0:1789760741.525246:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520940160
00000100:00100000:2.0:1789760741.525383:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713099930600 time 713158268977 state 0x0 ref 1
00000100:00100000:2.0:1789760741.525403:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713158529393 time 713158268977 state 0x1 ref 1
00000100:00100000:2.0:1789760741.525439:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713158529393 time 713212116545 state 0x0 ref 1
00000100:00100000:2.0:1789760741.525455:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760741.525521:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21811200, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:2.0:1789760741.525534:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.525555:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:2.0:1789760741.525561:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760741.525569:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.525591:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760741.558260:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972645 is committed
00002000:00010000:1.0:1789760741.558410:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21811200 -> 21815296
00010000:00010000:1.0:1789760741.558432:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.558447:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.558458:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.558466:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760741.558472:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.558482:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.558505:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.558518:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c47c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21811200->21815295] (req 21811200->21815295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760741.558639:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33179us (33540us total) trans 4294972645 rc 0/0
00000100:00100000:1.0:1789760741.558651:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5358
00000100:00100000:1.0:1789760741.558663:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713158529393 time 713212116545 state 0x2 ref 0
00000100:00100000:2.0:1789760741.562206:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.562365:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520940288
00000100:00100000:0.0:1789760741.562387:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520940288
00000100:00100000:0.0:1789760741.562467:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713158529393 time 713212116545 state 0x0 ref 1
00000100:00100000:0.0:1789760741.562487:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713212376961 time 713212116545 state 0x1 ref 1
00000100:00100000:0.0:1789760741.562513:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713212376961 time 713249195608 state 0x0 ref 1
00000100:00100000:0.0:1789760741.562526:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760741.562591:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21815296, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:0.0:1789760741.562602:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.562622:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:0.0:1789760741.562627:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760741.562634:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.562650:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760741.596120:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972646 is committed
00002000:00010000:2.0:1789760741.596564:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21815296 -> 21819392
00010000:00010000:2.0:1789760741.596588:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.596603:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.596615:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.596624:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760741.596629:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.596639:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.596663:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.596671:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c483 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21815296->21819391] (req 21815296->21819391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760741.596806:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34274us (34607us total) trans 4294972646 rc 0/0
00000100:00100000:2.0:1789760741.596819:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5359
00000100:00100000:2.0:1789760741.596831:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713212376961 time 713249195608 state 0x2 ref 0
00000100:00100000:3.0:1789760741.599520:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760741.599754:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520940416
00000100:00100000:1.0:1789760741.599767:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520940416
00000100:00100000:1.0:1789760741.599834:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713212376961 time 713249195608 state 0x0 ref 1
00000100:00100000:1.0:1789760741.599853:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713249456024 time 713249195608 state 0x1 ref 1
00000100:00100000:1.0:1789760741.599879:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713249456024 time 713286562373 state 0x0 ref 1
00000100:00100000:1.0:1789760741.599892:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760741.599953:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21819392, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:1.0:1789760741.599964:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.599985:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:1.0:1789760741.599991:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760741.599998:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.600020:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760741.639767:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972647 is committed
00002000:00010000:0.0:1789760741.640076:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21819392 -> 21823488
00010000:00010000:0.0:1789760741.640098:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.640114:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.640125:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.640133:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760741.640140:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.640150:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.640176:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.640185:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c48a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21819392->21823487] (req 21819392->21823487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760741.640381:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40420us (40804us total) trans 4294972647 rc 0/0
00000100:00100000:0.0:1789760741.640393:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5360
00000100:00100000:0.0:1789760741.640406:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713249456024 time 713286562373 state 0x2 ref 0
00000100:00100000:3.0:1789760741.643153:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760741.643454:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520940544
00000100:00100000:1.0:1789760741.643469:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520940544
00000100:00100000:1.0:1789760741.643617:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713249456024 time 713286562373 state 0x0 ref 1
00000100:00100000:1.0:1789760741.643639:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713286822789 time 713286562373 state 0x1 ref 1
00000100:00100000:1.0:1789760741.643665:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713286822789 time 713330348222 state 0x0 ref 1
00000100:00100000:1.0:1789760741.643679:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520940544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760741.643753:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21823488, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:1.0:1789760741.643764:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.643783:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:1.0:1789760741.643788:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760741.643796:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.643812:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760741.684593:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972648 is committed
00002000:00010000:3.0:1789760741.684756:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21823488 -> 21827584
00010000:00010000:3.0:1789760741.684778:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.684793:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.684804:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.684812:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760741.684817:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.684827:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.684850:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.684858:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c491 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21823488->21827583] (req 21823488->21827583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760741.685029:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520940544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41346us (41882us total) trans 4294972648 rc 0/0
00000100:00100000:3.0:1789760741.685043:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5361
00000100:00100000:3.0:1789760741.685056:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713286822789 time 713330348222 state 0x2 ref 0
00000100:00100000:2.0:1789760741.688429:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760741.688621:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520940672
00000100:00100000:3.0:1789760741.688635:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520940672
00000100:00100000:3.0:1789760741.688711:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713286822789 time 713330348222 state 0x0 ref 1
00000100:00100000:3.0:1789760741.688730:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713330608638 time 713330348222 state 0x1 ref 1
00000100:00100000:3.0:1789760741.688767:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713330608638 time 713375448294 state 0x0 ref 1
00000100:00100000:3.0:1789760741.688781:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760741.688846:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21827584, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:3.0:1789760741.688857:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.688877:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:3.0:1789760741.688882:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760741.688890:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.688908:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760741.723646:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972649 is committed
00002000:00010000:2.0:1789760741.723784:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21827584 -> 21831680
00010000:00010000:2.0:1789760741.723805:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.723821:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.723830:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.723838:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760741.723843:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.723858:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.723881:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.723889:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c498 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21827584->21831679] (req 21827584->21831679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760741.724057:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35270us (35634us total) trans 4294972649 rc 0/0
00000100:00100000:2.0:1789760741.724070:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5362
00000100:00100000:2.0:1789760741.724081:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713330608638 time 713375448294 state 0x2 ref 0
00000100:00100000:3.0:1789760741.727476:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.727563:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520940800
00000100:00100000:0.0:1789760741.727576:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520940800
00000100:00100000:0.0:1789760741.727645:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713330608638 time 713375448294 state 0x0 ref 1
00000100:00100000:0.0:1789760741.727665:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713375708710 time 713375448294 state 0x1 ref 1
00000100:00100000:0.0:1789760741.727699:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713375708710 time 713414381830 state 0x0 ref 1
00000100:00100000:0.0:1789760741.727713:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760741.727782:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21831680, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:0.0:1789760741.727793:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.727813:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:0.0:1789760741.727818:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760741.727826:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.727841:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760741.763352:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21831680 -> 21835776
00010000:00010000:0.0:1789760741.763489:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.763508:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.763517:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.763526:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760741.763532:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.763542:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.763569:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.763577:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c49f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21831680->21835775] (req 21831680->21835775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760741.763700:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520940800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35982us (36231us total) trans 4294972650 rc 0/0
00000100:00100000:0.0:1789760741.763713:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5363
00000100:00100000:0.0:1789760741.763725:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713375708710 time 713414381830 state 0x2 ref 0
00000001:00080000:3.0:1789760741.766523:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972650 is committed
00000100:00100000:2.0:1789760741.766689:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.766803:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520940928
00000100:00100000:0.0:1789760741.766815:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520940928
00000100:00100000:0.0:1789760741.766884:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713375708710 time 713414381830 state 0x0 ref 1
00000100:00100000:0.0:1789760741.766903:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713414642246 time 713414381830 state 0x1 ref 1
00000100:00100000:0.0:1789760741.766973:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713414642246 time 713453654860 state 0x0 ref 1
00000100:00100000:0.0:1789760741.766987:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520940928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760741.767118:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21835776, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:0.0:1789760741.767130:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.767149:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:0.0:1789760741.767155:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760741.767163:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.767178:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760741.804757:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21835776 -> 21839872
00010000:00010000:0.0:1789760741.804796:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.804811:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.804822:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.804830:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760741.804836:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.804847:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.804870:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.804878:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21835776->21839871] (req 21835776->21839871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760741.805015:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520940928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38022us (38322us total) trans 4294972651 rc 0/0
00000100:00100000:0.0:1789760741.805033:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5364
00000100:00100000:0.0:1789760741.805046:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713414642246 time 713453654860 state 0x2 ref 0
00000001:00080000:3.0:1789760741.805141:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972651 is committed
00000100:00100000:2.0:1789760741.809602:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760741.809703:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520941056
00000100:00100000:3.0:1789760741.809716:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520941056
00000100:00100000:3.0:1789760741.809801:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713414642246 time 713453654860 state 0x0 ref 1
00000100:00100000:3.0:1789760741.809820:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713453915276 time 713453654860 state 0x1 ref 1
00000100:00100000:3.0:1789760741.809855:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713453915276 time 713496536837 state 0x0 ref 1
00000100:00100000:3.0:1789760741.809870:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760741.809938:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21839872, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:3.0:1789760741.809949:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.809968:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:3.0:1789760741.809973:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760741.809981:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.809997:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760741.844657:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972652 is committed
00002000:00010000:3.0:1789760741.844813:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21839872 -> 21843968
00010000:00010000:3.0:1789760741.844834:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.844849:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.844860:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.844868:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760741.844874:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.844884:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.844909:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.844917:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c4ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21839872->21843967] (req 21839872->21843967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760741.845039:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35165us (35445us total) trans 4294972652 rc 0/0
00000100:00100000:3.0:1789760741.845051:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5365
00000100:00100000:3.0:1789760741.845063:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713453915276 time 713496536837 state 0x2 ref 0
00000100:00100000:3.0:1789760741.848307:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.848695:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520941184
00000100:00100000:0.0:1789760741.848709:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520941184
00000100:00100000:0.0:1789760741.848795:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713453915276 time 713496536837 state 0x0 ref 1
00000100:00100000:0.0:1789760741.848815:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713496797253 time 713496536837 state 0x1 ref 1
00000100:00100000:0.0:1789760741.848848:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713496797253 time 713535529994 state 0x0 ref 1
00000100:00100000:0.0:1789760741.848861:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760741.848925:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21843968, mtime: 0x6aad94e6, atime: 0x0, ctime: 0x6aad94e6, blocks: 0xa807
00010000:00010000:0.0:1789760741.848937:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.848956:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:0.0:1789760741.848962:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760741.848970:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.848984:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760741.906665:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972653 is committed
00002000:00010000:2.0:1789760741.907303:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21843968 -> 21848064
00002000:00010000:2.0:1789760741.907309:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760742 -> 1789760743
00002000:00010000:2.0:1789760741.907340:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760742 -> 1789760743
00010000:00010000:2.0:1789760741.907358:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.907373:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.907388:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.907396:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760741.907402:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.907412:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.907440:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.907448:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c4b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21843968->21848063] (req 21843968->21848063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760741.909197:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60320us (60886us total) trans 4294972653 rc 0/0
00000100:00100000:3.0:1789760741.909217:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5366
00000100:00100000:3.0:1789760741.909231:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713496797253 time 713535529994 state 0x2 ref 0
00000100:00100000:2.0:1789760741.911964:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.912106:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520941312
00000100:00100000:0.0:1789760741.912119:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520941312
00000100:00100000:0.0:1789760741.912192:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713496797253 time 713535529994 state 0x0 ref 1
00000100:00100000:0.0:1789760741.912210:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713535790410 time 713535529994 state 0x1 ref 1
00000100:00100000:0.0:1789760741.912288:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713535790410 time 713598969242 state 0x0 ref 1
00000100:00100000:0.0:1789760741.912303:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520941312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760741.912484:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21848064, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:1.0:1789760741.912498:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.912519:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:1.0:1789760741.912525:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760741.912533:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760741.912551:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.945593:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760741.950704:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972654 is committed
00002000:00010000:3.0:1789760741.950766:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21848064 -> 21852160
00010000:00010000:3.0:1789760741.951146:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.951164:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.951175:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.951184:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760741.951190:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.951202:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.951227:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.951242:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c4bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21848064->21852159] (req 21848064->21852159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760741.951579:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520941312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39270us (39620us total) trans 4294972654 rc 0/0
00000100:00100000:3.0:1789760741.951593:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5367
00000100:00100000:3.0:1789760741.951605:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713535790410 time 713598969242 state 0x2 ref 0
00000100:00100000:2.0:1789760741.954932:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760741.955871:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520941440
00000100:00100000:0.0:1789760741.955887:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520941440
00000100:00100000:0.0:1789760741.955972:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713535790410 time 713598969242 state 0x0 ref 1
00000100:00100000:0.0:1789760741.955993:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713599229658 time 713598969242 state 0x1 ref 1
00000100:00100000:0.0:1789760741.956031:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713599229658 time 713642713482 state 0x0 ref 1
00000100:00100000:0.0:1789760741.956045:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760741.956112:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21852160, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760741.956123:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.956144:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:0.0:1789760741.956150:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760741.956158:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760741.956176:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760741.994297:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21852160 -> 21856256
00010000:00010000:2.0:1789760741.994348:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.994365:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.994376:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.994387:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760741.994393:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.994404:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.994428:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760741.994437:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c4c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21852160->21856255] (req 21852160->21856255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760741.994612:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972655 is committed
00000100:00100000:2.0:1789760741.994727:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38677us (39800us total) trans 4294972655 rc 0/0
00000100:00100000:2.0:1789760741.994749:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5368
00000100:00100000:2.0:1789760741.994760:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713599229658 time 713642713482 state 0x2 ref 0
00000100:00100000:2.0:1789760741.998580:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760741.998679:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520941568
00000100:00100000:3.0:1789760741.998693:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520941568
00000100:00100000:3.0:1789760741.998776:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713599229658 time 713642713482 state 0x0 ref 1
00000100:00100000:3.0:1789760741.998797:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713642973898 time 713642713482 state 0x1 ref 1
00000100:00100000:3.0:1789760741.998841:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713642973898 time 713685522422 state 0x0 ref 1
00000100:00100000:3.0:1789760741.998855:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760741.998927:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21856256, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:3.0:1789760741.998939:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.998959:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:3.0:1789760741.998964:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760741.998971:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760741.998995:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760742.026875:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972656 is committed
00002000:00010000:3.0:1789760742.027254:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21856256 -> 21860352
00010000:00010000:3.0:1789760742.027284:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.027299:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.027310:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.027353:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760742.027359:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.027370:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.027395:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.027677:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21856256->21860351] (req 21856256->21860351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760742.027827:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28968us (29257us total) trans 4294972656 rc 0/0
00000100:00100000:3.0:1789760742.027841:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5369
00000100:00100000:3.0:1789760742.027854:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713642973898 time 713685522422 state 0x2 ref 0
00000100:00100000:3.0:1789760742.032479:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760742.032535:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520941696
00000100:00100000:0.0:1789760742.032548:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520941696
00000100:00100000:0.0:1789760742.032705:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713642973898 time 713685522422 state 0x0 ref 1
00000100:00100000:0.0:1789760742.032724:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713685782838 time 713685522422 state 0x1 ref 1
00000100:00100000:0.0:1789760742.032774:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713685782838 time 713719455902 state 0x0 ref 1
00000100:00100000:0.0:1789760742.032789:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760742.032853:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21860352, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760742.032863:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.032881:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:0.0:1789760742.032886:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760742.032892:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.032908:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:2.0:1789760742.033927:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:1.0:1789760742.083554:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972657 is committed
00002000:00010000:3.0:1789760742.083671:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21860352 -> 21864448
00010000:00010000:3.0:1789760742.083692:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.083708:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.083719:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.083728:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760742.083746:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.083758:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.083783:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.083796:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c4d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21860352->21864447] (req 21860352->21864447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760742.083952:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51159us (51482us total) trans 4294972657 rc 0/0
00000100:00100000:3.0:1789760742.083965:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5370
00000100:00100000:3.0:1789760742.083977:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713685782838 time 713719455902 state 0x2 ref 0
00000100:00100000:2.0:1789760742.087466:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760742.087654:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520941824
00000100:00100000:1.0:1789760742.087668:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520941824
00000100:00100000:1.0:1789760742.088971:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713685782838 time 713719455902 state 0x0 ref 1
00000100:00100000:1.0:1789760742.089000:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713719716318 time 713719455902 state 0x1 ref 1
00000100:00100000:3.0:1789760742.089141:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713719716318 time 713775818848 state 0x0 ref 1
00000100:00100000:3.0:1789760742.089170:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760742.089246:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21864448, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:3.0:1789760742.089258:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.089290:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:3.0:1789760742.089295:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760742.089302:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.089338:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760742.136701:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972658 is committed
00002000:00010000:3.0:1789760742.136839:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21864448 -> 21868544
00010000:00010000:3.0:1789760742.136860:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.136876:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.136887:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.136896:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760742.136902:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.136912:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.136938:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.136947:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21864448->21868543] (req 21864448->21868543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760742.137073:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47910us (49618us total) trans 4294972658 rc 0/0
00000100:00100000:3.0:1789760742.137086:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5371
00000100:00100000:3.0:1789760742.137100:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713719716318 time 713775818848 state 0x2 ref 0
00000100:00100000:3.0:1789760742.140135:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760742.140200:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520941952
00000100:00100000:2.0:1789760742.140212:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520941952
00000100:00100000:2.0:1789760742.140543:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713719716318 time 713775818848 state 0x0 ref 1
00000100:00100000:2.0:1789760742.140567:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713776079264 time 713775818848 state 0x1 ref 1
00000100:00100000:2.0:1789760742.140611:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713776079264 time 713827283586 state 0x0 ref 1
00000100:00100000:2.0:1789760742.140626:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760742.140695:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21868544, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:2.0:1789760742.140707:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.140728:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:2.0:1789760742.140745:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760742.140754:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.140771:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760742.188294:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21868544 -> 21872640
00010000:00010000:1.0:1789760742.188362:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.188379:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.188406:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.188415:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760742.188422:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.188432:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.188456:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.188465:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c4de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21868544->21872639] (req 21868544->21872639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760742.188502:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972659 is committed
00000100:00100000:1.0:1789760742.188587:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520941952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47957us (48459us total) trans 4294972659 rc 0/0
00000100:00100000:1.0:1789760742.188600:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5372
00000100:00100000:1.0:1789760742.188612:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713776079264 time 713827283586 state 0x2 ref 0
00000100:00100000:2.0:1789760742.191893:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760742.192890:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520942080
00000100:00100000:3.0:1789760742.192906:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520942080
00000100:00100000:3.0:1789760742.192993:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713776079264 time 713827283586 state 0x0 ref 1
00000100:00100000:3.0:1789760742.193014:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713827544002 time 713827283586 state 0x1 ref 1
00000100:00100000:3.0:1789760742.193050:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713827544002 time 713879732136 state 0x0 ref 1
00000100:00100000:3.0:1789760742.193064:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520942080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760742.193130:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21872640, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:3.0:1789760742.193141:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.193162:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:3.0:1789760742.193167:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760742.193175:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.193191:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760742.241132:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21872640 -> 21876736
00010000:00010000:0.0:1789760742.241161:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.241183:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.241192:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.241200:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760742.241206:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.241216:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.241241:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.241250:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c4e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21872640->21876735] (req 21872640->21876735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760742.241644:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520942080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48575us (49757us total) trans 4294972660 rc 0/0
00000100:00100000:0.0:1789760742.241657:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5373
00000100:00100000:0.0:1789760742.241669:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713827544002 time 713879732136 state 0x2 ref 0
00000100:00100000:3.0:1789760742.244566:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760742.244765:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520942208
00000100:00100000:0.0:1789760742.244779:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520942208
00000100:00100000:0.0:1789760742.244853:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713827544002 time 713879732136 state 0x0 ref 1
00000100:00100000:0.0:1789760742.244872:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713879992552 time 713879732136 state 0x1 ref 1
00000100:00100000:0.0:1789760742.244899:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713879992552 time 713931581770 state 0x0 ref 1
00000100:00100000:0.0:1789760742.244912:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520942208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760742.244973:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21876736, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760742.244984:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.245002:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:0.0:1789760742.245007:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760742.245014:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.245029:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760742.246654:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972660 is committed
00000001:00080000:1.0:1789760742.280337:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972661 is committed
00002000:00010000:0.0:1789760742.280570:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21876736 -> 21880832
00010000:00010000:0.0:1789760742.280603:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.280619:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.280635:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.280643:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760742.280649:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.280659:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.280682:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.280690:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c4ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21876736->21880831] (req 21876736->21880831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760742.280831:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520942208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35914us (36274us total) trans 4294972661 rc 0/0
00000100:00100000:0.0:1789760742.280844:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5374
00000100:00100000:0.0:1789760742.280856:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713879992552 time 713931581770 state 0x2 ref 0
00000100:00100000:3.0:1789760742.284708:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760742.284840:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520942336
00000100:00100000:1.0:1789760742.284853:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520942336
00000100:00100000:1.0:1789760742.284934:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713879992552 time 713931581770 state 0x0 ref 1
00000100:00100000:1.0:1789760742.284953:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713931842186 time 713931581770 state 0x1 ref 1
00000100:00100000:1.0:1789760742.285043:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713931842186 time 713971723249 state 0x0 ref 1
00000100:00100000:1.0:1789760742.285059:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520942336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760742.285125:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21880832, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:1.0:1789760742.285137:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.285157:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=713s v=(0 0)
00010000:00010000:1.0:1789760742.285162:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760742.285170:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.285187:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760742.316135:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21880832 -> 21884928
00010000:00010000:0.0:1789760742.316164:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.316187:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.316198:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.316206:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760742.316212:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.316223:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.316252:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.316260:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c4f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21880832->21884927] (req 21880832->21884927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760742.316339:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972662 is committed
00000100:00100000:0.0:1789760742.316587:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520942336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31523us (31882us total) trans 4294972662 rc 0/0
00000100:00100000:0.0:1789760742.316601:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5375
00000100:00100000:0.0:1789760742.316613:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713931842186 time 713971723249 state 0x2 ref 0
00000100:00100000:3.0:1789760742.319162:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760742.319215:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520942464
00000100:00100000:1.0:1789760742.319231:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520942464
00000100:00100000:1.0:1789760742.319306:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713931842186 time 713971723249 state 0x0 ref 1
00000100:00100000:1.0:1789760742.319492:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713971983665 time 713971723249 state 0x1 ref 1
00000100:00100000:1.0:1789760742.319556:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713971983665 time 714006238321 state 0x0 ref 1
00000100:00100000:1.0:1789760742.319572:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520942464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760742.319654:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21884928, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:1.0:1789760742.319666:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.319686:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:1.0:1789760742.319691:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760742.319699:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.319715:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760742.364450:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21884928 -> 21889024
00010000:00010000:1.0:1789760742.364480:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.364496:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.364508:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.364516:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760742.364521:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.364532:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.364559:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.364568:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c4fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21884928->21889023] (req 21884928->21889023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760742.365010:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520942464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45433us (45850us total) trans 4294972663 rc 0/0
00000100:00100000:1.0:1789760742.365022:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5376
00000100:00100000:1.0:1789760742.365034:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713971983665 time 714006238321 state 0x2 ref 0
00000001:00080000:2.0:1789760742.365186:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972663 is committed
00000100:00100000:3.0:1789760742.376428:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760742.376779:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520942592
00000100:00100000:0.0:1789760742.376794:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520942592
00000100:00100000:0.0:1789760742.376872:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 713971983665 time 714006238321 state 0x0 ref 1
00000100:00100000:0.0:1789760742.376893:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714006498737 time 714006238321 state 0x1 ref 1
00000100:00100000:0.0:1789760742.376934:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714006498737 time 714063616809 state 0x0 ref 1
00000100:00100000:0.0:1789760742.376949:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520942592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760742.377025:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21889024, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760742.377038:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.377057:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:0.0:1789760742.377062:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760742.377070:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.377087:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760742.426247:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972664 is committed
00002000:00010000:1.0:1789760742.426394:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21889024 -> 21893120
00010000:00010000:1.0:1789760742.426414:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.426429:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.426440:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.426449:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760742.426454:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.426472:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.426495:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.426503:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60c501 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21889024->21893119] (req 21889024->21893119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760742.426627:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520942592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49674us (50207us total) trans 4294972664 rc 0/0
00000100:00100000:1.0:1789760742.426640:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5377
00000100:00100000:1.0:1789760742.426652:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714006498737 time 714063616809 state 0x2 ref 0
00000100:00100000:0.0:1789760742.433060:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760742.433421:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520942720
00000100:00100000:3.0:1789760742.433434:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520942720
00000100:00100000:3.0:1789760742.433508:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714006498737 time 714063616809 state 0x0 ref 1
00000100:00100000:3.0:1789760742.433527:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714063877225 time 714063616809 state 0x1 ref 1
00000100:00100000:3.0:1789760742.433560:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714063877225 time 714120241653 state 0x0 ref 1
00000100:00100000:3.0:1789760742.433574:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520942720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760742.433658:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21893120, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:3.0:1789760742.433671:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.433693:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:3.0:1789760742.433700:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760742.433708:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.433727:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760742.475493:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21893120 -> 21897216
00010000:00010000:1.0:1789760742.475512:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.475525:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.475534:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.475542:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760742.475548:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.475557:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.475576:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.475583:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c508 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21893120->21897215] (req 21893120->21897215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760742.475685:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972665 is committed
00000100:00100000:1.0:1789760742.475778:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520942720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42201us (42728us total) trans 4294972665 rc 0/0
00000100:00100000:1.0:1789760742.475789:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5378
00000100:00100000:1.0:1789760742.475799:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714063877225 time 714120241653 state 0x2 ref 0
00000100:00100000:3.0:1789760742.478692:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760742.478778:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520942848
00000100:00100000:1.0:1789760742.478794:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520942848
00000100:00100000:1.0:1789760742.478855:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714063877225 time 714120241653 state 0x0 ref 1
00000100:00100000:1.0:1789760742.478869:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714120502069 time 714120241653 state 0x1 ref 1
00000100:00100000:1.0:1789760742.478978:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714120502069 time 714165659539 state 0x0 ref 1
00000100:00100000:1.0:1789760742.478992:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520942848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760742.479045:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21897216, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:1.0:1789760742.479055:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.479070:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:1.0:1789760742.479075:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760742.479081:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.479096:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760742.517070:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972666 is committed
00002000:00010000:1.0:1789760742.517176:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21897216 -> 21901312
00010000:00010000:1.0:1789760742.517189:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.517201:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.517209:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.517216:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760742.517221:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.517230:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.517252:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.517264:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c50f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21897216->21901311] (req 21897216->21901311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760742.517402:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520942848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38407us (38720us total) trans 4294972666 rc 0/0
00000100:00100000:1.0:1789760742.517411:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5379
00000100:00100000:1.0:1789760742.517420:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714120502069 time 714165659539 state 0x2 ref 0
00000100:00100000:2.0:1789760742.521664:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1789760742.521689:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548753152:0@lo:13:osp-pre-1-0.0
00000100:00100000:2.0:1789760742.521772:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760742.521817:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548753152
00000100:00100000:0.0:1789760742.521825:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548753152
00000100:00100000:2.0:1789760742.521847:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8d9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548753024:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1789760742.521873:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:1.0:1789760742.521918:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1789760742.521951:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548753024
00000100:00100000:0.0:1789760742.521955:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548753024
00000100:00100000:0.0:1789760742.522020:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360
00000100:00100000:0.0:1789760742.522032:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548753152:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:0.0:1789760742.522068:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760742.522120:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548753152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (355us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760742.522127:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360
00000100:00100000:3.0:1789760742.522152:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361
00000100:00100000:3.0:1789760742.522163:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548753024:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1789760742.522175:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:3.0:1789760742.522205:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548753024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (331us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760742.522215:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361
00000100:00080000:1.0:1789760742.522234:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1789760742.522236:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548753280:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.522278:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760742.522305:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548753792:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.522354:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760742.522379:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548754304:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.522403:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760742.522423:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:3.0:1789760742.522428:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548753408:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.522450:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760742.522467:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548753920:0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.522485:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548753792
00000100:00100000:3.0:1789760742.522490:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760742.522492:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548753792
00000100:00100000:3.0:1789760742.522511:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548754432:0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.522531:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427
00000100:00100000:3.0:1789760742.522536:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760742.522544:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548753792:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.522599:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548753792:12345-0@lo:400:kworker.0 Request processed in 58us (243us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760742.522606:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427
00000100:00100000:0.0:1789760742.522662:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548753280
00000100:00100000:0.0:1789760742.522667:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548753280
00000100:00100000:0.0:1789760742.522705:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471
00000100:00100000:0.0:1789760742.522713:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548753280:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760742.522760:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548753280:12345-0@lo:400:kworker.0 Request processed in 49us (481us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760742.522767:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471
00000100:00100000:2.0:1789760742.522879:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876699548753664:0@lo:400:kworker.0
00000100:00100000:2.0:1789760742.522907:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760742.522944:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548754176:0@lo:400:kworker.0
00000100:00100000:2.0:1789760742.522965:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760742.523009:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548754304
00000100:00100000:1.0:1789760742.523014:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548754304
00000100:00100000:2.0:1789760742.523016:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548753152:0@lo:13:osp-pre-1-0.0
00000100:00100000:2.0:1789760742.523038:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8d9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548753024:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760742.523047:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548754176
00000100:00100000:1.0:1789760742.523052:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548754176
00000100:00100000:2.0:1789760742.523064:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1]
00000100:00100000:2.0:1789760742.523072:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548753536:0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.523083:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284
00000100:00100000:1.0:1789760742.523092:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548754304:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760742.523102:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760742.523152:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548754304:12345-0@lo:400:kworker.0 Request processed in 60us (746us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760742.523159:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284
00000100:00100000:0.0:1789760742.523163:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548753408
00000100:00100000:0.0:1789760742.523169:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548753408
00000100:00100000:1.0:1789760742.523173:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285
00000100:00100000:0.0:1789760742.523198:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548753920
00000100:00100000:0.0:1789760742.523202:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548753920
00000100:00100000:0.0:1789760742.523221:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548754432
00000100:00100000:0.0:1789760742.523224:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548754432
00000100:00100000:0.0:1789760742.523235:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548753664
00000100:00100000:0.0:1789760742.523237:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548753664
00000100:00100000:0.0:1789760742.523249:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877
00000100:00100000:0.0:1789760742.523256:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548753408:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760742.523289:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548753408:12345-0@lo:400:kworker.0 Request processed in 34us (838us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760742.523296:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877
00000100:00100000:0.0:1789760742.523307:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878
00000100:00100000:0.0:1789760742.523329:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548753920:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760742.523352:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548753920:12345-0@lo:400:kworker.0 Request processed in 40us (863us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760742.523357:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878
00000100:00100000:0.0:1789760742.523367:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879
00000100:00100000:0.0:1789760742.523373:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548754432:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760742.523396:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548754432:12345-0@lo:400:kworker.0 Request processed in 24us (863us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760742.523402:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879
00000100:00100000:0.0:1789760742.523413:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880
00000100:00100000:0.0:1789760742.523418:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876699548753664:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760742.523449:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876699548753664:12345-0@lo:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760742.523456:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880
00000100:00100000:1.0:1789760742.523456:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548754176:12345-0@lo:400:kworker.0
00000100:00080000:0.0:1789760742.523479:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789760742.523499:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548754176:12345-0@lo:400:kworker.0 Request processed in 319us (532us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760742.523505:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285
00000100:00100000:2.0:1789760742.523543:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3454:1876699548754048:0@lo:400:kworker.0
00000100:00100000:2.0:1789760742.523569:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760742.523588:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3454:1876699548754560:0@lo:400:kworker.0
00000100:00100000:2.0:1789760742.523607:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760742.523640:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876699548753664:0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.523642:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548754048
00000100:00100000:1.0:1789760742.523647:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548754048
00000100:00100000:2.0:1789760742.523653:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548754176:0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.523677:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548754560
00000100:00100000:1.0:1789760742.523681:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548754560
00000100:00100000:2.0:1789760742.523682:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548753536
00000100:00100000:2.0:1789760742.523687:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548753536
00000100:00100000:2.0:1789760742.523717:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428
00000100:00100000:2.0:1789760742.523723:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548753536:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.523795:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881
00000100:00100000:1.0:1789760742.523803:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3454:x1876699548754048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760742.523847:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548753536:12345-0@lo:400:kworker.0 Request processed in 123us (747us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760742.523854:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428
00000100:00100000:2.0:1789760742.523885:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548753536:0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.524033:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3454:x1876699548754048:12345-0@lo:400:kworker.0 Request processed in 231us (462us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760742.524040:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881
00000100:00100000:1.0:1789760742.524055:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882
00000100:00100000:1.0:1789760742.524062:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876699548754560:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760742.524137:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876699548754560:12345-0@lo:400:kworker.0 Request processed in 75us (527us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760742.524143:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882
00000100:00100000:3.0:1789760742.524503:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7429f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548753408:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.524518:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548753920:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.524534:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548754432:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.524545:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7428380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548753280:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.524555:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548753792:0@lo:400:kworker.0
00000100:00100000:3.0:1789760742.524564:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548754304:0@lo:400:kworker.0
00000100:00080000:0.0:1789760742.524641:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1789760742.524714:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3454:1876699548754048:0@lo:400:kworker.0
00000100:00100000:2.0:1789760742.524725:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3454:1876699548754560:0@lo:400:kworker.0
00000100:00100000:2.0:1789760742.525769:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760742.525892:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520942976
00000100:00100000:3.0:1789760742.525900:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520942976
00000100:00100000:3.0:1789760742.525939:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714120502069 time 714165659539 state 0x0 ref 1
00000100:00100000:3.0:1789760742.525953:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714165919955 time 714165659539 state 0x1 ref 1
00000100:00100000:3.0:1789760742.525981:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714165919955 time 714212663739 state 0x0 ref 1
00000100:00100000:3.0:1789760742.525992:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520942976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760742.526034:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21901312, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:3.0:1789760742.526044:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.526060:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:3.0:1789760742.526064:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760742.526070:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.526083:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760742.549657:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972667 is committed
00002000:00010000:2.0:1789760742.549786:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21901312 -> 21905408
00010000:00010000:2.0:1789760742.549801:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.549814:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.549824:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.549832:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760742.549836:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.549845:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.549863:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.549871:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c516 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21901312->21905407] (req 21901312->21905407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760742.549961:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520942976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23967us (24202us total) trans 4294972667 rc 0/0
00000100:00100000:2.0:1789760742.549971:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5380
00000100:00100000:2.0:1789760742.549980:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714165919955 time 714212663739 state 0x2 ref 0
00000100:00100000:2.0:1789760742.554286:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760742.554376:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520943104
00000100:00100000:0.0:1789760742.554385:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520943104
00000100:00100000:0.0:1789760742.554436:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714165919955 time 714212663739 state 0x0 ref 1
00000100:00100000:0.0:1789760742.554452:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714212924155 time 714212663739 state 0x1 ref 1
00000100:00100000:0.0:1789760742.554535:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714212924155 time 714241217197 state 0x0 ref 1
00000100:00100000:0.0:1789760742.554549:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520943104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760742.554596:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21905408, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760742.554605:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.554621:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:0.0:1789760742.554625:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760742.554629:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.554638:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760742.579137:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972668 is committed
00002000:00010000:3.0:1789760742.579244:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21905408 -> 21909504
00010000:00010000:3.0:1789760742.579270:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.579285:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.579307:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.579482:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760742.579487:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.579497:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.579519:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.579527:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c51d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21905408->21909503] (req 21905408->21909503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760742.579726:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520943104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25174us (25443us total) trans 4294972668 rc 0/0
00000100:00100000:3.0:1789760742.579747:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5381
00000100:00100000:3.0:1789760742.579756:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714212924155 time 714241217197 state 0x2 ref 0
00000100:00100000:1.0:1789760742.584809:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760742.584901:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520943232
00000100:00100000:3.0:1789760742.584911:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520943232
00000100:00100000:3.0:1789760742.584966:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714212924155 time 714241217197 state 0x0 ref 1
00000100:00100000:3.0:1789760742.584982:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714241477613 time 714241217197 state 0x1 ref 1
00000100:00100000:3.0:1789760742.585006:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714241477613 time 714271688922 state 0x0 ref 1
00000100:00100000:3.0:1789760742.585017:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520943232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760742.585065:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21909504, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:3.0:1789760742.585074:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.585089:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:3.0:1789760742.585093:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760742.585099:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.585111:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760742.618876:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21909504 -> 21913600
00010000:00010000:1.0:1789760742.618896:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.618911:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.618921:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.618929:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760742.618933:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.618943:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.618961:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.618969:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c524 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21909504->21913599] (req 21909504->21913599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760742.619060:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520943232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34040us (35878us total) trans 4294972669 rc 0/0
00000100:00100000:1.0:1789760742.619070:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5382
00000100:00100000:1.0:1789760742.619079:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714241477613 time 714271688922 state 0x2 ref 0
00000001:00080000:2.0:1789760742.619154:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972669 is committed
00000100:00100000:1.0:1789760742.623696:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760742.624148:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520943360
00000100:00100000:2.0:1789760742.624159:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520943360
00000100:00100000:0.0:1789760742.624288:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714241477613 time 714271688922 state 0x0 ref 1
00000100:00100000:0.0:1789760742.624304:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714271949338 time 714271688922 state 0x1 ref 1
00000100:00100000:3.0:1789760742.624376:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714271949338 time 714311055586 state 0x0 ref 1
00000100:00100000:3.0:1789760742.624391:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520943360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760742.624438:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21913600, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:3.0:1789760742.624447:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.624463:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:3.0:1789760742.624468:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760742.624475:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.624541:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760742.652990:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21913600 -> 21917696
00010000:00010000:3.0:1789760742.653010:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.653024:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.653032:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.653039:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760742.653044:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.653052:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.653071:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.653078:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c52b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21913600->21917695] (req 21913600->21917695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760742.653179:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520943360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28787us (29487us total) trans 4294972670 rc 0/0
00000100:00100000:3.0:1789760742.653190:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5383
00000100:00100000:3.0:1789760742.653200:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714271949338 time 714311055586 state 0x2 ref 0
00000001:00080000:2.0:1789760742.653927:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972670 is committed
00000100:00100000:3.0:1789760742.657872:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760742.657958:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520943488
00000100:00100000:0.0:1789760742.657976:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520943488
00000100:00100000:0.0:1789760742.658032:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714271949338 time 714311055586 state 0x0 ref 1
00000100:00100000:0.0:1789760742.658045:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714311316002 time 714311055586 state 0x1 ref 1
00000100:00100000:0.0:1789760742.658074:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714311316002 time 714344757230 state 0x0 ref 1
00000100:00100000:0.0:1789760742.658090:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520943488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760742.658137:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21917696, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760742.658146:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.658163:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:0.0:1789760742.658167:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760742.658173:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.658187:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760742.698133:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972671 is committed
00002000:00010000:1.0:1789760742.698390:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21917696 -> 21921792
00010000:00010000:1.0:1789760742.698407:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.698419:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.698428:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.698435:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760742.698440:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.698450:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.698471:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.698480:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c532 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21917696->21921791] (req 21917696->21921791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760742.698619:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520943488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40529us (40751us total) trans 4294972671 rc 0/0
00000100:00100000:1.0:1789760742.698635:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5384
00000100:00100000:1.0:1789760742.698645:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714311316002 time 714344757230 state 0x2 ref 0
00000100:00100000:1.0:1789760742.701779:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760742.702286:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520943616
00000100:00100000:0.0:1789760742.702297:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520943616
00000100:00100000:0.0:1789760742.702396:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714311316002 time 714344757230 state 0x0 ref 1
00000100:00100000:0.0:1789760742.702412:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714345017646 time 714344757230 state 0x1 ref 1
00000100:00100000:0.0:1789760742.702487:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714345017646 time 714389168933 state 0x0 ref 1
00000100:00100000:0.0:1789760742.702499:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520943616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760742.702552:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21921792, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760742.702562:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.702577:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:0.0:1789760742.702582:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760742.702588:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.702601:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760742.737984:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972672 is committed
00002000:00010000:0.0:1789760742.738113:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21921792 -> 21925888
00010000:00010000:0.0:1789760742.738129:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.738141:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.738149:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.738156:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760742.738160:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.738168:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.738187:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.738195:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c539 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21921792->21925887] (req 21921792->21925887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760742.738455:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520943616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35952us (36680us total) trans 4294972672 rc 0/0
00000100:00100000:0.0:1789760742.738469:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5385
00000100:00100000:0.0:1789760742.738479:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714345017646 time 714389168933 state 0x2 ref 0
00000100:00100000:0.0:1789760742.742386:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760742.742493:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520943744
00000100:00100000:1.0:1789760742.742504:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520943744
00000100:00100000:1.0:1789760742.742554:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714345017646 time 714389168933 state 0x0 ref 1
00000100:00100000:1.0:1789760742.742569:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714389429349 time 714389168933 state 0x1 ref 1
00000100:00100000:1.0:1789760742.742596:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714389429349 time 714429279412 state 0x0 ref 1
00000100:00100000:1.0:1789760742.742607:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520943744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760742.742651:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21925888, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:1.0:1789760742.742660:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.742688:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:1.0:1789760742.742692:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760742.742698:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.742713:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760742.768939:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972673 is committed
00002000:00010000:1.0:1789760742.769110:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21925888 -> 21929984
00010000:00010000:1.0:1789760742.769127:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.769140:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.769148:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.769156:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760742.769160:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.769168:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.769188:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.769194:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c540 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21925888->21929983] (req 21925888->21929983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760742.769407:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520943744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26795us (27026us total) trans 4294972673 rc 0/0
00000100:00100000:1.0:1789760742.769418:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5386
00000100:00100000:1.0:1789760742.769428:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714389429349 time 714429279412 state 0x2 ref 0
00000100:00100000:3.0:1789760742.772459:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760742.772559:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520943872
00000100:00100000:0.0:1789760742.772574:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520943872
00000100:00100000:0.0:1789760742.772636:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714389429349 time 714429279412 state 0x0 ref 1
00000100:00100000:0.0:1789760742.772652:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714429539828 time 714429279412 state 0x1 ref 1
00000100:00100000:0.0:1789760742.772695:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714429539828 time 714459377788 state 0x0 ref 1
00000100:00100000:0.0:1789760742.772708:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520943872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760742.772768:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21929984, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760742.772777:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.772792:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:0.0:1789760742.772796:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760742.772803:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.772816:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760742.802601:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972674 is committed
00002000:00010000:3.0:1789760742.802855:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21929984 -> 21934080
00010000:00010000:3.0:1789760742.802871:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.802886:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.802895:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.802904:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760742.802909:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.802917:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.802942:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.802948:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c547 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21929984->21934079] (req 21929984->21934079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760742.803037:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520943872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30325us (30585us total) trans 4294972674 rc 0/0
00000100:00100000:3.0:1789760742.803048:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5387
00000100:00100000:3.0:1789760742.803067:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714429539828 time 714459377788 state 0x2 ref 0
00000100:00100000:2.0:1789760742.807874:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760742.807982:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520944000
00000100:00100000:0.0:1789760742.807993:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520944000
00000100:00100000:0.0:1789760742.808051:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714429539828 time 714459377788 state 0x0 ref 1
00000100:00100000:0.0:1789760742.808066:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714459638204 time 714459377788 state 0x1 ref 1
00000100:00100000:0.0:1789760742.808099:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714459638204 time 714494781324 state 0x0 ref 1
00000100:00100000:0.0:1789760742.808112:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760742.808164:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21934080, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:0.0:1789760742.808174:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.808190:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:0.0:1789760742.808195:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760742.808201:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760742.808217:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760742.850992:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972675 is committed
00002000:00010000:2.0:1789760742.852515:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21934080 -> 21938176
00010000:00010000:2.0:1789760742.852539:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.852555:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.852565:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.852574:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760742.852580:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.852596:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.852619:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.852626:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c54e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21934080->21938175] (req 21934080->21938175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760742.852814:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44696us (44943us total) trans 4294972675 rc 0/0
00000100:00100000:2.0:1789760742.852826:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5388
00000100:00100000:2.0:1789760742.852838:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714459638204 time 714494781324 state 0x2 ref 0
00000100:00100000:0.0:1789760742.855895:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760742.856630:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520944128
00000100:00100000:2.0:1789760742.856644:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520944128
00000100:00100000:2.0:1789760742.856795:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714459638204 time 714494781324 state 0x0 ref 1
00000100:00100000:2.0:1789760742.856818:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714495041740 time 714494781324 state 0x1 ref 1
00000100:00100000:2.0:1789760742.856853:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714495041740 time 714543534968 state 0x0 ref 1
00000100:00100000:2.0:1789760742.856868:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760742.856933:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21938176, mtime: 0x6aad94e7, atime: 0x0, ctime: 0x6aad94e7, blocks: 0xa807
00010000:00010000:2.0:1789760742.856944:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.856964:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:2.0:1789760742.856969:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760742.856977:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.856992:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760742.891984:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21938176 -> 21942272
00002000:00010000:2.0:1789760742.891999:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760743 -> 1789760744
00002000:00010000:2.0:1789760742.892003:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760743 -> 1789760744
00010000:00010000:2.0:1789760742.892021:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.892042:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.892053:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.892061:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760742.892067:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.892077:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.892101:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.892108:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c555 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21938176->21942271] (req 21938176->21942271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760742.892229:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520944128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35356us (36336us total) trans 4294972676 rc 0/0
00000100:00100000:2.0:1789760742.892243:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5389
00000100:00100000:2.0:1789760742.892254:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714495041740 time 714543534968 state 0x2 ref 0
00000001:00080000:0.0:1789760742.892505:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972676 is committed
00000100:00100000:3.0:1789760742.895449:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760742.895840:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520944256
00000100:00100000:1.0:1789760742.895854:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520944256
00000100:00100000:1.0:1789760742.895928:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714495041740 time 714543534968 state 0x0 ref 1
00000100:00100000:1.0:1789760742.895946:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714543795384 time 714543534968 state 0x1 ref 1
00000100:00100000:1.0:1789760742.895983:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714543795384 time 714582665601 state 0x0 ref 1
00000100:00100000:1.0:1789760742.895999:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760742.896064:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21942272, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:1.0:1789760742.896076:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.896096:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:1.0:1789760742.896102:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760742.896109:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.896126:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760742.932202:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21942272 -> 21946368
00010000:00010000:3.0:1789760742.932230:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.932248:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.932342:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.932353:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00000001:00080000:1.0:1789760742.932360:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972677 is committed
00010000:00010000:3.0:1789760742.932426:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.932442:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.932467:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.932476:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c55c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21942272->21946367] (req 21942272->21946367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760742.932641:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36638us (37202us total) trans 4294972677 rc 0/0
00000100:00100000:3.0:1789760742.932655:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5390
00000100:00100000:3.0:1789760742.932667:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714543795384 time 714582665601 state 0x2 ref 0
00000100:00100000:1.0:1789760742.937453:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760742.937523:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520944384
00000100:00100000:3.0:1789760742.937541:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520944384
00000100:00100000:3.0:1789760742.937628:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714543795384 time 714582665601 state 0x0 ref 1
00000100:00100000:3.0:1789760742.937646:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714582926017 time 714582665601 state 0x1 ref 1
00000100:00100000:3.0:1789760742.937683:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714582926017 time 714624365904 state 0x0 ref 1
00000100:00100000:3.0:1789760742.937698:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760742.937777:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21946368, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:3.0:1789760742.937789:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.937811:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:3.0:1789760742.937816:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760742.937824:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.937840:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760742.972853:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760742.988226:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972678 is committed
00002000:00010000:3.0:1789760742.988430:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21946368 -> 21950464
00010000:00010000:3.0:1789760742.988451:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.988467:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.988479:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.988487:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760742.988493:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.988503:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.988529:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760742.988541:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c563 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21946368->21950463] (req 21946368->21950463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760742.988698:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50995us (51254us total) trans 4294972678 rc 0/0
00000100:00100000:3.0:1789760742.988710:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5391
00000100:00100000:3.0:1789760742.988722:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714582926017 time 714624365904 state 0x2 ref 0
00000100:00100000:0.0:1789760742.991913:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760742.992040:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520944512
00000100:00100000:2.0:1789760742.992055:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520944512
00000100:00100000:2.0:1789760742.992129:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714582926017 time 714624365904 state 0x0 ref 1
00000100:00100000:2.0:1789760742.992148:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714624626320 time 714624365904 state 0x1 ref 1
00000100:00100000:2.0:1789760742.992229:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714624626320 time 714678911854 state 0x0 ref 1
00000100:00100000:2.0:1789760742.992241:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760742.992305:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21950464, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:2.0:1789760742.992336:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.992376:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:2.0:1789760742.992382:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760742.992390:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760742.992407:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760743.024563:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972679 is committed
00002000:00010000:2.0:1789760743.024661:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21950464 -> 21954560
00010000:00010000:2.0:1789760743.024682:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.024697:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.024707:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.024716:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760743.024722:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.024743:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.024776:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.024786:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c56a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21950464->21954559] (req 21950464->21954559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760743.024905:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32659us (33009us total) trans 4294972679 rc 0/0
00000100:00100000:2.0:1789760743.024916:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5392
00000100:00100000:2.0:1789760743.024928:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714624626320 time 714678911854 state 0x2 ref 0
00000100:00100000:2.0:1789760743.028156:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760743.028562:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520944640
00000100:00100000:0.0:1789760743.028576:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520944640
00000100:00100000:0.0:1789760743.028650:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714624626320 time 714678911854 state 0x0 ref 1
00000100:00100000:0.0:1789760743.028669:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714679172270 time 714678911854 state 0x1 ref 1
00000100:00100000:0.0:1789760743.028706:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714679172270 time 714715387986 state 0x0 ref 1
00000100:00100000:0.0:1789760743.028721:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520944640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760743.028799:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21954560, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:0.0:1789760743.028810:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.028828:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:0.0:1789760743.028833:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760743.028842:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.028859:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760743.062237:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21954560 -> 21958656
00010000:00010000:1.0:1789760743.062276:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.062294:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.062304:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.062336:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760743.062343:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.062354:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.062447:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.062457:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c571 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21954560->21958655] (req 21954560->21958655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760743.062584:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520944640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33859us (34437us total) trans 4294972680 rc 0/0
00000100:00100000:1.0:1789760743.062597:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5393
00000100:00100000:1.0:1789760743.062610:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714679172270 time 714715387986 state 0x2 ref 0
00000001:00080000:3.0:1789760743.062714:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972680 is committed
00000100:00100000:2.0:1789760743.065672:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760743.065769:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520944768
00000100:00100000:3.0:1789760743.065792:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520944768
00000100:00100000:3.0:1789760743.065866:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714679172270 time 714715387986 state 0x0 ref 1
00000100:00100000:3.0:1789760743.065886:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714715648402 time 714715387986 state 0x1 ref 1
00000100:00100000:3.0:1789760743.065921:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714715648402 time 714752603107 state 0x0 ref 1
00000100:00100000:3.0:1789760743.065936:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520944768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760743.065998:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21958656, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:3.0:1789760743.066010:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.066029:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:3.0:1789760743.066034:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760743.066041:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.066060:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760743.100933:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972681 is committed
00002000:00010000:2.0:1789760743.101065:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21958656 -> 21962752
00010000:00010000:2.0:1789760743.101086:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.101102:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.101113:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.101122:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760743.101128:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.101139:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.101164:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.101173:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c578 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21958656->21962751] (req 21958656->21962751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760743.101547:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520944768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35606us (35882us total) trans 4294972681 rc 0/0
00000100:00100000:2.0:1789760743.101560:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5394
00000100:00100000:2.0:1789760743.101571:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714715648402 time 714752603107 state 0x2 ref 0
00000100:00100000:2.0:1789760743.105854:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760743.105960:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520944896
00000100:00100000:3.0:1789760743.105973:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520944896
00000100:00100000:3.0:1789760743.106043:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714715648402 time 714752603107 state 0x0 ref 1
00000100:00100000:3.0:1789760743.106062:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714752863523 time 714752603107 state 0x1 ref 1
00000100:00100000:3.0:1789760743.106141:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714752863523 time 714792822699 state 0x0 ref 1
00000100:00100000:3.0:1789760743.106157:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760743.106219:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21962752, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:3.0:1789760743.106230:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.106248:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:3.0:1789760743.106253:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760743.106270:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.106287:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760743.138662:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972682 is committed
00002000:00010000:2.0:1789760743.138961:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21962752 -> 21966848
00010000:00010000:2.0:1789760743.138983:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.138997:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.139007:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.139019:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760743.139025:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.139034:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.139058:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.139065:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c57f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21962752->21966847] (req 21962752->21966847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760743.139244:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520944896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33083us (33398us total) trans 4294972682 rc 0/0
00000100:00100000:2.0:1789760743.139270:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5395
00000100:00100000:2.0:1789760743.139284:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714752863523 time 714792822699 state 0x2 ref 0
00000100:00100000:2.0:1789760743.142457:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760743.142547:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520945024
00000100:00100000:0.0:1789760743.142560:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520945024
00000100:00100000:0.0:1789760743.142628:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714752863523 time 714792822699 state 0x0 ref 1
00000100:00100000:0.0:1789760743.142646:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714793083115 time 714792822699 state 0x1 ref 1
00000100:00100000:0.0:1789760743.142700:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714793083115 time 714829382093 state 0x0 ref 1
00000100:00100000:0.0:1789760743.142714:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc174e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520945024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760743.142782:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21966848, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:0.0:1789760743.142792:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.142811:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:0.0:1789760743.142817:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760743.142824:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.142841:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760743.174698:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21966848 -> 21970944
00010000:00010000:1.0:1789760743.174737:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.174753:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.174763:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.174772:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760743.174777:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.174788:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.174811:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.174820:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60c586 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21966848->21970943] (req 21966848->21970943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760743.174984:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc174e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520945024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32264us (32615us total) trans 4294972683 rc 0/0
00000100:00100000:1.0:1789760743.174998:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5396
00000100:00100000:1.0:1789760743.175012:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714793083115 time 714829382093 state 0x2 ref 0
00000001:00080000:3.0:1789760743.175112:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972683 is committed
00000100:00100000:0.0:1789760743.179045:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760743.179538:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520945152
00000100:00100000:1.0:1789760743.179554:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520945152
00000100:00100000:1.0:1789760743.179635:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714793083115 time 714829382093 state 0x0 ref 1
00000100:00100000:1.0:1789760743.179656:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714829642509 time 714829382093 state 0x1 ref 1
00000100:00100000:1.0:1789760743.179754:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714829642509 time 714866435102 state 0x0 ref 1
00000100:00100000:1.0:1789760743.179770:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520945152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760743.179842:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21970944, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:1.0:1789760743.179854:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.179876:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:1.0:1789760743.179881:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760743.179889:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.179907:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760743.245108:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972684 is committed
00002000:00010000:2.0:1789760743.245193:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21970944 -> 21975040
00010000:00010000:2.0:1789760743.245209:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.245220:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.245233:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.245240:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760743.245245:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.245253:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.245273:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.245279:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c58d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21970944->21975039] (req 21970944->21975039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760743.245448:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520945152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65676us (66411us total) trans 4294972684 rc 0/0
00000100:00100000:2.0:1789760743.245459:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5397
00000100:00100000:2.0:1789760743.245468:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714829642509 time 714866435102 state 0x2 ref 0
00000100:00100000:2.0:1789760743.248586:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760743.248703:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520945280
00000100:00100000:1.0:1789760743.248716:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520945280
00000100:00100000:1.0:1789760743.248789:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714829642509 time 714866435102 state 0x0 ref 1
00000100:00100000:1.0:1789760743.248802:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714866695518 time 714866435102 state 0x1 ref 1
00000100:00100000:1.0:1789760743.248832:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714866695518 time 714935513983 state 0x0 ref 1
00000100:00100000:1.0:1789760743.248846:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520945280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760743.248912:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21975040, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:1.0:1789760743.248924:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.248940:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:1.0:1789760743.248945:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760743.248950:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.248966:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760743.291214:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21975040 -> 21979136
00010000:00010000:3.0:1789760743.291241:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.291266:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.291277:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.291285:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760743.291292:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.291302:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.291358:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.291368:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c594 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21975040->21979135] (req 21975040->21979135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760743.291665:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520945280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42809us (43077us total) trans 4294972685 rc 0/0
00000100:00100000:3.0:1789760743.291686:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5398
00000100:00100000:3.0:1789760743.291697:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714866695518 time 714935513983 state 0x2 ref 0
00000001:00080000:3.0:1789760743.291835:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972685 is committed
00000100:00100000:0.0:1789760743.298079:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760743.298183:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520945408
00000100:00100000:2.0:1789760743.298197:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520945408
00000100:00100000:2.0:1789760743.298442:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714866695518 time 714935513983 state 0x0 ref 1
00000100:00100000:2.0:1789760743.298463:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714935774399 time 714935513983 state 0x1 ref 1
00000100:00100000:2.0:1789760743.298548:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714935774399 time 714985229292 state 0x0 ref 1
00000100:00100000:2.0:1789760743.298562:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520945408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760743.298625:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21979136, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:2.0:1789760743.298637:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.298657:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=714s v=(0 0)
00010000:00010000:2.0:1789760743.298662:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760743.298670:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.298685:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760743.341995:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972686 is committed
00002000:00010000:3.0:1789760743.342115:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21979136 -> 21983232
00010000:00010000:3.0:1789760743.342137:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.342153:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.342164:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.342172:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760743.342178:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.342189:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.342215:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.342224:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c59b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21979136->21983231] (req 21979136->21983231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760743.342393:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520945408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43827us (44322us total) trans 4294972686 rc 0/0
00000100:00100000:3.0:1789760743.342411:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5399
00000100:00100000:3.0:1789760743.342423:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714935774399 time 714985229292 state 0x2 ref 0
00000100:00100000:0.0:1789760743.347270:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760743.347409:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520945536
00000100:00100000:1.0:1789760743.347424:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520945536
00000100:00100000:1.0:1789760743.347669:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714935774399 time 714985229292 state 0x0 ref 1
00000100:00100000:1.0:1789760743.347687:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714985489708 time 714985229292 state 0x1 ref 1
00000100:00100000:1.0:1789760743.347929:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714985489708 time 715034610602 state 0x0 ref 1
00000100:00100000:1.0:1789760743.347942:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520945536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760743.347998:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21983232, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:1.0:1789760743.348006:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.348023:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:1.0:1789760743.348027:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760743.348033:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.348045:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760743.395533:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972687 is committed
00002000:00010000:2.0:1789760743.395827:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21983232 -> 21987328
00010000:00010000:2.0:1789760743.395854:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.395869:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.395880:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.395894:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760743.395900:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.395909:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.395931:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.395939:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c5a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21983232->21987327] (req 21983232->21987327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760743.396049:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520945536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48104us (48788us total) trans 4294972687 rc 0/0
00000100:00100000:2.0:1789760743.396061:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5400
00000100:00100000:2.0:1789760743.396072:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714985489708 time 715034610602 state 0x2 ref 0
00000100:00100000:0.0:1789760743.402361:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760743.402471:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520945664
00000100:00100000:1.0:1789760743.402485:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520945664
00000100:00100000:1.0:1789760743.402567:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 714985489708 time 715034610602 state 0x0 ref 1
00000100:00100000:1.0:1789760743.402586:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715034871018 time 715034610602 state 0x1 ref 1
00000100:00100000:1.0:1789760743.402685:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715034871018 time 715089366215 state 0x0 ref 1
00000100:00100000:1.0:1789760743.402701:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520945664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760743.402776:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21987328, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:1.0:1789760743.402787:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.402806:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:1.0:1789760743.402811:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760743.402819:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.402835:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760743.441819:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972688 is committed
00002000:00010000:1.0:1789760743.442038:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21987328 -> 21991424
00010000:00010000:1.0:1789760743.442057:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.442071:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.442082:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.442089:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760743.442095:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.442106:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.442128:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.442136:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21987328->21991423] (req 21987328->21991423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760743.442584:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520945664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39878us (40230us total) trans 4294972688 rc 0/0
00000100:00100000:1.0:1789760743.442598:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5401
00000100:00100000:1.0:1789760743.442610:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715034871018 time 715089366215 state 0x2 ref 0
00000100:00100000:0.0:1789760743.450469:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760743.450582:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520945792
00000100:00100000:3.0:1789760743.450595:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520945792
00000100:00100000:3.0:1789760743.450680:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715034871018 time 715089366215 state 0x0 ref 1
00000100:00100000:3.0:1789760743.450699:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715089626631 time 715089366215 state 0x1 ref 1
00000100:00100000:2.0:1789760743.451112:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715089626631 time 715137790445 state 0x0 ref 1
00000100:00100000:2.0:1789760743.451131:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520945792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760743.451198:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21991424, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:2.0:1789760743.451210:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.451236:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:2.0:1789760743.451242:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760743.451250:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.451266:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760743.497714:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972689 is committed
00002000:00010000:1.0:1789760743.497916:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21991424 -> 21995520
00010000:00010000:1.0:1789760743.497934:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.497946:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.497953:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.497958:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760743.497962:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.497970:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.497990:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.497999:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c5b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21991424->21995519] (req 21991424->21995519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760743.498110:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520945792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46978us (47650us total) trans 4294972689 rc 0/0
00000100:00100000:1.0:1789760743.498123:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5402
00000100:00100000:1.0:1789760743.498134:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715089626631 time 715137790445 state 0x2 ref 0
00000100:00100000:0.0:1789760743.500233:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760743.500542:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520945920
00000100:00100000:3.0:1789760743.500557:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520945920
00000100:00100000:2.0:1789760743.500923:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715089626631 time 715137790445 state 0x0 ref 1
00000100:00100000:2.0:1789760743.500941:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715138050861 time 715137790445 state 0x1 ref 1
00000100:00100000:2.0:1789760743.500976:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715138050861 time 715187658813 state 0x0 ref 1
00000100:00100000:2.0:1789760743.500991:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520945920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760743.501057:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21995520, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:2.0:1789760743.501068:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.501087:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:2.0:1789760743.501092:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760743.501099:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.501115:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760743.550224:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972690 is committed
00002000:00010000:2.0:1789760743.550618:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21995520 -> 21999616
00010000:00010000:2.0:1789760743.550638:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.550720:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.550980:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.551004:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760743.551010:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.551032:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.551067:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.551085:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60c5b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21995520->21999615] (req 21995520->21999615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760743.551539:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520945920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50541us (51312us total) trans 4294972690 rc 0/0
00000100:00100000:2.0:1789760743.551558:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5403
00000100:00100000:2.0:1789760743.551571:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715138050861 time 715187658813 state 0x2 ref 0
00000100:00100000:1.0:1789760743.564624:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760743.565021:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520946048
00000100:00100000:0.0:1789760743.565035:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520946048
00000100:00100000:0.0:1789760743.565129:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715138050861 time 715187658813 state 0x0 ref 1
00000100:00100000:0.0:1789760743.565148:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715187919229 time 715187658813 state 0x1 ref 1
00000100:00100000:0.0:1789760743.565182:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715187919229 time 715251864364 state 0x0 ref 1
00000100:00100000:0.0:1789760743.565197:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520946048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760743.565272:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 21999616, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:0.0:1789760743.565283:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.565302:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:0.0:1789760743.565307:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760743.565342:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.565360:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760743.601810:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 21999616 -> 22003712
00010000:00010000:0.0:1789760743.601839:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.601856:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.601866:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.601874:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760743.601879:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.601889:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.601912:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.601920:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c5be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [21999616->22003711] (req 21999616->22003711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760743.602042:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520946048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36841us (37657us total) trans 4294972691 rc 0/0
00000100:00100000:0.0:1789760743.602054:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5404
00000100:00100000:0.0:1789760743.602066:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715187919229 time 715251864364 state 0x2 ref 0
00000001:00080000:1.0:1789760743.604656:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972691 is committed
00000100:00100000:0.0:1789760743.608142:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760743.608218:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520946176
00000100:00100000:1.0:1789760743.608232:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520946176
00000100:00100000:1.0:1789760743.608414:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715187919229 time 715251864364 state 0x0 ref 1
00000100:00100000:1.0:1789760743.608434:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715252124780 time 715251864364 state 0x1 ref 1
00000100:00100000:1.0:1789760743.608527:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715252124780 time 715295208641 state 0x0 ref 1
00000100:00100000:1.0:1789760743.608543:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520946176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760743.608609:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22003712, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:1.0:1789760743.608621:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.608641:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:1.0:1789760743.608647:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760743.608657:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.608680:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760743.679181:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22003712 -> 22007808
00010000:00010000:3.0:1789760743.679210:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.679225:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.679236:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.679244:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760743.679259:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.679271:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.679301:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.679310:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c5c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22003712->22007807] (req 22003712->22007807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760743.679467:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520946176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70921us (71333us total) trans 4294972692 rc 0/0
00000100:00100000:3.0:1789760743.679479:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5405
00000100:00100000:3.0:1789760743.679493:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715252124780 time 715295208641 state 0x2 ref 0
00000001:00080000:1.0:1789760743.679648:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972692 is committed
00000100:00100000:2.0:1789760743.684878:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760743.684980:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520946304
00000100:00100000:1.0:1789760743.684997:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520946304
00000100:00100000:1.0:1789760743.685085:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715252124780 time 715295208641 state 0x0 ref 1
00000100:00100000:1.0:1789760743.685106:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715295469057 time 715295208641 state 0x1 ref 1
00000100:00100000:1.0:1789760743.685143:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715295469057 time 715371826258 state 0x0 ref 1
00000100:00100000:1.0:1789760743.685159:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520946304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760743.685232:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22007808, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:1.0:1789760743.685244:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.685264:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:1.0:1789760743.685269:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760743.685278:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.685295:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760743.750673:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972693 is committed
00002000:00010000:3.0:1789760743.751036:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22007808 -> 22011904
00010000:00010000:3.0:1789760743.751056:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.751073:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.751083:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.751092:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760743.751098:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.751114:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.751139:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.751147:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c5cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22007808->22011903] (req 22007808->22011903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760743.751272:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520946304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66109us (66401us total) trans 4294972693 rc 0/0
00000100:00100000:3.0:1789760743.751284:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5406
00000100:00100000:3.0:1789760743.751296:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715295469057 time 715371826258 state 0x2 ref 0
00000100:00100000:0.0:1789760743.755849:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760743.755942:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520946432
00000100:00100000:2.0:1789760743.755956:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520946432
00000100:00100000:2.0:1789760743.756031:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715295469057 time 715371826258 state 0x0 ref 1
00000100:00100000:2.0:1789760743.756050:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715372086674 time 715371826258 state 0x1 ref 1
00000100:00100000:2.0:1789760743.756084:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715372086674 time 715442765507 state 0x0 ref 1
00000100:00100000:2.0:1789760743.756099:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520946432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760743.756163:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22011904, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:2.0:1789760743.756174:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.756194:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:2.0:1789760743.756198:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760743.756206:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.756223:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760743.804833:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972694 is committed
00002000:00010000:1.0:1789760743.804924:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22011904 -> 22016000
00010000:00010000:1.0:1789760743.804945:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.804960:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.804970:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.804979:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760743.804984:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.804995:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.805022:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.805031:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c5d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22011904->22015999] (req 22011904->22015999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760743.805156:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520946432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49053us (49313us total) trans 4294972694 rc 0/0
00000100:00100000:1.0:1789760743.805169:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5407
00000100:00100000:1.0:1789760743.805182:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715372086674 time 715442765507 state 0x2 ref 0
00000100:00100000:0.0:1789760743.810876:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760743.810988:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520946560
00000100:00100000:1.0:1789760743.811001:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520946560
00000100:00100000:1.0:1789760743.811069:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715372086674 time 715442765507 state 0x0 ref 1
00000100:00100000:1.0:1789760743.811087:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715443025923 time 715442765507 state 0x1 ref 1
00000100:00100000:1.0:1789760743.811167:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715443025923 time 715497848570 state 0x0 ref 1
00000100:00100000:1.0:1789760743.811181:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520946560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760743.811265:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22016000, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:1.0:1789760743.811276:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.811298:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:1.0:1789760743.811303:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760743.811311:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.811733:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760743.865262:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22016000 -> 22020096
00010000:00010000:0.0:1789760743.865296:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.865341:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.865534:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.865546:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760743.865551:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.865561:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.865586:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.865595:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c5da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22016000->22020095] (req 22016000->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760743.865718:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520946560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54531us (54847us total) trans 4294972695 rc 0/0
00000100:00100000:0.0:1789760743.865741:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5408
00000100:00100000:0.0:1789760743.865753:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715443025923 time 715497848570 state 0x2 ref 0
00000001:00080000:3.0:1789760743.865860:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972695 is committed
00000100:00100000:3.0:1789760743.869016:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760743.869122:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520946688
00000100:00100000:0.0:1789760743.869137:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520946688
00000100:00100000:0.0:1789760743.869210:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715443025923 time 715497848570 state 0x0 ref 1
00000100:00100000:0.0:1789760743.869230:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715498108986 time 715497848570 state 0x1 ref 1
00000100:00100000:0.0:1789760743.869278:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715498108986 time 715555959009 state 0x0 ref 1
00000100:00100000:0.0:1789760743.869295:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520946688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760743.869403:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22020096, mtime: 0x6aad94e8, atime: 0x0, ctime: 0x6aad94e8, blocks: 0xa807
00010000:00010000:0.0:1789760743.869414:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.869435:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:0.0:1789760743.869440:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760743.869448:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760743.869580:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760743.935988:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22020096 -> 22024192
00002000:00010000:3.0:1789760743.936003:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760744 -> 1789760745
00002000:00010000:3.0:1789760743.936006:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760744 -> 1789760745
00002000:00010000:3.0:1789760743.936009:0:14638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 43015 -> 45063
00010000:00010000:3.0:1789760743.936028:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.936045:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.936063:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.936072:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760743.936079:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.936089:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.936112:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.936120:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c5e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22020096->22024191] (req 22020096->22024191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760743.936284:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520946688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66984us (67277us total) trans 4294972696 rc 0/0
00000100:00100000:3.0:1789760743.936298:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5409
00000100:00100000:3.0:1789760743.936311:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715498108986 time 715555959009 state 0x2 ref 0
00000001:00080000:1.0:1789760743.936654:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972696 is committed
00000100:00100000:2.0:1789760743.940051:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760743.940138:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520946816
00000100:00100000:3.0:1789760743.940154:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520946816
00000100:00100000:3.0:1789760743.940235:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715498108986 time 715555959009 state 0x0 ref 1
00000100:00100000:3.0:1789760743.940266:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715556219425 time 715555959009 state 0x1 ref 1
00000100:00100000:3.0:1789760743.940303:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715556219425 time 715626984644 state 0x0 ref 1
00000100:00100000:3.0:1789760743.940534:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520946816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760743.940603:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22024192, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:3.0:1789760743.940614:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.940636:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:3.0:1789760743.940642:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760743.940649:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.940665:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760743.973566:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972697 is committed
00002000:00010000:3.0:1789760743.973587:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22024192 -> 22028288
00010000:00010000:3.0:1789760743.973614:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.973631:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.973642:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.973651:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760743.973658:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.973669:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.973695:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760743.973703:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22024192->22028287] (req 22024192->22028287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760743.973881:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520946816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33558us (33844us total) trans 4294972697 rc 0/0
00000100:00100000:3.0:1789760743.973894:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5410
00000100:00100000:3.0:1789760743.973906:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715556219425 time 715626984644 state 0x2 ref 0
00000100:00100000:2.0:1789760743.976869:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760743.977095:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520946944
00000100:00100000:1.0:1789760743.977108:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520946944
00000100:00100000:1.0:1789760743.977182:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715556219425 time 715626984644 state 0x0 ref 1
00000100:00100000:1.0:1789760743.977202:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715627245060 time 715626984644 state 0x1 ref 1
00000100:00100000:1.0:1789760743.977242:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715627245060 time 715663923781 state 0x0 ref 1
00000100:00100000:1.0:1789760743.977348:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520946944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760743.977422:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22028288, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:1.0:1789760743.977435:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.977735:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:1.0:1789760743.977742:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760743.977751:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760743.977771:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760743.996587:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760744.016178:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972698 is committed
00002000:00010000:2.0:1789760744.016371:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22028288 -> 22032384
00010000:00010000:2.0:1789760744.016392:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760744.016407:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760744.016416:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760744.016423:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760744.016429:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760744.016439:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760744.016533:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760744.016543:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c5ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22028288->22032383] (req 22028288->22032383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760744.016700:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520946944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39385us (39837us total) trans 4294972698 rc 0/0
00000100:00100000:2.0:1789760744.016717:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5411
00000100:00100000:2.0:1789760744.016739:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715627245060 time 715663923781 state 0x2 ref 0
00000100:00100000:2.0:1789760744.020043:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760744.020161:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520947072
00000100:00100000:0.0:1789760744.020174:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520947072
00000100:00100000:0.0:1789760744.020591:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715627245060 time 715663923781 state 0x0 ref 1
00000100:00080000:2.0:1789760744.020601:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760744.020611:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715664184197 time 715663923781 state 0x1 ref 1
00000100:00100000:3.0:1789760744.020697:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715664184197 time 715707372920 state 0x0 ref 1
00000100:00100000:3.0:1789760744.020727:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520947072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760744.020793:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22032384, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:3.0:1789760744.020804:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.020823:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:3.0:1789760744.020829:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760744.020837:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.020853:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760744.064945:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22032384 -> 22036480
00010000:00010000:3.0:1789760744.064971:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.064986:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.064995:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.065003:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760744.065009:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.065019:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.065042:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.065049:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c5f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22032384->22036479] (req 22032384->22036479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760744.065177:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520947072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44457us (45139us total) trans 4294972699 rc 0/0
00000100:00100000:3.0:1789760744.065189:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5412
00000100:00100000:3.0:1789760744.065201:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715664184197 time 715707372920 state 0x2 ref 0
00000001:00080000:0.0:1789760744.065369:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972699 is committed
00000100:00100000:1.0:1789760744.068589:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760744.068771:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520947200
00000100:00100000:3.0:1789760744.068784:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520947200
00000100:00100000:3.0:1789760744.068857:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715664184197 time 715707372920 state 0x0 ref 1
00000100:00100000:3.0:1789760744.068876:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715707633336 time 715707372920 state 0x1 ref 1
00000100:00100000:3.0:1789760744.068914:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715707633336 time 715755596072 state 0x0 ref 1
00000100:00100000:3.0:1789760744.068928:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520947200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760744.068989:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22036480, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:3.0:1789760744.069000:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.069021:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:3.0:1789760744.069026:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760744.069033:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.069051:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760744.122913:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22036480 -> 22040576
00010000:00010000:3.0:1789760744.122940:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.122953:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.122963:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.122970:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760744.122976:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.122986:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.123010:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.123019:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c5fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22036480->22040575] (req 22036480->22040575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760744.123144:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520947200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54211us (54564us total) trans 4294972700 rc 0/0
00000100:00100000:3.0:1789760744.123161:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5413
00000100:00100000:3.0:1789760744.123173:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715707633336 time 715755596072 state 0x2 ref 0
00000001:00080000:0.0:1789760744.123766:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972700 is committed
00000100:00100000:2.0:1789760744.132763:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760744.132941:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520947328
00000100:00100000:1.0:1789760744.132955:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520947328
00000100:00100000:1.0:1789760744.133033:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715707633336 time 715755596072 state 0x0 ref 1
00000100:00100000:1.0:1789760744.133054:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715755856488 time 715755596072 state 0x1 ref 1
00000100:00100000:1.0:1789760744.133140:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715755856488 time 715819820857 state 0x0 ref 1
00000100:00100000:1.0:1789760744.133156:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520947328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760744.133225:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22040576, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:1.0:1789760744.133237:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.133266:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:1.0:1789760744.133272:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760744.133281:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.133297:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760744.190394:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972701 is committed
00002000:00010000:3.0:1789760744.190454:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22040576 -> 22044672
00010000:00010000:3.0:1789760744.190483:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.190498:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.190506:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.190511:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760744.190516:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.190523:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.190542:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.190547:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c604 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22040576->22044671] (req 22040576->22044671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760744.190652:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520947328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57494us (57900us total) trans 4294972701 rc 0/0
00000100:00100000:3.0:1789760744.190662:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5414
00000100:00100000:3.0:1789760744.190672:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715755856488 time 715819820857 state 0x2 ref 0
00000100:00100000:2.0:1789760744.197387:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760744.198602:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520947456
00000100:00100000:1.0:1789760744.198619:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520947456
00000100:00100000:1.0:1789760744.198705:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715755856488 time 715819820857 state 0x0 ref 1
00000100:00100000:1.0:1789760744.198735:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715820081273 time 715819820857 state 0x1 ref 1
00000100:00100000:1.0:1789760744.198834:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715820081273 time 715885514708 state 0x0 ref 1
00000100:00100000:1.0:1789760744.198849:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520947456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760744.198916:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22044672, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:1.0:1789760744.198929:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.198950:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:1.0:1789760744.198956:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760744.198963:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.198980:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760744.245624:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22044672 -> 22048768
00010000:00010000:3.0:1789760744.245654:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.245670:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.245680:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.245689:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760744.245694:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.245704:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.245746:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760744.245762:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972702 is committed
00010000:00010000:3.0:1789760744.245762:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c60b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22044672->22048767] (req 22044672->22048767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760744.245891:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520947456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47037us (48510us total) trans 4294972702 rc 0/0
00000100:00100000:3.0:1789760744.245905:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5415
00000100:00100000:3.0:1789760744.245918:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715820081273 time 715885514708 state 0x2 ref 0
00000100:00100000:1.0:1789760744.249304:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760744.249377:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520947584
00000100:00100000:3.0:1789760744.249392:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520947584
00000100:00100000:3.0:1789760744.249468:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715820081273 time 715885514708 state 0x0 ref 1
00000100:00100000:3.0:1789760744.249488:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715885775124 time 715885514708 state 0x1 ref 1
00000100:00100000:3.0:1789760744.249525:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715885775124 time 715936207554 state 0x0 ref 1
00000100:00100000:3.0:1789760744.249541:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520947584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760744.249606:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22048768, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:3.0:1789760744.249617:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.249638:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:3.0:1789760744.249643:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760744.249650:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.249673:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760744.290284:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972703 is committed
00002000:00010000:3.0:1789760744.291534:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22048768 -> 22052864
00010000:00010000:3.0:1789760744.291557:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.291572:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.291582:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.291591:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760744.291597:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.291887:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.291918:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.291928:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c612 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22048768->22052863] (req 22048768->22052863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760744.292138:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520947584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42592us (42848us total) trans 4294972703 rc 0/0
00000100:00100000:3.0:1789760744.292153:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5416
00000100:00100000:3.0:1789760744.292166:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715885775124 time 715936207554 state 0x2 ref 0
00000100:00100000:2.0:1789760744.295091:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760744.295224:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520947712
00000100:00100000:3.0:1789760744.295236:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520947712
00000100:00100000:3.0:1789760744.295342:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715885775124 time 715936207554 state 0x0 ref 1
00000100:00100000:3.0:1789760744.295364:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715936467970 time 715936207554 state 0x1 ref 1
00000100:00100000:3.0:1789760744.295405:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715936467970 time 715982086727 state 0x0 ref 1
00000100:00100000:3.0:1789760744.295419:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520947712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760744.295500:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22052864, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:3.0:1789760744.295511:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.295665:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=715s v=(0 0)
00010000:00010000:3.0:1789760744.295672:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760744.295680:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.295699:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760744.328498:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972704 is committed
00002000:00010000:1.0:1789760744.328761:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22052864 -> 22056960
00010000:00010000:1.0:1789760744.328782:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.328796:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.328807:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.328815:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760744.328821:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.328830:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.328856:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.328863:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c619 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22052864->22056959] (req 22052864->22056959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760744.329009:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520947712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33585us (33925us total) trans 4294972704 rc 0/0
00000100:00100000:1.0:1789760744.329023:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5417
00000100:00100000:1.0:1789760744.329036:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715936467970 time 715982086727 state 0x2 ref 0
00000100:00100000:2.0:1789760744.337603:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760744.337818:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520947840
00000100:00100000:1.0:1789760744.337833:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520947840
00000100:00100000:1.0:1789760744.337909:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715936467970 time 715982086727 state 0x0 ref 1
00000100:00100000:1.0:1789760744.337928:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715982347143 time 715982086727 state 0x1 ref 1
00000100:00100000:1.0:1789760744.338018:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715982347143 time 716024698175 state 0x0 ref 1
00000100:00100000:1.0:1789760744.338033:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520947840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760744.338100:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22056960, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:1.0:1789760744.338111:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.338131:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:1.0:1789760744.338138:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760744.338146:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.338163:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760744.375420:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972705 is committed
00002000:00010000:1.0:1789760744.375576:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22056960 -> 22061056
00010000:00010000:1.0:1789760744.375597:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.375612:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.375623:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.375630:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760744.375637:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.375647:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.375671:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.375680:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c620 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22056960->22061055] (req 22056960->22061055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760744.375812:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520947840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37774us (38320us total) trans 4294972705 rc 0/0
00000100:00100000:1.0:1789760744.375825:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5418
00000100:00100000:1.0:1789760744.375838:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715982347143 time 716024698175 state 0x2 ref 0
00000100:00100000:3.0:1789760744.382208:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760744.387688:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520947968
00000100:00100000:1.0:1789760744.387709:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520947968
00000100:00100000:1.0:1789760744.387806:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 715982347143 time 716024698175 state 0x0 ref 1
00000100:00100000:1.0:1789760744.387827:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716024958591 time 716024698175 state 0x1 ref 1
00000100:00100000:1.0:1789760744.387871:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716024958591 time 716074553535 state 0x0 ref 1
00000100:00100000:1.0:1789760744.387890:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520947968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760744.387962:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22061056, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:1.0:1789760744.387972:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.387993:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:1.0:1789760744.387997:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760744.388005:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.388022:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760744.453269:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972706 is committed
00002000:00010000:0.0:1789760744.454631:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22061056 -> 22065152
00010000:00010000:0.0:1789760744.454656:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.454672:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.454682:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.454690:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760744.454696:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.454707:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.454741:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.454750:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c627 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22061056->22065151] (req 22061056->22065151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760744.454924:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520947968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67034us (72725us total) trans 4294972706 rc 0/0
00000100:00100000:0.0:1789760744.454938:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5419
00000100:00100000:0.0:1789760744.454950:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716024958591 time 716074553535 state 0x2 ref 0
00000100:00100000:0.0:1789760744.470037:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760744.471841:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520948096
00000100:00100000:3.0:1789760744.471860:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520948096
00000100:00100000:3.0:1789760744.471940:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716024958591 time 716074553535 state 0x0 ref 1
00000100:00100000:3.0:1789760744.471956:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716074813951 time 716074553535 state 0x1 ref 1
00000100:00100000:3.0:1789760744.471987:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716074813951 time 716158670632 state 0x0 ref 1
00000100:00100000:3.0:1789760744.471999:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520948096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760744.472067:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22065152, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:3.0:1789760744.472079:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.472100:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:3.0:1789760744.472105:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760744.472114:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.472131:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760744.526173:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972707 is committed
00002000:00010000:3.0:1789760744.526564:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22065152 -> 22069248
00010000:00010000:3.0:1789760744.526679:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.526695:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.526705:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.526713:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760744.526729:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.526740:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.526764:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.526772:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c62e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22065152->22069247] (req 22065152->22069247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760744.526944:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520948096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54938us (56914us total) trans 4294972707 rc 0/0
00000100:00100000:3.0:1789760744.526958:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5420
00000100:00100000:3.0:1789760744.526969:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716074813951 time 716158670632 state 0x2 ref 0
00000100:00100000:0.0:1789760744.533973:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760744.534092:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520948224
00000100:00100000:3.0:1789760744.534105:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520948224
00000100:00100000:3.0:1789760744.534178:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716074813951 time 716158670632 state 0x0 ref 1
00000100:00100000:3.0:1789760744.534198:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716158931048 time 716158670632 state 0x1 ref 1
00000100:00100000:3.0:1789760744.534233:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716158931048 time 716220915453 state 0x0 ref 1
00000100:00100000:3.0:1789760744.534247:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520948224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760744.534310:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22069248, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:3.0:1789760744.534357:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.534378:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:3.0:1789760744.534384:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760744.534391:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.534408:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760744.572954:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972708 is committed
00002000:00010000:3.0:1789760744.573087:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22069248 -> 22073344
00010000:00010000:3.0:1789760744.573108:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.573124:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.573136:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.573144:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760744.573150:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.573161:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.573185:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.573193:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c635 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22069248->22073343] (req 22069248->22073343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760744.573699:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520948224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39445us (39730us total) trans 4294972708 rc 0/0
00000100:00100000:2.0:1789760744.573722:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5421
00000100:00100000:2.0:1789760744.573735:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716158931048 time 716220915453 state 0x2 ref 0
00000100:00100000:1.0:1789760744.577523:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760744.577669:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520948352
00000100:00100000:2.0:1789760744.577682:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520948352
00000100:00100000:2.0:1789760744.577767:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716158931048 time 716220915453 state 0x0 ref 1
00000100:00100000:2.0:1789760744.577787:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716221175869 time 716220915453 state 0x1 ref 1
00000100:00100000:2.0:1789760744.577852:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716221175869 time 716264533909 state 0x0 ref 1
00000100:00100000:2.0:1789760744.577866:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520948352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760744.577933:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22073344, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:2.0:1789760744.577945:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760744.577971:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:2.0:1789760744.577977:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760744.577985:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760744.578002:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760744.632994:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972709 is committed
00002000:00010000:1.0:1789760744.633128:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22073344 -> 22077440
00010000:00010000:1.0:1789760744.633149:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.633165:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.633176:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.633184:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760744.633190:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.633201:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.633224:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.633233:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c63c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22073344->22077439] (req 22073344->22077439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760744.633561:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520948352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55688us (56305us total) trans 4294972709 rc 0/0
00000100:00100000:1.0:1789760744.633576:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5422
00000100:00100000:1.0:1789760744.633587:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716221175869 time 716264533909 state 0x2 ref 0
00000100:00100000:1.0:1789760744.638995:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760744.639088:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520948480
00000100:00100000:0.0:1789760744.639100:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520948480
00000100:00100000:0.0:1789760744.639171:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716221175869 time 716264533909 state 0x0 ref 1
00000100:00100000:0.0:1789760744.639191:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716264794325 time 716264533909 state 0x1 ref 1
00000100:00100000:0.0:1789760744.639226:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716264794325 time 716325908872 state 0x0 ref 1
00000100:00100000:0.0:1789760744.639239:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520948480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760744.639302:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22077440, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:0.0:1789760744.639346:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.639367:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:0.0:1789760744.639372:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760744.639380:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.639497:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760744.686228:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972710 is committed
00002000:00010000:1.0:1789760744.686453:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22077440 -> 22081536
00010000:00010000:1.0:1789760744.686473:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.686488:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.686498:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.686506:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760744.686512:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.686523:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.686547:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.686555:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c643 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22077440->22081535] (req 22077440->22081535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760744.686681:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+6:2405:x1876699520948480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47436us (47693us total) trans 4294972710 rc 0/0
00000100:00100000:1.0:1789760744.686693:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5423
00000100:00100000:1.0:1789760744.686706:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716264794325 time 716325908872 state 0x2 ref 0
00000100:00100000:0.0:1789760744.690878:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760744.690988:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520948608
00000100:00100000:3.0:1789760744.691000:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520948608
00000100:00100000:3.0:1789760744.691070:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716264794325 time 716325908872 state 0x0 ref 1
00000100:00100000:3.0:1789760744.691089:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716326169288 time 716325908872 state 0x1 ref 1
00000100:00100000:3.0:1789760744.691118:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716326169288 time 716377800727 state 0x0 ref 1
00000100:00100000:3.0:1789760744.691137:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520948608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760744.691200:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22081536, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:3.0:1789760744.691212:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.691231:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:3.0:1789760744.691236:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760744.691243:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760744.691259:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760744.738918:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22081536 -> 22085632
00010000:00010000:1.0:1789760744.738940:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.738954:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.738964:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.738971:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760744.738976:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.738986:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.739009:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.739023:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c64a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22081536->22085631] (req 22081536->22085631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760744.739128:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520948608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47988us (48258us total) trans 4294972711 rc 0/0
00000100:00100000:1.0:1789760744.739140:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5424
00000100:00100000:1.0:1789760744.739151:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716326169288 time 716377800727 state 0x2 ref 0
00000001:00080000:2.0:1789760744.739748:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972711 is committed
00000100:00100000:2.0:1789760744.744536:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760744.744627:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520948736
00000100:00100000:1.0:1789760744.744637:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520948736
00000100:00100000:1.0:1789760744.744692:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716326169288 time 716377800727 state 0x0 ref 1
00000100:00100000:1.0:1789760744.744707:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716378061143 time 716377800727 state 0x1 ref 1
00000100:00100000:1.0:1789760744.744748:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716378061143 time 716431430531 state 0x0 ref 1
00000100:00100000:1.0:1789760744.744760:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520948736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760744.744808:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22085632, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:1.0:1789760744.744817:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.744832:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:1.0:1789760744.744837:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760744.744843:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.744860:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760744.805547:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972712 is committed
00002000:00010000:1.0:1789760744.805770:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22085632 -> 22089728
00010000:00010000:1.0:1789760744.805791:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.805807:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.805817:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.805826:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760744.805832:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.805844:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.805869:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.805879:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c651 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22085632->22089727] (req 22085632->22089727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760744.806063:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520948736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61297us (61528us total) trans 4294972712 rc 0/0
00000100:00100000:1.0:1789760744.806076:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5425
00000100:00100000:1.0:1789760744.806089:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716378061143 time 716431430531 state 0x2 ref 0
00000100:00100000:3.0:1789760744.809500:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760744.810403:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520948864
00000100:00100000:1.0:1789760744.810419:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520948864
00000100:00100000:1.0:1789760744.810499:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716378061143 time 716431430531 state 0x0 ref 1
00000100:00100000:1.0:1789760744.810521:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716431690947 time 716431430531 state 0x1 ref 1
00000100:00100000:1.0:1789760744.810565:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716431690947 time 716497246269 state 0x0 ref 1
00000100:00100000:1.0:1789760744.810580:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520948864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760744.810664:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22089728, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:1.0:1789760744.810676:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.810694:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:1.0:1789760744.810700:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760744.810708:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.810735:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760744.855673:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972713 is committed
00002000:00010000:0.0:1789760744.855836:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22089728 -> 22093824
00010000:00010000:0.0:1789760744.855858:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.855874:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.855885:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.855894:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760744.855900:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.855922:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.855947:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.855957:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c658 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22089728->22093823] (req 22089728->22093823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760744.857242:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520948864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46327us (47419us total) trans 4294972713 rc 0/0
00000100:00100000:0.0:1789760744.857260:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5426
00000100:00100000:0.0:1789760744.857275:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716431690947 time 716497246269 state 0x2 ref 0
00000100:00100000:1.0:1789760744.863502:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760744.863749:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520948992
00000100:00100000:0.0:1789760744.863763:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520948992
00000100:00100000:0.0:1789760744.863835:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716431690947 time 716497246269 state 0x0 ref 1
00000100:00100000:0.0:1789760744.863855:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716497506685 time 716497246269 state 0x1 ref 1
00000100:00100000:0.0:1789760744.863892:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716497506685 time 716550574183 state 0x0 ref 1
00000100:00100000:0.0:1789760744.863907:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520948992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760744.863971:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22093824, mtime: 0x6aad94e9, atime: 0x0, ctime: 0x6aad94e9, blocks: 0xb007
00010000:00010000:0.0:1789760744.863982:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.864002:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:0.0:1789760744.864007:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760744.864015:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.864033:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760744.915689:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972714 is committed
00002000:00010000:0.0:1789760744.915883:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22093824 -> 22097920
00002000:00010000:0.0:1789760744.915889:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760745 -> 1789760746
00002000:00010000:0.0:1789760744.915892:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760745 -> 1789760746
00010000:00010000:0.0:1789760744.915910:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.915927:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.915938:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.916010:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760744.916017:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.916027:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.916053:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.916062:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c65f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22093824->22097919] (req 22093824->22097919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760744.916187:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520948992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52275us (52694us total) trans 4294972714 rc 0/0
00000100:00100000:0.0:1789760744.916199:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5427
00000100:00100000:0.0:1789760744.916211:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716497506685 time 716550574183 state 0x2 ref 0
00000100:00100000:2.0:1789760744.922737:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760744.922911:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520949120
00000100:00100000:1.0:1789760744.922925:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520949120
00000100:00100000:1.0:1789760744.923009:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716497506685 time 716550574183 state 0x0 ref 1
00000100:00100000:1.0:1789760744.923028:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716550834599 time 716550574183 state 0x1 ref 1
00000100:00100000:1.0:1789760744.923061:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716550834599 time 716609742835 state 0x0 ref 1
00000100:00100000:1.0:1789760744.923076:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520949120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760744.923140:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22097920, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:1.0:1789760744.923152:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.923177:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:1.0:1789760744.923183:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760744.923192:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.923209:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760744.974417:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972715 is committed
00002000:00010000:0.0:1789760744.974515:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22097920 -> 22102016
00010000:00010000:0.0:1789760744.974535:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.974559:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.974570:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.974579:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760744.974585:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.974595:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.974619:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760744.974628:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c666 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22097920->22102015] (req 22097920->22102015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760744.974754:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520949120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51674us (52034us total) trans 4294972715 rc 0/0
00000100:00100000:0.0:1789760744.974766:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5428
00000100:00100000:0.0:1789760744.974778:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716550834599 time 716609742835 state 0x2 ref 0
00000100:00100000:3.0:1789760744.978162:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760744.978371:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520949248
00000100:00100000:1.0:1789760744.978383:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520949248
00000100:00100000:1.0:1789760744.978460:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716550834599 time 716609742835 state 0x0 ref 1
00000100:00100000:1.0:1789760744.978480:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716610003251 time 716609742835 state 0x1 ref 1
00000100:00100000:1.0:1789760744.978522:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716610003251 time 716665203576 state 0x0 ref 1
00000100:00100000:1.0:1789760744.978541:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520949248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760744.978608:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22102016, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:1.0:1789760744.978620:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.978640:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:1.0:1789760744.978645:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760744.978654:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760744.978670:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.022052:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760745.038780:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972716 is committed
00002000:00010000:1.0:1789760745.038946:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22102016 -> 22106112
00010000:00010000:1.0:1789760745.038967:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.038983:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.038993:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.039008:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760745.039014:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.039024:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.039048:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.039056:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c66d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22102016->22106111] (req 22102016->22106111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760745.039182:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520949248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60637us (61028us total) trans 4294972716 rc 0/0
00000100:00100000:1.0:1789760745.039194:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5429
00000100:00100000:1.0:1789760745.039206:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716610003251 time 716665203576 state 0x2 ref 0
00000100:00100000:2.0:1789760745.042587:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760745.042739:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520949376
00000100:00100000:0.0:1789760745.042751:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520949376
00000100:00100000:0.0:1789760745.042824:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716610003251 time 716665203576 state 0x0 ref 1
00000100:00100000:0.0:1789760745.042844:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716665463992 time 716665203576 state 0x1 ref 1
00000100:00100000:0.0:1789760745.042911:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716665463992 time 716729591918 state 0x0 ref 1
00000100:00100000:0.0:1789760745.042927:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520949376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760745.042997:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22106112, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:0.0:1789760745.043009:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.043030:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:0.0:1789760745.043036:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760745.043044:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.043062:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760745.081869:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1789760745.082040:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548754688:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1789760745.082139:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760745.082595:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548754688
00000100:00100000:1.0:1789760745.082608:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548754688
00000100:00100000:1.0:1789760745.082676:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429
00000100:00100000:1.0:1789760745.082688:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548754688:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1789760745.082753:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:1.0:1789760745.083033:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548754688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 345us (893us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760745.083045:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429
00000100:00100000:0.0:1789760745.083279:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548754688:0@lo:41:osp-pre-0-1.0
00000001:00080000:1.0:1789760745.087702:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972717 is committed
00002000:00010000:0.0:1789760745.088523:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22106112 -> 22110208
00010000:00010000:0.0:1789760745.088548:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.088565:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.088576:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.088584:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760745.088589:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.088599:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.088624:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.088633:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c674 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22106112->22110207] (req 22106112->22110207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760745.088773:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520949376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45842us (46193us total) trans 4294972717 rc 0/0
00000100:00100000:0.0:1789760745.088785:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5430
00000100:00100000:0.0:1789760745.088797:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716665463992 time 716729591918 state 0x2 ref 0
00000100:00100000:2.0:1789760745.091901:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760745.093772:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520949504
00000100:00100000:0.0:1789760745.093794:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520949504
00000100:00100000:0.0:1789760745.093885:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716665463992 time 716729591918 state 0x0 ref 1
00000100:00100000:0.0:1789760745.093905:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716729852334 time 716729591918 state 0x1 ref 1
00000100:00100000:0.0:1789760745.093934:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716729852334 time 716780616652 state 0x0 ref 1
00000100:00100000:0.0:1789760745.093948:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520949504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760745.094015:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22110208, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:0.0:1789760745.094027:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.094047:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:0.0:1789760745.094119:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760745.094129:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.094146:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760745.146739:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972718 is committed
00002000:00010000:2.0:1789760745.147596:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22110208 -> 22114304
00010000:00010000:2.0:1789760745.147619:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.147635:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.147645:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.147654:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760745.147659:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.147669:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.147694:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.147702:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c67b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22110208->22114303] (req 22110208->22114303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760745.147989:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520949504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54033us (56087us total) trans 4294972718 rc 0/0
00000100:00100000:2.0:1789760745.148002:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5431
00000100:00100000:2.0:1789760745.148014:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716729852334 time 716780616652 state 0x2 ref 0
00000100:00100000:3.0:1789760745.156623:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760745.156752:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520949632
00000100:00100000:1.0:1789760745.156770:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520949632
00000100:00100000:1.0:1789760745.156858:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716729852334 time 716780616652 state 0x0 ref 1
00000100:00100000:1.0:1789760745.156878:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716780877068 time 716780616652 state 0x1 ref 1
00000100:00100000:1.0:1789760745.157029:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716780877068 time 716843709605 state 0x0 ref 1
00000100:00100000:1.0:1789760745.157046:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520949632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760745.157114:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22114304, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:1.0:1789760745.157126:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.157147:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:1.0:1789760745.157152:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760745.157160:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.157176:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760745.209049:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972719 is committed
00002000:00010000:0.0:1789760745.209929:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22114304 -> 22118400
00010000:00010000:0.0:1789760745.209946:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.209960:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.209974:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.209981:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760745.209986:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.209994:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.210012:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.210019:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c682 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22114304->22118399] (req 22114304->22118399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760745.210687:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520949632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53637us (54065us total) trans 4294972719 rc 0/0
00000100:00100000:0.0:1789760745.210700:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5432
00000100:00100000:0.0:1789760745.210709:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716780877068 time 716843709605 state 0x2 ref 0
00000100:00100000:1.0:1789760745.215994:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760745.216158:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520949760
00000100:00100000:2.0:1789760745.216169:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520949760
00000100:00100000:2.0:1789760745.216221:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716780877068 time 716843709605 state 0x0 ref 1
00000100:00100000:2.0:1789760745.216237:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716843970021 time 716843709605 state 0x1 ref 1
00000100:00100000:2.0:1789760745.216364:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716843970021 time 716903045250 state 0x0 ref 1
00000100:00100000:2.0:1789760745.216382:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520949760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760745.216438:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22118400, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:2.0:1789760745.216447:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.216464:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:2.0:1789760745.216469:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760745.216476:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.216491:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760745.281625:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972720 is committed
00002000:00010000:1.0:1789760745.281727:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22118400 -> 22122496
00010000:00010000:1.0:1789760745.281743:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.281754:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.281763:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.281771:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760745.281776:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.281785:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.281803:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.281810:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c689 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22118400->22122495] (req 22118400->22122495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760745.281966:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520949760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65582us (65975us total) trans 4294972720 rc 0/0
00000100:00100000:1.0:1789760745.281976:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5433
00000100:00100000:1.0:1789760745.281995:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716843970021 time 716903045250 state 0x2 ref 0
00000100:00100000:0.0:1789760745.289151:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760745.289861:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520949888
00000100:00100000:2.0:1789760745.289872:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520949888
00000100:00100000:2.0:1789760745.290056:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716843970021 time 716903045250 state 0x0 ref 1
00000100:00100000:2.0:1789760745.290076:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716903305666 time 716903045250 state 0x1 ref 1
00000100:00100000:2.0:1789760745.290142:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716903305666 time 716976824399 state 0x0 ref 1
00000100:00100000:2.0:1789760745.290157:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520949888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760745.290215:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22122496, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:2.0:1789760745.290224:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.290559:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=716s v=(0 0)
00010000:00010000:2.0:1789760745.290565:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760745.290572:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.290587:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760745.328677:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22122496 -> 22126592
00010000:00010000:3.0:1789760745.328699:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.328722:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.328731:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.328744:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760745.328749:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.328758:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.328777:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.328785:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c690 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22122496->22126591] (req 22122496->22126591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760745.328870:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520949888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38711us (39723us total) trans 4294972721 rc 0/0
00000100:00100000:3.0:1789760745.328880:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5434
00000100:00100000:3.0:1789760745.328889:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716903305666 time 716976824399 state 0x2 ref 0
00000001:00080000:1.0:1789760745.329020:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972721 is committed
00000100:00100000:2.0:1789760745.333302:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760745.333663:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520950016
00000100:00100000:0.0:1789760745.333674:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520950016
00000100:00100000:0.0:1789760745.333737:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716903305666 time 716976824399 state 0x0 ref 1
00000100:00100000:0.0:1789760745.333751:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716977084815 time 716976824399 state 0x1 ref 1
00000100:00100000:0.0:1789760745.333810:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716977084815 time 717020492774 state 0x0 ref 1
00000100:00100000:0.0:1789760745.333822:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520950016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760745.333864:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22126592, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:0.0:1789760745.333874:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.333889:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:0.0:1789760745.333894:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760745.333900:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.333913:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760745.377130:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22126592 -> 22130688
00010000:00010000:0.0:1789760745.377150:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.377162:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.377171:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.377189:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760745.377194:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.377204:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.377223:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.377230:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c697 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22126592->22130687] (req 22126592->22130687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760745.377468:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520950016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43642us (44169us total) trans 4294972722 rc 0/0
00000100:00100000:0.0:1789760745.377479:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5435
00000100:00100000:0.0:1789760745.377489:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716977084815 time 717020492774 state 0x2 ref 0
00000001:00080000:1.0:1789760745.377770:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972722 is committed
00000100:00100000:2.0:1789760745.382409:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760745.382494:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520950144
00000100:00100000:0.0:1789760745.382505:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520950144
00000100:00100000:0.0:1789760745.382555:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 716977084815 time 717020492774 state 0x0 ref 1
00000100:00100000:0.0:1789760745.382570:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717020753190 time 717020492774 state 0x1 ref 1
00000100:00100000:0.0:1789760745.382636:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717020753190 time 717069318246 state 0x0 ref 1
00000100:00100000:0.0:1789760745.382651:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760745.382696:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22130688, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:0.0:1789760745.382705:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.382733:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:0.0:1789760745.382737:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760745.382744:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.382759:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760745.411944:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972723 is committed
00002000:00010000:0.0:1789760745.412188:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22130688 -> 22134784
00010000:00010000:0.0:1789760745.412203:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.412217:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.412226:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.412232:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760745.412237:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.412303:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.412468:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.412476:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60c69e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22130688->22134783] (req 22130688->22134783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760745.412595:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29942us (30413us total) trans 4294972723 rc 0/0
00000100:00100000:0.0:1789760745.412606:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5436
00000100:00100000:0.0:1789760745.412614:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717020753190 time 717069318246 state 0x2 ref 0
00000100:00100000:3.0:1789760745.416410:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760745.416461:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520950272
00000100:00100000:1.0:1789760745.416472:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520950272
00000100:00100000:1.0:1789760745.416529:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717020753190 time 717069318246 state 0x0 ref 1
00000100:00100000:1.0:1789760745.416543:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717069578662 time 717069318246 state 0x1 ref 1
00000100:00100000:1.0:1789760745.416566:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717069578662 time 717103250050 state 0x0 ref 1
00000100:00100000:1.0:1789760745.416577:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520950272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760745.416625:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22134784, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:1.0:1789760745.416634:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.416648:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:1.0:1789760745.416652:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760745.416658:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.416671:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760745.452602:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972724 is committed
00002000:00010000:0.0:1789760745.452705:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22134784 -> 22138880
00010000:00010000:0.0:1789760745.452730:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.452742:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.452751:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.452758:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760745.452763:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.452773:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.452791:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.452799:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c6a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22134784->22138879] (req 22134784->22138879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760745.452896:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520950272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36315us (36490us total) trans 4294972724 rc 0/0
00000100:00100000:0.0:1789760745.452907:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5437
00000100:00100000:0.0:1789760745.452915:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717069578662 time 717103250050 state 0x2 ref 0
00000100:00100000:2.0:1789760745.456705:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760745.456783:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520950400
00000100:00100000:3.0:1789760745.456793:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520950400
00000100:00100000:3.0:1789760745.456859:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717069578662 time 717103250050 state 0x0 ref 1
00000100:00100000:3.0:1789760745.456875:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717103510466 time 717103250050 state 0x1 ref 1
00000100:00100000:3.0:1789760745.456908:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717103510466 time 717143590447 state 0x0 ref 1
00000100:00100000:3.0:1789760745.456921:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760745.456979:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22138880, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:3.0:1789760745.456988:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.457003:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:3.0:1789760745.457007:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760745.457014:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.457028:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760745.496237:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972725 is committed
00002000:00010000:3.0:1789760745.496288:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22138880 -> 22142976
00010000:00010000:3.0:1789760745.496310:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.496417:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.496427:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.496434:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760745.496440:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.496450:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.496470:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.496477:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22138880->22142975] (req 22138880->22142975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760745.496578:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520950400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39653us (39876us total) trans 4294972725 rc 0/0
00000100:00100000:3.0:1789760745.496588:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5438
00000100:00100000:3.0:1789760745.496598:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717103510466 time 717143590447 state 0x2 ref 0
00000100:00100000:1.0:1789760745.501849:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760745.504828:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520950528
00000100:00100000:0.0:1789760745.504908:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520950528
00000100:00100000:0.0:1789760745.504982:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717103510466 time 717143590447 state 0x0 ref 1
00000100:00100000:0.0:1789760745.504999:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717143850863 time 717143590447 state 0x1 ref 1
00000100:00100000:0.0:1789760745.505034:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717143850863 time 717191715956 state 0x0 ref 1
00000100:00100000:0.0:1789760745.505046:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760745.505098:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22142976, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:0.0:1789760745.505108:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.505124:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:0.0:1789760745.505128:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760745.505135:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.505149:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760745.543470:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22142976 -> 22147072
00010000:00010000:1.0:1789760745.543489:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.543502:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.543512:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.543520:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760745.543525:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.543533:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.543553:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.543561:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c6b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22142976->22147071] (req 22142976->22147071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760745.543660:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520950528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38611us (41818us total) trans 4294972726 rc 0/0
00000100:00100000:1.0:1789760745.543670:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5439
00000100:00100000:1.0:1789760745.543680:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717143850863 time 717191715956 state 0x2 ref 0
00000001:00080000:3.0:1789760745.544513:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972726 is committed
00000100:00100000:0.0:1789760745.548543:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760745.552089:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520950656
00000100:00100000:2.0:1789760745.552106:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520950656
00000100:00100000:2.0:1789760745.552173:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717143850863 time 717191715956 state 0x0 ref 1
00000100:00100000:2.0:1789760745.552276:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717191976372 time 717191715956 state 0x1 ref 1
00000100:00100000:2.0:1789760745.552325:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717191976372 time 717238993953 state 0x0 ref 1
00000100:00100000:2.0:1789760745.552340:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760745.552385:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22147072, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:2.0:1789760745.552394:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.552414:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:2.0:1789760745.552418:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760745.552424:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.552438:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760745.589827:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972727 is committed
00002000:00010000:0.0:1789760745.590385:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22147072 -> 22151168
00010000:00010000:0.0:1789760745.590402:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.590416:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.590426:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.590434:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760745.590440:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.590450:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.590470:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.590478:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60c6ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22147072->22151167] (req 22147072->22151167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760745.590619:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38278us (42079us total) trans 4294972727 rc 0/0
00000100:00100000:0.0:1789760745.590631:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5440
00000100:00100000:0.0:1789760745.590641:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717191976372 time 717238993953 state 0x2 ref 0
00000100:00100000:0.0:1789760745.598871:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760745.598993:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520950784
00000100:00100000:1.0:1789760745.599005:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520950784
00000100:00100000:1.0:1789760745.599055:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717191976372 time 717238993953 state 0x0 ref 1
00000100:00100000:1.0:1789760745.599069:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717239254369 time 717238993953 state 0x1 ref 1
00000100:00100000:1.0:1789760745.599130:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717239254369 time 717285812710 state 0x0 ref 1
00000100:00100000:1.0:1789760745.599141:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760745.599196:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22151168, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:1.0:1789760745.599205:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.599221:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:1.0:1789760745.599226:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760745.599232:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.599253:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760745.634406:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972728 is committed
00002000:00010000:2.0:1789760745.634533:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22151168 -> 22155264
00010000:00010000:2.0:1789760745.634549:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.634562:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.634571:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.634578:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760745.634583:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.634591:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.634610:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.634618:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c6c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22151168->22155263] (req 22151168->22155263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760745.634719:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35565us (35844us total) trans 4294972728 rc 0/0
00000100:00100000:2.0:1789760745.634729:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5441
00000100:00100000:2.0:1789760745.634739:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717239254369 time 717285812710 state 0x2 ref 0
00000100:00100000:1.0:1789760745.638841:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760745.638927:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520950912
00000100:00100000:3.0:1789760745.638937:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520950912
00000100:00100000:3.0:1789760745.638985:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717239254369 time 717285812710 state 0x0 ref 1
00000100:00100000:3.0:1789760745.639000:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717286073126 time 717285812710 state 0x1 ref 1
00000100:00100000:3.0:1789760745.639032:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717286073126 time 717325715169 state 0x0 ref 1
00000100:00100000:3.0:1789760745.639048:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520950912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760745.639089:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22155264, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:3.0:1789760745.639099:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.639113:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:3.0:1789760745.639118:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760745.639124:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.639137:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760745.679875:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22155264 -> 22159360
00010000:00010000:3.0:1789760745.679897:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.679911:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.679919:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.679927:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760745.679932:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.679940:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.679959:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.679967:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22155264->22159359] (req 22155264->22159359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760745.680057:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520950912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41005us (41219us total) trans 4294972729 rc 0/0
00000100:00100000:3.0:1789760745.680065:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5442
00000100:00100000:3.0:1789760745.680074:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717286073126 time 717325715169 state 0x2 ref 0
00000001:00080000:2.0:1789760745.680147:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972729 is committed
00000100:00100000:0.0:1789760745.684193:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760745.684350:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520951040
00000100:00100000:1.0:1789760745.684360:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520951040
00000100:00100000:1.0:1789760745.684419:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717286073126 time 717325715169 state 0x0 ref 1
00000100:00100000:1.0:1789760745.684435:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717325975585 time 717325715169 state 0x1 ref 1
00000100:00100000:1.0:1789760745.684470:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717325975585 time 717371153008 state 0x0 ref 1
00000100:00100000:1.0:1789760745.684485:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520951040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760745.684534:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22159360, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:1.0:1789760745.684543:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.684560:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:1.0:1789760745.684564:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760745.684571:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.684585:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760745.718116:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22159360 -> 22163456
00010000:00010000:1.0:1789760745.718137:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.718151:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.718160:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.718167:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760745.718172:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.718181:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.718200:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.718208:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22159360->22163455] (req 22159360->22163455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760745.718401:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520951040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33913us (34211us total) trans 4294972730 rc 0/0
00000100:00100000:1.0:1789760745.718413:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5443
00000100:00100000:1.0:1789760745.718497:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717325975585 time 717371153008 state 0x2 ref 0
00000001:00080000:3.0:1789760745.718888:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972730 is committed
00000100:00100000:1.0:1789760745.724671:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760745.724783:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520951168
00000100:00100000:2.0:1789760745.724793:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520951168
00000100:00100000:2.0:1789760745.724844:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717325975585 time 717371153008 state 0x0 ref 1
00000100:00100000:2.0:1789760745.724858:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717371413424 time 717371153008 state 0x1 ref 1
00000100:00100000:2.0:1789760745.724932:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717371413424 time 717411613064 state 0x0 ref 1
00000100:00100000:2.0:1789760745.724945:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520951168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760745.724994:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22163456, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:2.0:1789760745.725004:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.725020:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:2.0:1789760745.725025:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760745.725031:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.725046:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760745.758098:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972731 is committed
00002000:00010000:2.0:1789760745.758420:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22163456 -> 22167552
00010000:00010000:2.0:1789760745.758508:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.758521:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.758530:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.758537:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760745.758542:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.758551:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.758570:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.758578:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c6d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22163456->22167551] (req 22163456->22167551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760745.758677:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520951168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33729us (34011us total) trans 4294972731 rc 0/0
00000100:00100000:2.0:1789760745.758687:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5444
00000100:00100000:2.0:1789760745.758697:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717371413424 time 717411613064 state 0x2 ref 0
00000100:00100000:1.0:1789760745.762040:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760745.762085:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520951296
00000100:00100000:2.0:1789760745.762094:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520951296
00000100:00100000:2.0:1789760745.762146:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717371413424 time 717411613064 state 0x0 ref 1
00000100:00100000:2.0:1789760745.762162:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717411873480 time 717411613064 state 0x1 ref 1
00000100:00100000:2.0:1789760745.762193:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717411873480 time 717448875035 state 0x0 ref 1
00000100:00100000:2.0:1789760745.762204:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520951296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760745.762251:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22167552, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:2.0:1789760745.762268:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.762283:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:2.0:1789760745.762286:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760745.762292:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.762305:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760745.790524:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972732 is committed
00002000:00010000:1.0:1789760745.790717:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22167552 -> 22171648
00010000:00010000:1.0:1789760745.790732:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.790745:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.790755:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.790769:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760745.790774:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.790783:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.790801:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.790809:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60c6dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22167552->22171647] (req 22167552->22171647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760745.790932:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520951296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28726us (28895us total) trans 4294972732 rc 0/0
00000100:00100000:1.0:1789760745.790942:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5445
00000100:00100000:1.0:1789760745.790951:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717411873480 time 717448875035 state 0x2 ref 0
00000100:00100000:0.0:1789760745.798155:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760745.798230:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520951424
00000100:00100000:3.0:1789760745.798250:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520951424
00000100:00100000:3.0:1789760745.798309:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717411873480 time 717448875035 state 0x0 ref 1
00000100:00100000:3.0:1789760745.798371:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717449135451 time 717448875035 state 0x1 ref 1
00000100:00100000:3.0:1789760745.798401:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717449135451 time 717485083930 state 0x0 ref 1
00000100:00100000:3.0:1789760745.798415:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520951424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760745.798465:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22171648, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:3.0:1789760745.798474:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.798488:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:3.0:1789760745.798492:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760745.798499:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.798513:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760745.825727:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972733 is committed
00002000:00010000:3.0:1789760745.825828:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22171648 -> 22175744
00010000:00010000:3.0:1789760745.825844:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.825857:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.825866:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.825873:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760745.825878:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.825888:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.825907:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.825915:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c6e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22171648->22175743] (req 22171648->22175743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760745.826013:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520951424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27594us (27861us total) trans 4294972733 rc 0/0
00000100:00100000:3.0:1789760745.826023:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5446
00000100:00100000:3.0:1789760745.826032:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717449135451 time 717485083930 state 0x2 ref 0
00000100:00100000:1.0:1789760745.829504:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760745.829600:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520951552
00000100:00100000:0.0:1789760745.829609:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520951552
00000100:00100000:0.0:1789760745.829659:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717449135451 time 717485083930 state 0x0 ref 1
00000100:00100000:0.0:1789760745.829673:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717485344346 time 717485083930 state 0x1 ref 1
00000100:00100000:0.0:1789760745.829703:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717485344346 time 717516385717 state 0x0 ref 1
00000100:00100000:0.0:1789760745.829729:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520951552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760745.829780:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22175744, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:0.0:1789760745.829790:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.829809:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:0.0:1789760745.829814:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760745.829820:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760745.829834:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760745.861900:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22175744 -> 22179840
00010000:00010000:3.0:1789760745.861920:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.861934:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.861944:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.861951:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760745.861956:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.861969:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.861988:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.861996:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c6eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22175744->22179839] (req 22175744->22179839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760745.862098:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520951552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32367us (32599us total) trans 4294972734 rc 0/0
00000100:00100000:3.0:1789760745.862109:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5447
00000100:00100000:3.0:1789760745.862118:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717485344346 time 717516385717 state 0x2 ref 0
00000001:00080000:0.0:1789760745.862544:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972734 is committed
00000100:00100000:0.0:1789760745.871525:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760745.871606:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520951680
00000100:00100000:2.0:1789760745.871616:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520951680
00000100:00100000:2.0:1789760745.871677:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717485344346 time 717516385717 state 0x0 ref 1
00000100:00100000:2.0:1789760745.871693:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717516646133 time 717516385717 state 0x1 ref 1
00000100:00100000:2.0:1789760745.871731:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717516646133 time 717558412926 state 0x0 ref 1
00000100:00100000:2.0:1789760745.871744:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520951680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760745.871789:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22179840, mtime: 0x6aad94ea, atime: 0x0, ctime: 0x6aad94ea, blocks: 0xb007
00010000:00010000:2.0:1789760745.871799:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.871814:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:2.0:1789760745.871818:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760745.871824:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.871837:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760745.923052:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22179840 -> 22183936
00002000:00010000:2.0:1789760745.923061:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760746 -> 1789760747
00002000:00010000:2.0:1789760745.923064:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760746 -> 1789760747
00010000:00010000:2.0:1789760745.923078:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.923091:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.923101:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.923109:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760745.923114:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.923124:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.923145:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760745.923153:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c6f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22179840->22183935] (req 22179840->22183935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760745.923243:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520951680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51496us (51723us total) trans 4294972735 rc 0/0
00000100:00100000:2.0:1789760745.923253:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5448
00000100:00100000:2.0:1789760745.923273:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717516646133 time 717558412926 state 0x2 ref 0
00000001:00080000:0.0:1789760745.923824:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972735 is committed
00000100:00100000:2.0:1789760745.928480:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760745.928629:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520951808
00000100:00100000:1.0:1789760745.928640:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520951808
00000100:00100000:1.0:1789760745.928694:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717516646133 time 717558412926 state 0x0 ref 1
00000100:00100000:1.0:1789760745.928718:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717558673342 time 717558412926 state 0x1 ref 1
00000100:00100000:1.0:1789760745.928776:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717558673342 time 717615458254 state 0x0 ref 1
00000100:00100000:1.0:1789760745.928789:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520951808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760745.928836:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22183936, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:1.0:1789760745.928845:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.928861:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:1.0:1789760745.928866:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760745.928881:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.928895:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760745.974041:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972736 is committed
00002000:00010000:1.0:1789760745.974244:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22183936 -> 22188032
00010000:00010000:1.0:1789760745.974259:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.974270:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.974279:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.974286:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760745.974290:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.974299:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.974348:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760745.974355:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c6f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22183936->22188031] (req 22183936->22188031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760745.974435:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520951808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45644us (45960us total) trans 4294972736 rc 0/0
00000100:00100000:1.0:1789760745.974445:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5449
00000100:00100000:1.0:1789760745.974455:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717558673342 time 717615458254 state 0x2 ref 0
00000100:00100000:2.0:1789760745.985833:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760745.985926:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520951936
00000100:00100000:3.0:1789760745.985936:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520951936
00000100:00100000:3.0:1789760745.985996:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717558673342 time 717615458254 state 0x0 ref 1
00000100:00100000:3.0:1789760745.986011:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717615718670 time 717615458254 state 0x1 ref 1
00000100:00100000:3.0:1789760745.986070:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717615718670 time 717672752423 state 0x0 ref 1
00000100:00100000:3.0:1789760745.986083:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520951936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760745.986128:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22188032, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:3.0:1789760745.986138:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.986153:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:3.0:1789760745.986158:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760745.986164:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760745.986177:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760746.011217:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22188032 -> 22192128
00010000:00010000:3.0:1789760746.011249:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.011263:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.011272:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.011280:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760746.011286:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.011295:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.011352:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.011361:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c700 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22188032->22192127] (req 22188032->22192127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760746.011447:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520951936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25361us (25616us total) trans 4294972737 rc 0/0
00000100:00100000:3.0:1789760746.011457:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5450
00000100:00100000:3.0:1789760746.011466:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717615718670 time 717672752423 state 0x2 ref 0
00000001:00080000:3.0:1789760746.011502:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972737 is committed
00000100:00100000:2.0:1789760746.015152:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760746.015243:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520952064
00000100:00100000:3.0:1789760746.015253:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520952064
00000100:00100000:3.0:1789760746.015356:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717615718670 time 717672752423 state 0x0 ref 1
00000100:00100000:3.0:1789760746.015371:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717673012839 time 717672752423 state 0x1 ref 1
00000100:00100000:3.0:1789760746.015542:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717673012839 time 717702223525 state 0x0 ref 1
00000100:00100000:3.0:1789760746.015558:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760746.015604:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22192128, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:3.0:1789760746.015613:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.015634:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:3.0:1789760746.015638:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760746.015645:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.015658:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:2.0:1789760746.016309:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1789760746.043748:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760746.045998:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972738 is committed
00002000:00010000:0.0:1789760746.046063:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22192128 -> 22196224
00010000:00010000:0.0:1789760746.046078:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.046091:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.046099:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.046107:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760746.046112:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.046122:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.046142:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.046155:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c707 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22192128->22196223] (req 22192128->22196223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760746.046280:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30721us (31134us total) trans 4294972738 rc 0/0
00000100:00100000:0.0:1789760746.046290:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5451
00000100:00100000:0.0:1789760746.046299:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717673012839 time 717702223525 state 0x2 ref 0
00000100:00100000:2.0:1789760746.051215:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760746.051470:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520952192
00000100:00100000:0.0:1789760746.051481:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520952192
00000100:00100000:0.0:1789760746.051537:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717673012839 time 717702223525 state 0x0 ref 1
00000100:00100000:0.0:1789760746.051554:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717702483941 time 717702223525 state 0x1 ref 1
00000100:00100000:0.0:1789760746.051680:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717702483941 time 717738361813 state 0x0 ref 1
00000100:00100000:0.0:1789760746.051695:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520952192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760746.051754:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22196224, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:0.0:1789760746.051763:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.051779:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:0.0:1789760746.051783:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760746.051790:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.051804:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760746.084150:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972739 is committed
00002000:00010000:0.0:1789760746.084418:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22196224 -> 22200320
00010000:00010000:0.0:1789760746.084433:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.084447:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.084456:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.084462:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760746.084467:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.084475:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.084495:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.084503:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c70e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22196224->22200319] (req 22196224->22200319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760746.084638:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520952192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32941us (33428us total) trans 4294972739 rc 0/0
00000100:00100000:0.0:1789760746.084650:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5452
00000100:00100000:0.0:1789760746.084660:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717702483941 time 717738361813 state 0x2 ref 0
00000100:00100000:2.0:1789760746.088688:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760746.088796:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520952320
00000100:00100000:1.0:1789760746.088806:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520952320
00000100:00100000:1.0:1789760746.088857:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717702483941 time 717738361813 state 0x0 ref 1
00000100:00100000:1.0:1789760746.088871:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717738622229 time 717738361813 state 0x1 ref 1
00000100:00100000:1.0:1789760746.088936:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717738622229 time 717775618121 state 0x0 ref 1
00000100:00100000:1.0:1789760746.088950:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760746.089001:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22200320, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:1.0:1789760746.089011:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.089028:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:1.0:1789760746.089032:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760746.089038:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.089052:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760746.105501:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548754816:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1789760746.105570:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760746.105652:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548754816
00000100:00100000:1.0:1789760746.105659:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548754816
00000100:00100000:1.0:1789760746.105717:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430
00000100:00100000:1.0:1789760746.105728:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548754816:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1789760746.105768:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:1.0:1789760746.105819:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548754816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (248us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760746.105827:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430
00000100:00100000:1.0:1789760746.105878:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548754816:0@lo:41:osp-pre-1-0.0
00000001:00080000:2.0:1789760746.121981:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972740 is committed
00002000:00010000:1.0:1789760746.122103:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22200320 -> 22204416
00010000:00010000:1.0:1789760746.122119:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.122132:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.122148:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.122156:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760746.122161:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.122170:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.122189:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.122197:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c715 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22200320->22204415] (req 22200320->22204415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760746.122574:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33621us (33889us total) trans 4294972740 rc 0/0
00000100:00100000:1.0:1789760746.122587:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5453
00000100:00100000:1.0:1789760746.122596:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717738622229 time 717775618121 state 0x2 ref 0
00000100:00100000:0.0:1789760746.125792:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760746.125865:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520952448
00000100:00100000:3.0:1789760746.125874:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520952448
00000100:00100000:3.0:1789760746.125927:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717738622229 time 717775618121 state 0x0 ref 1
00000100:00100000:3.0:1789760746.125943:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717775878537 time 717775618121 state 0x1 ref 1
00000100:00100000:3.0:1789760746.125975:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717775878537 time 717812657062 state 0x0 ref 1
00000100:00100000:3.0:1789760746.125988:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760746.126036:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22204416, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:3.0:1789760746.126045:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.126062:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:3.0:1789760746.126067:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760746.126073:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.126092:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760746.155785:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22204416 -> 22208512
00010000:00010000:0.0:1789760746.155807:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.155820:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.155830:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.155837:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760746.155841:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.155848:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.155871:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.155878:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c71c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22204416->22208511] (req 22204416->22208511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760746.155975:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520952448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29984us (30188us total) trans 4294972741 rc 0/0
00000100:00100000:0.0:1789760746.155986:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5454
00000100:00100000:0.0:1789760746.155995:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717775878537 time 717812657062 state 0x2 ref 0
00000001:00080000:1.0:1789760746.158490:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972741 is committed
00000100:00100000:1.0:1789760746.161586:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760746.161674:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520952576
00000100:00100000:0.0:1789760746.161684:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520952576
00000100:00100000:0.0:1789760746.161746:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717775878537 time 717812657062 state 0x0 ref 1
00000100:00100000:0.0:1789760746.161761:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717812917478 time 717812657062 state 0x1 ref 1
00000100:00100000:0.0:1789760746.161823:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717812917478 time 717848505929 state 0x0 ref 1
00000100:00100000:0.0:1789760746.161837:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760746.161883:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22208512, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:0.0:1789760746.161892:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.161907:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:0.0:1789760746.161911:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760746.161917:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.161931:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760746.192134:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22208512 -> 22212608
00010000:00010000:0.0:1789760746.192154:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.192167:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.192176:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.192183:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760746.192188:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.192197:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.192216:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.192225:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c723 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22208512->22212607] (req 22208512->22212607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760746.192373:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520952576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30533us (30790us total) trans 4294972742 rc 0/0
00000100:00100000:0.0:1789760746.192384:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5455
00000100:00100000:0.0:1789760746.192393:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717812917478 time 717848505929 state 0x2 ref 0
00000001:00080000:3.0:1789760746.194529:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972742 is committed
00000100:00100000:2.0:1789760746.195562:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760746.195861:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520952704
00000100:00100000:0.0:1789760746.195870:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520952704
00000100:00100000:0.0:1789760746.195917:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717812917478 time 717848505929 state 0x0 ref 1
00000100:00100000:0.0:1789760746.195931:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717848766345 time 717848505929 state 0x1 ref 1
00000100:00100000:0.0:1789760746.195959:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717848766345 time 717882642308 state 0x0 ref 1
00000100:00100000:0.0:1789760746.195970:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760746.196017:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22212608, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:0.0:1789760746.196027:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.196043:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:0.0:1789760746.196047:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760746.196053:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.196066:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760746.228204:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22212608 -> 22216704
00010000:00010000:2.0:1789760746.228223:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.228246:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.228255:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.228262:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760746.228267:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.228276:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.228296:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.228309:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60c72a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22212608->22216703] (req 22212608->22216703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760746.228428:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520952704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32455us (32871us total) trans 4294972743 rc 0/0
00000100:00100000:2.0:1789760746.228440:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5456
00000100:00100000:2.0:1789760746.228450:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717848766345 time 717882642308 state 0x2 ref 0
00000001:00080000:3.0:1789760746.231303:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972743 is committed
00000100:00100000:0.0:1789760746.232547:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760746.232626:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520952832
00000100:00100000:2.0:1789760746.232636:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520952832
00000100:00100000:2.0:1789760746.232690:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717848766345 time 717882642308 state 0x0 ref 1
00000100:00100000:2.0:1789760746.232715:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717882902724 time 717882642308 state 0x1 ref 1
00000100:00100000:2.0:1789760746.232744:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717882902724 time 717919426074 state 0x0 ref 1
00000100:00100000:2.0:1789760746.232756:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520952832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760746.232805:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22216704, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:2.0:1789760746.232814:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.232830:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:2.0:1789760746.232834:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760746.232840:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.232859:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760746.264936:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972744 is committed
00002000:00010000:2.0:1789760746.265075:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22216704 -> 22220800
00010000:00010000:2.0:1789760746.265091:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.265104:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.265114:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.265122:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760746.265127:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.265136:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.265155:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.265163:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c731 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22216704->22220799] (req 22216704->22220799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760746.265374:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520952832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32614us (32826us total) trans 4294972744 rc 0/0
00000100:00100000:2.0:1789760746.265387:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5457
00000100:00100000:2.0:1789760746.265397:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717882902724 time 717919426074 state 0x2 ref 0
00000100:00100000:0.0:1789760746.269172:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760746.269256:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520952960
00000100:00100000:3.0:1789760746.269266:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520952960
00000100:00100000:3.0:1789760746.269471:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717882902724 time 717919426074 state 0x0 ref 1
00000100:00100000:3.0:1789760746.269489:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717919686490 time 717919426074 state 0x1 ref 1
00000100:00100000:3.0:1789760746.269517:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717919686490 time 717956199826 state 0x0 ref 1
00000100:00100000:3.0:1789760746.269529:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760746.269583:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22220800, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:3.0:1789760746.269592:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.269608:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:3.0:1789760746.269613:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760746.269620:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.269634:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760746.302876:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972745 is committed
00002000:00010000:2.0:1789760746.302999:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22220800 -> 22224896
00010000:00010000:2.0:1789760746.303014:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.303027:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.303035:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.303042:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760746.303046:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.303055:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.303074:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.303086:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c738 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22220800->22224895] (req 22220800->22224895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760746.303179:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520952960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33646us (34012us total) trans 4294972745 rc 0/0
00000100:00100000:2.0:1789760746.303189:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5458
00000100:00100000:2.0:1789760746.303198:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717919686490 time 717956199826 state 0x2 ref 0
00000100:00100000:1.0:1789760746.306588:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760746.306699:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520953088
00000100:00100000:0.0:1789760746.306719:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520953088
00000100:00100000:0.0:1789760746.306776:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717919686490 time 717956199826 state 0x0 ref 1
00000100:00100000:0.0:1789760746.306805:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717956460242 time 717956199826 state 0x1 ref 1
00000100:00100000:0.0:1789760746.306836:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717956460242 time 717993518846 state 0x0 ref 1
00000100:00100000:0.0:1789760746.306851:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520953088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760746.306904:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22224896, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:0.0:1789760746.306916:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.306933:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=717s v=(0 0)
00010000:00010000:0.0:1789760746.306937:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760746.306943:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.306958:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760746.331750:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760746.331791:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760746.331814:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760746.331833:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760746.331858:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760746.331884:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520953472
00000100:00100000:1.0:1789760746.331894:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520953472
00000100:00100000:1.0:1789760746.331951:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520953728
00000100:00100000:1.0:1789760746.331954:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520953728
00000100:00100000:1.0:1789760746.331970:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520953344
00000100:00100000:1.0:1789760746.331973:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520953344
00000100:00100000:1.0:1789760746.331986:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520953600
00000100:00100000:1.0:1789760746.331989:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520953600
00000100:00100000:1.0:1789760746.332006:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 883
00000100:00100000:1.0:1789760746.332016:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520953472:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760746.332087:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520953472:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 71us (295us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760746.332095:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 883
00000100:00100000:1.0:1789760746.332112:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 884
00000100:00100000:1.0:1789760746.332119:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520953728:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760746.332145:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520953728:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (330us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760746.332152:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 884
00000100:00100000:1.0:1789760746.332163:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 885
00000100:00100000:1.0:1789760746.332169:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520953344:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760746.332193:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520953344:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760746.332200:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 885
00000100:00100000:1.0:1789760746.332212:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 886
00000100:00100000:1.0:1789760746.332218:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520953600:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760746.332253:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520953600:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (381us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760746.332260:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 886
00000100:00080000:1.0:1789760746.332280:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:1.0:1789760746.332285:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1789760746.332463:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520953216
00000100:00100000:3.0:1789760746.332468:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520953216
00000100:00100000:3.0:1789760746.332505:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 472
00000100:00100000:3.0:1789760746.332513:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2405:x1876699520953216:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760746.332545:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2405:x1876699520953216:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (804us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760746.332551:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 472
00000001:00080000:0.0:1789760746.340569:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972746 is committed
00002000:00010000:0.0:1789760746.340643:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22224896 -> 22228992
00010000:00010000:0.0:1789760746.340659:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.340672:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.340681:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.340687:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760746.340692:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.340709:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.340732:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.340739:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c73f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22224896->22228991] (req 22224896->22228991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760746.340816:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520953088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33966us (34234us total) trans 4294972746 rc 0/0
00000100:00100000:0.0:1789760746.340827:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5459
00000100:00100000:0.0:1789760746.340836:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717956460242 time 717993518846 state 0x2 ref 0
00000100:00100000:0.0:1789760746.347976:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760746.348101:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520953856
00000100:00100000:2.0:1789760746.348113:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520953856
00000100:00100000:2.0:1789760746.348171:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717956460242 time 717993518846 state 0x0 ref 1
00000100:00100000:2.0:1789760746.348187:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717993779262 time 717993518846 state 0x1 ref 1
00000100:00100000:2.0:1789760746.348219:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717993779262 time 718034902113 state 0x0 ref 1
00000100:00100000:2.0:1789760746.348424:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520953856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760746.348478:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22228992, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:2.0:1789760746.348487:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.348502:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:2.0:1789760746.348507:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760746.348513:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.348531:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760746.388571:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972747 is committed
00002000:00010000:2.0:1789760746.388662:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22228992 -> 22233088
00010000:00010000:2.0:1789760746.388678:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.388691:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.388699:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.388717:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760746.388721:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.388730:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.388749:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.388757:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c746 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22228992->22233087] (req 22228992->22233087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760746.388905:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520953856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40663us (41002us total) trans 4294972747 rc 0/0
00000100:00100000:2.0:1789760746.388916:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5460
00000100:00100000:2.0:1789760746.388926:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717993779262 time 718034902113 state 0x2 ref 0
00000100:00100000:1.0:1789760746.391899:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760746.392010:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520953984
00000100:00100000:2.0:1789760746.392019:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520953984
00000100:00100000:2.0:1789760746.392071:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 717993779262 time 718034902113 state 0x0 ref 1
00000100:00100000:2.0:1789760746.392085:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718035162529 time 718034902113 state 0x1 ref 1
00000100:00100000:2.0:1789760746.392159:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718035162529 time 718078841383 state 0x0 ref 1
00000100:00100000:2.0:1789760746.392173:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520953984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760746.392220:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22233088, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:2.0:1789760746.392228:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.392244:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:2.0:1789760746.392249:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760746.392255:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.392269:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760746.422694:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972748 is committed
00002000:00010000:3.0:1789760746.422819:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22233088 -> 22237184
00010000:00010000:3.0:1789760746.422833:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.422847:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.422857:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.422864:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760746.422869:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.422879:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.422898:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.422906:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c74d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22233088->22237183] (req 22233088->22237183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760746.422992:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520953984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30818us (31099us total) trans 4294972748 rc 0/0
00000100:00100000:3.0:1789760746.423002:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5461
00000100:00100000:3.0:1789760746.423011:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718035162529 time 718078841383 state 0x2 ref 0
00000100:00100000:1.0:1789760746.430440:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760746.430584:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520954112
00000100:00100000:3.0:1789760746.430602:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520954112
00000100:00100000:3.0:1789760746.430682:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718035162529 time 718078841383 state 0x0 ref 1
00000100:00100000:3.0:1789760746.430710:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718079101799 time 718078841383 state 0x1 ref 1
00000100:00100000:3.0:1789760746.430747:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718079101799 time 718117429351 state 0x0 ref 1
00000100:00100000:3.0:1789760746.430765:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520954112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760746.430827:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22237184, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:3.0:1789760746.430838:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.430859:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:3.0:1789760746.430865:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760746.430872:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.430896:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760746.475076:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972749 is committed
00002000:00010000:2.0:1789760746.475176:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22237184 -> 22241280
00010000:00010000:2.0:1789760746.475190:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.475204:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.475213:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.475220:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760746.475225:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.475461:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.475482:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.475490:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c754 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22237184->22241279] (req 22237184->22241279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760746.475583:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520954112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44818us (45148us total) trans 4294972749 rc 0/0
00000100:00100000:2.0:1789760746.475597:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5462
00000100:00100000:2.0:1789760746.475606:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718079101799 time 718117429351 state 0x2 ref 0
00000100:00100000:1.0:1789760746.490634:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760746.490745:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520954240
00000100:00100000:0.0:1789760746.490761:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520954240
00000100:00100000:0.0:1789760746.490824:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718079101799 time 718117429351 state 0x0 ref 1
00000100:00100000:0.0:1789760746.490839:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718117689767 time 718117429351 state 0x1 ref 1
00000100:00100000:0.0:1789760746.490870:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718117689767 time 718177552536 state 0x0 ref 1
00000100:00100000:0.0:1789760746.490884:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520954240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760746.490935:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22241280, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:0.0:1789760746.490945:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.490959:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:0.0:1789760746.490964:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760746.490970:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.490995:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760746.532054:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22241280 -> 22245376
00010000:00010000:1.0:1789760746.532079:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.532095:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.532104:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.532111:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760746.532116:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.532125:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.532153:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.532160:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c75b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22241280->22245375] (req 22241280->22245375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760746.532259:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520954240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41374us (41636us total) trans 4294972750 rc 0/0
00000100:00100000:1.0:1789760746.532269:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5463
00000100:00100000:1.0:1789760746.532289:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718117689767 time 718177552536 state 0x2 ref 0
00000001:00080000:0.0:1789760746.532572:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972750 is committed
00000100:00100000:1.0:1789760746.546028:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760746.546117:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520954368
00000100:00100000:3.0:1789760746.546127:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520954368
00000100:00100000:3.0:1789760746.546181:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718117689767 time 718177552536 state 0x0 ref 1
00000100:00100000:3.0:1789760746.546196:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718177812952 time 718177552536 state 0x1 ref 1
00000100:00100000:3.0:1789760746.546227:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718177812952 time 718232910044 state 0x0 ref 1
00000100:00100000:3.0:1789760746.546248:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520954368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760746.546296:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22245376, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:3.0:1789760746.546305:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.546515:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:3.0:1789760746.546520:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760746.546527:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.546541:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760746.594989:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972751 is committed
00002000:00010000:1.0:1789760746.595099:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22245376 -> 22249472
00010000:00010000:1.0:1789760746.595115:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.595129:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.595139:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.595147:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760746.595151:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.595175:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.595196:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.595204:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c762 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22245376->22249471] (req 22245376->22249471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760746.595297:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520954368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49047us (49275us total) trans 4294972751 rc 0/0
00000100:00100000:1.0:1789760746.595307:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5464
00000100:00100000:1.0:1789760746.595353:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718177812952 time 718232910044 state 0x2 ref 0
00000100:00100000:1.0:1789760746.601998:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760746.602110:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520954496
00000100:00100000:2.0:1789760746.602120:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520954496
00000100:00100000:2.0:1789760746.602188:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718177812952 time 718232910044 state 0x0 ref 1
00000100:00100000:2.0:1789760746.602204:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718233170460 time 718232910044 state 0x1 ref 1
00000100:00100000:2.0:1789760746.602238:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718233170460 time 718288913935 state 0x0 ref 1
00000100:00100000:2.0:1789760746.602256:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520954496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760746.602306:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22249472, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:2.0:1789760746.602356:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.602372:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:2.0:1789760746.602377:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760746.602385:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.602399:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760746.618428:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548754944:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1789760746.618499:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760746.618569:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548754944
00000100:00100000:0.0:1789760746.618576:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548754944
00000100:00100000:0.0:1789760746.618632:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362
00000100:00100000:0.0:1789760746.618641:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548754944:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1789760746.618665:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528023552 pending 1703936 free 3835691008 avail 3802136576
00000100:00100000:0.0:1789760746.618717:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548754944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (217us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760746.618724:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362
00000100:00080000:0.0:1789760746.618744:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760746.618783:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548754944:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760746.621534:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1789760746.621553:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548755072:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1789760746.621616:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760746.621670:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548755072
00000100:00100000:3.0:1789760746.621678:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548755072
00000100:00100000:3.0:1789760746.621740:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363
00000100:00100000:3.0:1789760746.621749:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548755072:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1789760746.621770:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528023552 pending 1703936 free 3835691008 avail 3802136576
00000100:00100000:3.0:1789760746.621812:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548755072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (195us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760746.621820:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363
00000100:00080000:3.0:1789760746.621839:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760746.621870:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548755072:0@lo:13:osp-pre-0-1.0
00000001:00080000:2.0:1789760746.650916:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972752 is committed
00002000:00010000:3.0:1789760746.651100:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22249472 -> 22253568
00010000:00010000:3.0:1789760746.651115:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.651129:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.651139:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.651146:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760746.651151:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.651161:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.651180:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.651187:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c769 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22249472->22253567] (req 22249472->22253567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760746.651365:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520954496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49106us (49370us total) trans 4294972752 rc 0/0
00000100:00100000:3.0:1789760746.651376:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5465
00000100:00100000:3.0:1789760746.651387:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718233170460 time 718288913935 state 0x2 ref 0
00000100:00100000:0.0:1789760746.660480:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760746.660624:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520954624
00000100:00100000:2.0:1789760746.660635:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520954624
00000100:00100000:2.0:1789760746.660690:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718233170460 time 718288913935 state 0x0 ref 1
00000100:00100000:2.0:1789760746.660717:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718289174351 time 718288913935 state 0x1 ref 1
00000100:00100000:2.0:1789760746.660750:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718289174351 time 718347432617 state 0x0 ref 1
00000100:00100000:2.0:1789760746.660762:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520954624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760746.660809:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22253568, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:2.0:1789760746.660818:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.660833:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:2.0:1789760746.660838:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760746.660844:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.660858:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760746.740847:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22253568 -> 22257664
00010000:00010000:2.0:1789760746.740879:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.740893:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.740907:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.740915:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760746.740920:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.740930:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.740950:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.740958:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c770 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22253568->22257663] (req 22253568->22257663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760746.741053:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520954624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 80287us (80580us total) trans 4294972753 rc 0/0
00000100:00100000:2.0:1789760746.741065:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5466
00000100:00100000:2.0:1789760746.741077:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718289174351 time 718347432617 state 0x2 ref 0
00000001:00080000:2.0:1789760746.741115:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972753 is committed
00000100:00100000:1.0:1789760746.745803:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760746.745946:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520954752
00000100:00100000:0.0:1789760746.745956:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520954752
00000100:00100000:0.0:1789760746.746008:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718289174351 time 718347432617 state 0x0 ref 1
00000100:00100000:0.0:1789760746.746022:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718347693033 time 718347432617 state 0x1 ref 1
00000100:00100000:0.0:1789760746.746052:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718347693033 time 718432734880 state 0x0 ref 1
00000100:00100000:0.0:1789760746.746065:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520954752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760746.746118:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22257664, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:0.0:1789760746.746127:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.746142:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:0.0:1789760746.746147:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760746.746152:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.746535:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760746.780175:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972754 is committed
00002000:00010000:0.0:1789760746.780407:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22257664 -> 22261760
00010000:00010000:0.0:1789760746.780423:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.780436:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.780446:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.780453:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760746.780458:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.780468:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.780487:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.780495:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c777 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22257664->22261759] (req 22257664->22261759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760746.780578:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520954752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34511us (34778us total) trans 4294972754 rc 0/0
00000100:00100000:0.0:1789760746.780588:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5467
00000100:00100000:0.0:1789760746.780597:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718347693033 time 718432734880 state 0x2 ref 0
00000100:00100000:0.0:1789760746.784627:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760746.784716:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520954880
00000100:00100000:1.0:1789760746.784726:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520954880
00000100:00100000:1.0:1789760746.784849:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718347693033 time 718432734880 state 0x0 ref 1
00000100:00100000:1.0:1789760746.784865:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718432995296 time 718432734880 state 0x1 ref 1
00000100:00100000:1.0:1789760746.784897:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718432995296 time 718471578659 state 0x0 ref 1
00000100:00100000:1.0:1789760746.784908:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520954880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760746.784955:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22261760, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:1.0:1789760746.784964:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.784978:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:1.0:1789760746.784983:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760746.784988:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.785001:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760746.827612:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972755 is committed
00002000:00010000:1.0:1789760746.827814:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22261760 -> 22265856
00010000:00010000:1.0:1789760746.827829:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.827843:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.827853:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.827860:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760746.827865:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.827875:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.827896:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760746.827905:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c77e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22261760->22265855] (req 22261760->22265855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760746.828100:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520954880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43188us (43478us total) trans 4294972755 rc 0/0
00000100:00100000:1.0:1789760746.828111:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5468
00000100:00100000:1.0:1789760746.828121:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718432995296 time 718471578659 state 0x2 ref 0
00000100:00100000:1.0:1789760746.837148:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760746.837662:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520955008
00000100:00100000:3.0:1789760746.837672:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520955008
00000100:00100000:3.0:1789760746.837736:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718432995296 time 718471578659 state 0x0 ref 1
00000100:00100000:3.0:1789760746.837748:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718471839075 time 718471578659 state 0x1 ref 1
00000100:00100000:3.0:1789760746.837773:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718471839075 time 718524456961 state 0x0 ref 1
00000100:00100000:3.0:1789760746.837784:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520955008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760746.837830:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22265856, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:3.0:1789760746.837839:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.837853:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:3.0:1789760746.837858:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760746.837865:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.837877:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760746.883642:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972756 is committed
00002000:00010000:3.0:1789760746.883761:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22265856 -> 22269952
00010000:00010000:3.0:1789760746.883776:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.883787:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.883796:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.883803:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760746.883809:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.883818:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.883836:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.883844:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c785 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22265856->22269951] (req 22265856->22269951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760746.884112:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520955008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46322us (46966us total) trans 4294972756 rc 0/0
00000100:00100000:3.0:1789760746.884124:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5469
00000100:00100000:3.0:1789760746.884133:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718471839075 time 718524456961 state 0x2 ref 0
00000100:00100000:3.0:1789760746.890664:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760746.890750:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520955136
00000100:00100000:2.0:1789760746.890759:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520955136
00000100:00100000:2.0:1789760746.890817:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718471839075 time 718524456961 state 0x0 ref 1
00000100:00100000:2.0:1789760746.890833:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718524717377 time 718524456961 state 0x1 ref 1
00000100:00100000:2.0:1789760746.890871:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718524717377 time 718577553450 state 0x0 ref 1
00000100:00100000:2.0:1789760746.890884:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520955136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760746.890947:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22269952, mtime: 0x6aad94eb, atime: 0x0, ctime: 0x6aad94eb, blocks: 0xb007
00010000:00010000:2.0:1789760746.890960:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.890976:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:2.0:1789760746.890981:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760746.890987:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.891001:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760746.936020:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972757 is committed
00002000:00010000:3.0:1789760746.936415:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22269952 -> 22274048
00002000:00010000:3.0:1789760746.936420:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760747 -> 1789760748
00002000:00010000:3.0:1789760746.936423:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760747 -> 1789760748
00010000:00010000:3.0:1789760746.936437:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.936451:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.936460:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.936467:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760746.936471:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.936480:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.936504:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.936511:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60c78c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22269952->22274047] (req 22269952->22274047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760746.936681:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520955136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45793us (46021us total) trans 4294972757 rc 0/0
00000100:00100000:3.0:1789760746.936709:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5470
00000100:00100000:3.0:1789760746.936718:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718524717377 time 718577553450 state 0x2 ref 0
00000100:00100000:2.0:1789760746.942201:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760746.942344:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520955264
00000100:00100000:0.0:1789760746.942354:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520955264
00000100:00100000:0.0:1789760746.942409:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718524717377 time 718577553450 state 0x0 ref 1
00000100:00100000:0.0:1789760746.942426:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718577813866 time 718577553450 state 0x1 ref 1
00000100:00100000:0.0:1789760746.942452:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718577813866 time 718629134714 state 0x0 ref 1
00000100:00100000:0.0:1789760746.942465:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520955264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760746.942514:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22274048, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:0.0:1789760746.942523:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.942545:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:0.0:1789760746.942549:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760746.942555:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760746.942568:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760746.978797:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972758 is committed
00002000:00010000:2.0:1789760746.979097:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22274048 -> 22278144
00010000:00010000:2.0:1789760746.979113:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.979125:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.979135:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.979143:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760746.979148:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.979158:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.979177:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760746.979185:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c793 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22274048->22278143] (req 22274048->22278143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760746.979692:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520955264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37222us (37506us total) trans 4294972758 rc 0/0
00000100:00100000:3.0:1789760746.979711:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5471
00000100:00100000:3.0:1789760746.979721:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718577813866 time 718629134714 state 0x2 ref 0
00000100:00100000:1.0:1789760746.987890:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760746.988353:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520955392
00000100:00100000:3.0:1789760746.988363:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520955392
00000100:00100000:3.0:1789760746.988492:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718577813866 time 718629134714 state 0x0 ref 1
00000100:00100000:3.0:1789760746.988509:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718629395130 time 718629134714 state 0x1 ref 1
00000100:00100000:3.0:1789760746.988569:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718629395130 time 718675251088 state 0x0 ref 1
00000100:00100000:3.0:1789760746.988583:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520955392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760746.988632:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22278144, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:3.0:1789760746.988641:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.988657:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:3.0:1789760746.988661:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760746.988668:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760746.988682:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760747.039632:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22278144 -> 22282240
00010000:00010000:3.0:1789760747.039650:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.039663:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.039672:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.039680:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760747.039684:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.039693:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.039723:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.039730:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c79a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22278144->22282239] (req 22278144->22282239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760747.039822:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520955392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51236us (51935us total) trans 4294972759 rc 0/0
00000100:00100000:3.0:1789760747.039834:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5472
00000100:00100000:3.0:1789760747.039842:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718629395130 time 718675251088 state 0x2 ref 0
00000001:00080000:0.0:1789760747.039917:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972759 is committed
00000100:00100000:1.0:1789760747.053203:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760747.056058:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520955520
00000100:00100000:3.0:1789760747.056076:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520955520
00000100:00100000:2.0:1789760747.056331:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718629395130 time 718675251088 state 0x0 ref 1
00000100:00100000:2.0:1789760747.056351:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718675511504 time 718675251088 state 0x1 ref 1
00000100:00100000:2.0:1789760747.056418:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718675511504 time 718743099377 state 0x0 ref 1
00000100:00100000:2.0:1789760747.056432:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520955520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760747.056499:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22282240, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:2.0:1789760747.056510:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.056527:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:2.0:1789760747.056532:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760747.056539:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.056553:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.065587:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760747.088798:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972760 is committed
00002000:00010000:2.0:1789760747.089088:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22282240 -> 22286336
00010000:00010000:2.0:1789760747.089104:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.089117:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.089125:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.089131:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760747.089136:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.089145:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.089164:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.089170:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22282240->22286335] (req 22282240->22286335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760747.089388:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520955520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32954us (36190us total) trans 4294972760 rc 0/0
00000100:00100000:2.0:1789760747.089399:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5473
00000100:00100000:2.0:1789760747.089409:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718675511504 time 718743099377 state 0x2 ref 0
00000100:00100000:2.0:1789760747.100465:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760747.100633:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520955648
00000100:00100000:3.0:1789760747.100644:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520955648
00000100:00100000:3.0:1789760747.100694:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718675511504 time 718743099377 state 0x0 ref 1
00000100:00100000:3.0:1789760747.100722:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718743359793 time 718743099377 state 0x1 ref 1
00000100:00100000:3.0:1789760747.100754:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718743359793 time 718787436515 state 0x0 ref 1
00000100:00100000:3.0:1789760747.100765:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520955648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760747.100811:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22286336, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:3.0:1789760747.100820:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.100838:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:3.0:1789760747.100843:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760747.100849:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.100863:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760747.148200:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972761 is committed
00002000:00010000:1.0:1789760747.148501:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22286336 -> 22290432
00010000:00010000:1.0:1789760747.148517:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.148530:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.148538:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.148545:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760747.148550:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.148559:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.148579:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.148586:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c7a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22286336->22290431] (req 22286336->22290431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760747.148680:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520955648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47911us (48218us total) trans 4294972761 rc 0/0
00000100:00100000:1.0:1789760747.148690:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5474
00000100:00100000:1.0:1789760747.148709:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718743359793 time 718787436515 state 0x2 ref 0
00000100:00100000:1.0:1789760747.158153:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760747.160410:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520955776
00000100:00100000:3.0:1789760747.160425:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520955776
00000100:00100000:3.0:1789760747.160485:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718743359793 time 718787436515 state 0x0 ref 1
00000100:00100000:3.0:1789760747.160500:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718787696931 time 718787436515 state 0x1 ref 1
00000100:00100000:3.0:1789760747.160584:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718787696931 time 718847266498 state 0x0 ref 1
00000100:00100000:3.0:1789760747.160599:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520955776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760747.160648:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22290432, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:3.0:1789760747.160656:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.160670:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:3.0:1789760747.160674:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760747.160680:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.160709:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760747.192467:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972762 is committed
00002000:00010000:1.0:1789760747.192614:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22290432 -> 22294528
00010000:00010000:1.0:1789760747.192631:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.192643:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.192653:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.192664:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760747.192669:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.192677:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.192706:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.192714:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c7af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22290432->22294527] (req 22290432->22294527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760747.192814:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520955776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32213us (34665us total) trans 4294972762 rc 0/0
00000100:00100000:1.0:1789760747.192824:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5475
00000100:00100000:1.0:1789760747.192833:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718787696931 time 718847266498 state 0x2 ref 0
00000100:00100000:3.0:1789760747.196782:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760747.196944:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520955904
00000100:00100000:1.0:1789760747.196954:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520955904
00000100:00100000:1.0:1789760747.197007:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718787696931 time 718847266498 state 0x0 ref 1
00000100:00100000:1.0:1789760747.197023:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718847526914 time 718847266498 state 0x1 ref 1
00000100:00100000:1.0:1789760747.197086:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718847526914 time 718883768503 state 0x0 ref 1
00000100:00100000:1.0:1789760747.197101:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520955904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760747.197146:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22294528, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:1.0:1789760747.197155:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.197172:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:1.0:1789760747.197176:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760747.197183:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.197197:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760747.242878:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22294528 -> 22298624
00010000:00010000:3.0:1789760747.242900:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.242911:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.242919:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.242926:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760747.242930:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.242938:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.242958:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.242964:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22294528->22298623] (req 22294528->22298623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760747.243094:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520955904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45991us (46318us total) trans 4294972763 rc 0/0
00000100:00100000:3.0:1789760747.243105:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5476
00000100:00100000:3.0:1789760747.243114:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718847526914 time 718883768503 state 0x2 ref 0
00000001:00080000:0.0:1789760747.243263:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972763 is committed
00000100:00100000:1.0:1789760747.248813:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760747.248912:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520956032
00000100:00100000:2.0:1789760747.248922:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520956032
00000100:00100000:2.0:1789760747.248982:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718847526914 time 718883768503 state 0x0 ref 1
00000100:00100000:2.0:1789760747.248997:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718884028919 time 718883768503 state 0x1 ref 1
00000100:00100000:2.0:1789760747.249024:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718884028919 time 718935707469 state 0x0 ref 1
00000100:00100000:2.0:1789760747.249036:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520956032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760747.249083:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22298624, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:2.0:1789760747.249092:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.249112:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:2.0:1789760747.249117:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760747.249124:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.249136:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760747.299551:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972764 is committed
00002000:00010000:1.0:1789760747.299817:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22298624 -> 22302720
00010000:00010000:1.0:1789760747.299833:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.299846:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.299854:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.299862:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760747.299866:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.299874:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.299891:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.299898:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c7bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22298624->22302719] (req 22298624->22302719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760747.300029:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520956032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50984us (51215us total) trans 4294972764 rc 0/0
00000100:00100000:1.0:1789760747.300039:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5477
00000100:00100000:1.0:1789760747.300048:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718884028919 time 718935707469 state 0x2 ref 0
00000100:00100000:1.0:1789760747.304914:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760747.305076:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520956160
00000100:00100000:3.0:1789760747.305087:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520956160
00000100:00100000:3.0:1789760747.305141:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718884028919 time 718935707469 state 0x0 ref 1
00000100:00100000:3.0:1789760747.305157:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718935967885 time 718935707469 state 0x1 ref 1
00000100:00100000:3.0:1789760747.305222:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718935967885 time 718991903678 state 0x0 ref 1
00000100:00100000:3.0:1789760747.305243:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520956160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760747.305289:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22302720, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:3.0:1789760747.305299:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.305346:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=718s v=(0 0)
00010000:00010000:3.0:1789760747.305351:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760747.305357:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.305372:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760747.338101:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22302720 -> 22306816
00010000:00010000:3.0:1789760747.338120:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.338133:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.338142:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.338149:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760747.338154:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.338164:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.338185:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.338192:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c7c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22302720->22306815] (req 22302720->22306815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760747.338364:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520956160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33117us (33453us total) trans 4294972765 rc 0/0
00000100:00100000:3.0:1789760747.338379:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5478
00000100:00100000:3.0:1789760747.338389:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718935967885 time 718991903678 state 0x2 ref 0
00000001:00080000:3.0:1789760747.338422:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972765 is committed
00000100:00100000:3.0:1789760747.345100:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760747.345431:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520956288
00000100:00100000:1.0:1789760747.345441:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520956288
00000100:00100000:1.0:1789760747.345492:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718935967885 time 718991903678 state 0x0 ref 1
00000100:00100000:1.0:1789760747.345507:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718992164094 time 718991903678 state 0x1 ref 1
00000100:00100000:1.0:1789760747.345538:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718992164094 time 719032221390 state 0x0 ref 1
00000100:00100000:1.0:1789760747.345549:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520956288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760747.345591:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22306816, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:1.0:1789760747.345600:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.349019:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:1.0:1789760747.349033:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760747.349043:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.349063:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760747.373708:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22306816 -> 22310912
00010000:00010000:1.0:1789760747.373727:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.373740:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.373748:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.373756:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760747.373761:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.373770:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.373795:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.373804:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c7cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22306816->22310911] (req 22306816->22310911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760747.373900:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520956288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28346us (28802us total) trans 4294972766 rc 0/0
00000100:00100000:1.0:1789760747.373911:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5479
00000100:00100000:1.0:1789760747.373921:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718992164094 time 719032221390 state 0x2 ref 0
00000001:00080000:2.0:1789760747.374619:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972766 is committed
00000100:00100000:2.0:1789760747.379914:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760747.380021:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520956416
00000100:00100000:3.0:1789760747.380032:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520956416
00000100:00100000:3.0:1789760747.380084:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 718992164094 time 719032221390 state 0x0 ref 1
00000100:00100000:3.0:1789760747.380099:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719032481806 time 719032221390 state 0x1 ref 1
00000100:00100000:3.0:1789760747.380138:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719032481806 time 719066820119 state 0x0 ref 1
00000100:00100000:3.0:1789760747.380157:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8da95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520956416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760747.380207:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22310912, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:3.0:1789760747.380217:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.380248:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:3.0:1789760747.380254:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760747.380260:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.380276:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760747.419380:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22310912 -> 22315008
00010000:00010000:3.0:1789760747.419401:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.419416:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.419426:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.419434:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760747.419439:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.419447:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760747.419551:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972767 is committed
00010000:00010000:3.0:1789760747.419565:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.419576:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22310912->22315007] (req 22310912->22315007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760747.419669:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8da95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520956416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39516us (39760us total) trans 4294972767 rc 0/0
00000100:00100000:3.0:1789760747.419685:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5480
00000100:00100000:3.0:1789760747.419706:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719032481806 time 719066820119 state 0x2 ref 0
00000100:00100000:3.0:1789760747.425525:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760747.426302:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520956544
00000100:00100000:2.0:1789760747.426350:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520956544
00000100:00100000:2.0:1789760747.426406:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719032481806 time 719066820119 state 0x0 ref 1
00000100:00100000:2.0:1789760747.426421:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719067080535 time 719066820119 state 0x1 ref 1
00000100:00100000:2.0:1789760747.426457:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719067080535 time 719113140081 state 0x0 ref 1
00000100:00100000:2.0:1789760747.426470:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520956544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760747.426516:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22315008, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:2.0:1789760747.426526:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.426543:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:2.0:1789760747.426548:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760747.426556:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.426570:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760747.477380:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972768 is committed
00002000:00010000:2.0:1789760747.477720:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22315008 -> 22319104
00010000:00010000:2.0:1789760747.477736:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.477748:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.477757:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.477765:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760747.477770:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.477782:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.477800:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.477807:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22315008->22319103] (req 22315008->22319103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760747.477935:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520956544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51462us (52415us total) trans 4294972768 rc 0/0
00000100:00100000:2.0:1789760747.477946:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5481
00000100:00100000:2.0:1789760747.477956:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719067080535 time 719113140081 state 0x2 ref 0
00000100:00100000:1.0:1789760747.480513:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760747.480580:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520956672
00000100:00100000:0.0:1789760747.480590:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520956672
00000100:00100000:0.0:1789760747.480644:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719067080535 time 719113140081 state 0x0 ref 1
00000100:00100000:0.0:1789760747.480657:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719113400497 time 719113140081 state 0x1 ref 1
00000100:00100000:0.0:1789760747.480689:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719113400497 time 719167371450 state 0x0 ref 1
00000100:00100000:0.0:1789760747.480712:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520956672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760747.480760:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22319104, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:0.0:1789760747.480769:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.480794:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:0.0:1789760747.480799:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760747.480805:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.480818:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760747.526075:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972769 is committed
00002000:00010000:3.0:1789760747.527435:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22319104 -> 22323200
00010000:00010000:3.0:1789760747.527454:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.527467:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.527477:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.527484:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760747.527490:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.527499:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.527518:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.527526:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60c7e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22319104->22323199] (req 22319104->22323199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760747.527646:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520956672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46934us (47138us total) trans 4294972769 rc 0/0
00000100:00100000:3.0:1789760747.527655:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5482
00000100:00100000:3.0:1789760747.527663:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719113400497 time 719167371450 state 0x2 ref 0
00000100:00100000:1.0:1789760747.530940:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760747.531044:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520956800
00000100:00100000:0.0:1789760747.531053:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520956800
00000100:00100000:0.0:1789760747.531109:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719113400497 time 719167371450 state 0x0 ref 1
00000100:00100000:0.0:1789760747.531124:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719167631866 time 719167371450 state 0x1 ref 1
00000100:00100000:0.0:1789760747.531199:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719167631866 time 719217881342 state 0x0 ref 1
00000100:00100000:0.0:1789760747.531212:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520956800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760747.531270:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22323200, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:0.0:1789760747.531279:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.531294:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:0.0:1789760747.531298:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760747.531303:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.531352:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760747.555268:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972770 is committed
00002000:00010000:0.0:1789760747.555645:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22323200 -> 22327296
00010000:00010000:0.0:1789760747.555660:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.555671:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.555679:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.555686:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760747.555690:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.555708:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.555725:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.555733:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60c7e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22323200->22327295] (req 22323200->22327295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760747.555856:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520956800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24642us (24919us total) trans 4294972770 rc 0/0
00000100:00100000:0.0:1789760747.555870:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5483
00000100:00100000:0.0:1789760747.555879:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719167631866 time 719217881342 state 0x2 ref 0
00000100:00100000:0.0:1789760747.560685:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760747.560875:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520956928
00000100:00100000:3.0:1789760747.560885:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520956928
00000100:00100000:3.0:1789760747.560940:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719167631866 time 719217881342 state 0x0 ref 1
00000100:00100000:3.0:1789760747.562970:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719218141758 time 719217881342 state 0x1 ref 1
00000100:00100000:3.0:1789760747.563021:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719218141758 time 719249702414 state 0x0 ref 1
00000100:00100000:3.0:1789760747.563042:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520956928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760747.563385:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22327296, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:3.0:1789760747.563395:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.563411:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:3.0:1789760747.563687:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760747.563705:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.563721:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760747.600765:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972771 is committed
00002000:00010000:3.0:1789760747.600875:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22327296 -> 22331392
00010000:00010000:3.0:1789760747.600891:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.600903:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.600912:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.600919:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760747.600923:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.600932:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.600950:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.600958:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c7ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22327296->22331391] (req 22327296->22331391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760747.601049:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520956928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38012us (40378us total) trans 4294972771 rc 0/0
00000100:00100000:3.0:1789760747.601062:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5484
00000100:00100000:3.0:1789760747.601073:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719218141758 time 719249702414 state 0x2 ref 0
00000100:00100000:0.0:1789760747.613760:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760747.613862:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520957056
00000100:00100000:2.0:1789760747.613871:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520957056
00000100:00100000:2.0:1789760747.613921:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719218141758 time 719249702414 state 0x0 ref 1
00000100:00100000:2.0:1789760747.613937:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719249962830 time 719249702414 state 0x1 ref 1
00000100:00100000:2.0:1789760747.613967:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719249962830 time 719300650091 state 0x0 ref 1
00000100:00100000:2.0:1789760747.613980:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520957056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760747.614024:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22331392, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:2.0:1789760747.614034:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.614049:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:2.0:1789760747.614053:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760747.614059:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.614073:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760747.642166:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8da95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548755200:0@lo:400:kworker.0
00000100:00100000:3.0:1789760747.642239:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760747.643276:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8da94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548755328:0@lo:400:kworker.0
00000100:00100000:2.0:1789760747.643335:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760747.643402:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc174f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548755840:0@lo:400:kworker.0
00000100:00100000:2.0:1789760747.643424:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760747.643448:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548756352:0@lo:400:kworker.0
00000100:00100000:2.0:1789760747.643471:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760747.643489:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548756864:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1789760747.643513:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760747.643539:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:2.0:1789760747.643545:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8da94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548755456:0@lo:400:kworker.0
00000100:00100000:2.0:1789760747.643568:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760747.643586:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc174ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548755968:0@lo:400:kworker.0
00000100:00100000:2.0:1789760747.643605:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760747.643623:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548756480:0@lo:400:kworker.0
00000100:00100000:2.0:1789760747.643643:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760747.643676:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548756864
00000100:00100000:2.0:1789760747.643894:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548756864
00000100:00100000:2.0:1789760747.643953:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364
00000100:00100000:2.0:1789760747.643962:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548756864:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1789760747.643995:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:2.0:1789760747.644044:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548756864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (529us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760747.644050:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364
00000100:00100000:2.0:1789760747.644095:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548756864:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760747.644974:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8da96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548755584:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.645014:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760747.645044:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc174f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548756096:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.645070:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760747.645089:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548756608:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.645108:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760747.645128:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:1.0:1789760747.645135:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc174c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548755712:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.645155:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760747.645173:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc174e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548756224:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.645200:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760747.645218:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548756736:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.645609:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760747.646161:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548755328
00000100:00100000:3.0:1789760747.646169:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548755328
00000100:00100000:3.0:1789760747.646248:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548755840
00000100:00100000:3.0:1789760747.646252:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548755840
00000100:00100000:3.0:1789760747.646403:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548756352
00000100:00100000:3.0:1789760747.646408:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548756352
00000100:00100000:3.0:1789760747.646425:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548755968
00000100:00100000:3.0:1789760747.646428:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548755968
00000100:00100000:3.0:1789760747.646442:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548756480
00000100:00100000:3.0:1789760747.646444:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548756480
00000100:00100000:3.0:1789760747.646471:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548755584
00000100:00100000:3.0:1789760747.646475:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548755584
00000100:00100000:3.0:1789760747.646498:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887
00000100:00100000:3.0:1789760747.646509:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548755328:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760747.646575:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548755328:12345-0@lo:400:kworker.0 Request processed in 69us (3240us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760747.646584:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887
00000100:00100000:3.0:1789760747.646603:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888
00000100:00100000:3.0:1789760747.646611:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548755840:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760747.646639:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548755840:12345-0@lo:400:kworker.0 Request processed in 30us (3214us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760747.646645:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888
00000100:00100000:3.0:1789760747.646656:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889
00000100:00100000:3.0:1789760747.646662:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548756352:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760747.646685:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548756352:12345-0@lo:400:kworker.0 Request processed in 24us (3214us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760747.646690:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889
00000100:00100000:3.0:1789760747.646713:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890
00000100:00100000:3.0:1789760747.646718:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548755968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760747.646741:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548755968:12345-0@lo:400:kworker.0 Request processed in 24us (3136us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760747.646747:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890
00000100:00100000:3.0:1789760747.646755:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891
00000100:00100000:3.0:1789760747.646760:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548756480:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.646847:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892
00000100:00100000:1.0:1789760747.646858:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548755584:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760747.649035:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548756480:12345-0@lo:400:kworker.0 Request processed in 2266us (5382us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760747.649047:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891
00000100:00100000:1.0:1789760747.649079:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548755584:12345-0@lo:400:kworker.0 Request processed in 2222us (4061us total) trans 0 rc 0/0
00000100:00080000:3.0:1789760747.649084:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1789760747.649090:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892
00000100:00080000:3.0:1789760747.649092:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:3.0:1789760747.649096:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789760747.649137:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548755456
00000100:00100000:1.0:1789760747.649145:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548755456
00000100:00100000:1.0:1789760747.649182:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548755712
00000100:00100000:1.0:1789760747.649187:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548755712
00000100:00100000:1.0:1789760747.649202:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431
00000100:00100000:1.0:1789760747.649209:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548755456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.649396:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548755456:12345-0@lo:400:kworker.0 Request processed in 187us (5826us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760747.649403:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431
00000100:00100000:1.0:1789760747.649418:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432
00000100:00100000:1.0:1789760747.649425:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548755712:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.649455:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548755712:12345-0@lo:400:kworker.0 Request processed in 31us (4299us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760747.649461:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432
00000100:00100000:1.0:1789760747.649481:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548756096
00000100:00100000:1.0:1789760747.649485:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548756096
00000100:00100000:1.0:1789760747.649518:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548756608
00000100:00100000:1.0:1789760747.649522:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548756608
00000100:00100000:1.0:1789760747.649534:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548756224
00000100:00100000:1.0:1789760747.649537:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548756224
00000100:00100000:1.0:1789760747.649547:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548756736
00000100:00100000:1.0:1789760747.649549:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548756736
00000100:00100000:1.0:1789760747.649573:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286
00000100:00100000:1.0:1789760747.649578:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548756096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.649611:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548756096:12345-0@lo:400:kworker.0 Request processed in 33us (4540us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760747.649616:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286
00000100:00100000:1.0:1789760747.649628:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287
00000100:00100000:1.0:1789760747.649633:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548756608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.649660:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548756608:12345-0@lo:400:kworker.0 Request processed in 27us (4551us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760747.649666:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287
00000100:00100000:1.0:1789760747.649676:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288
00000100:00100000:1.0:1789760747.649756:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548756224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.649786:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548756224:12345-0@lo:400:kworker.0 Request processed in 105us (4591us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760747.649792:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288
00000100:00100000:1.0:1789760747.649805:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289
00000100:00100000:1.0:1789760747.649811:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548756736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.649837:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548756736:12345-0@lo:400:kworker.0 Request processed in 27us (4229us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760747.649843:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289
00000100:00100000:1.0:1789760747.649879:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548755200
00000100:00100000:1.0:1789760747.649883:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548755200
00000100:00100000:1.0:1789760747.649909:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473
00000100:00100000:1.0:1789760747.649916:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3454:x1876699548755200:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.649952:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3454:x1876699548755200:12345-0@lo:400:kworker.0 Request processed in 37us (7714us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760747.649958:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473
00000100:00100000:1.0:1789760747.649995:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda742dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548756992:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760747.650024:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760747.650059:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548756992
00000100:00100000:1.0:1789760747.650062:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548756992
00000100:00100000:1.0:1789760747.650083:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365
00000100:00100000:1.0:1789760747.650088:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548756992:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:1.0:1789760747.650102:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760747.650132:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548756992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (108us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760747.650138:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365
00000100:00080000:1.0:1789760747.650150:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789760747.650177:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda742dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548756992:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760747.650786:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8da94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548755456:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.650813:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc174ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548755968:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.650825:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548756480:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.650838:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8da94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548755328:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.650849:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc174f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548755840:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.650861:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6055880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548756352:0@lo:400:kworker.0
00000100:00100000:1.0:1789760747.650915:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8da95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548755200:0@lo:400:kworker.0
00000100:00100000:0.0:1789760747.654142:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8da96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548755584:0@lo:400:kworker.0
00000100:00100000:0.0:1789760747.654171:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc174f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548756096:0@lo:400:kworker.0
00000100:00100000:0.0:1789760747.654184:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548756608:0@lo:400:kworker.0
00000100:00100000:0.0:1789760747.654215:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc174c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548755712:0@lo:400:kworker.0
00000100:00100000:0.0:1789760747.654241:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc174e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548756224:0@lo:400:kworker.0
00000100:00100000:0.0:1789760747.654254:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548756736:0@lo:400:kworker.0
00000001:00080000:1.0:1789760747.661098:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972772 is committed
00002000:00010000:2.0:1789760747.664020:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22331392 -> 22335488
00010000:00010000:2.0:1789760747.664041:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.664054:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.664063:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.664071:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760747.664075:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.664085:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.664103:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.664111:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c7f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22331392->22335487] (req 22331392->22335487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760747.664260:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520957056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50279us (50506us total) trans 4294972772 rc 0/0
00000100:00100000:2.0:1789760747.664271:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5485
00000100:00100000:2.0:1789760747.664281:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719249962830 time 719300650091 state 0x2 ref 0
00000100:00100000:1.0:1789760747.668663:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760747.668792:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520957184
00000100:00100000:0.0:1789760747.668802:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520957184
00000100:00100000:0.0:1789760747.668853:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719249962830 time 719300650091 state 0x0 ref 1
00000100:00100000:0.0:1789760747.668869:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719300910507 time 719300650091 state 0x1 ref 1
00000100:00100000:0.0:1789760747.668900:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719300910507 time 719355582752 state 0x0 ref 1
00000100:00100000:0.0:1789760747.668914:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520957184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760747.668958:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22335488, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:0.0:1789760747.668967:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.668982:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:0.0:1789760747.668986:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760747.668992:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.669004:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760747.715049:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972773 is committed
00002000:00010000:1.0:1789760747.715117:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22335488 -> 22339584
00010000:00010000:1.0:1789760747.715139:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.715151:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.715160:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.715168:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760747.715173:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.715183:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.715200:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760747.715205:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c7fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22335488->22339583] (req 22335488->22339583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760747.715303:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520957184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46388us (46645us total) trans 4294972773 rc 0/0
00000100:00100000:1.0:1789760747.715575:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5486
00000100:00100000:1.0:1789760747.715585:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719300910507 time 719355582752 state 0x2 ref 0
00000100:00100000:0.0:1789760747.719926:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760747.720103:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520957312
00000100:00100000:2.0:1789760747.720114:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520957312
00000100:00100000:2.0:1789760747.720165:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719300910507 time 719355582752 state 0x0 ref 1
00000100:00100000:2.0:1789760747.720179:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719355843168 time 719355582752 state 0x1 ref 1
00000100:00100000:2.0:1789760747.720239:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719355843168 time 719406921390 state 0x0 ref 1
00000100:00100000:2.0:1789760747.720252:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520957312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760747.720300:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22339584, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:2.0:1789760747.720309:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.720350:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:2.0:1789760747.720355:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760747.720362:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.720375:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760747.768534:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22339584 -> 22343680
00010000:00010000:2.0:1789760747.768562:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.768585:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.768596:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.768604:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760747.768610:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.768621:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.768644:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.768651:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c803 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22339584->22343679] (req 22339584->22343679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760747.769185:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520957312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48925us (49258us total) trans 4294972774 rc 0/0
00000100:00100000:2.0:1789760747.769200:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5487
00000100:00100000:2.0:1789760747.769214:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719355843168 time 719406921390 state 0x2 ref 0
00000001:00080000:3.0:1789760747.769500:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972774 is committed
00000100:00100000:0.0:1789760747.771929:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760747.772025:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520957440
00000100:00100000:3.0:1789760747.772040:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520957440
00000100:00100000:3.0:1789760747.772113:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719355843168 time 719406921390 state 0x0 ref 1
00000100:00100000:3.0:1789760747.772133:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719407181806 time 719406921390 state 0x1 ref 1
00000100:00100000:3.0:1789760747.772171:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719407181806 time 719458852154 state 0x0 ref 1
00000100:00100000:3.0:1789760747.772189:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520957440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760747.772348:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22343680, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:3.0:1789760747.772360:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.772380:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:3.0:1789760747.772385:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760747.772393:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.772410:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760747.841688:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972775 is committed
00002000:00010000:3.0:1789760747.841817:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22343680 -> 22347776
00010000:00010000:3.0:1789760747.841840:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.841856:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.841867:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.841876:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760747.841884:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.841898:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.841927:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760747.841937:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c80a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22343680->22347775] (req 22343680->22347775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760747.842163:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520957440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 69968us (70241us total) trans 4294972775 rc 0/0
00000100:00100000:3.0:1789760747.842176:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5488
00000100:00100000:3.0:1789760747.842188:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719407181806 time 719458852154 state 0x2 ref 0
00000100:00100000:1.0:1789760747.845368:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760747.845466:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520957568
00000100:00100000:0.0:1789760747.845479:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520957568
00000100:00100000:0.0:1789760747.845557:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719407181806 time 719458852154 state 0x0 ref 1
00000100:00100000:0.0:1789760747.845577:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719459112570 time 719458852154 state 0x1 ref 1
00000100:00100000:0.0:1789760747.845617:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719459112570 time 719532298665 state 0x0 ref 1
00000100:00100000:0.0:1789760747.845632:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520957568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760747.845715:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22347776, mtime: 0x6aad94ec, atime: 0x0, ctime: 0x6aad94ec, blocks: 0xb007
00010000:00010000:0.0:1789760747.845726:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.845747:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:0.0:1789760747.845753:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760747.845761:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.845778:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760747.899608:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22347776 -> 22351872
00002000:00010000:2.0:1789760747.899622:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760748 -> 1789760749
00002000:00010000:2.0:1789760747.899625:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760748 -> 1789760749
00010000:00010000:2.0:1789760747.899643:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.899659:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.899670:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.899678:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760747.899684:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.899706:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.899734:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.899743:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c811 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22347776->22351871] (req 22347776->22351871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760747.899805:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972776 is committed
00000100:00100000:2.0:1789760747.899900:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520957568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54263us (54583us total) trans 4294972776 rc 0/0
00000100:00100000:2.0:1789760747.899914:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5489
00000100:00100000:2.0:1789760747.899925:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719459112570 time 719532298665 state 0x2 ref 0
00000100:00100000:1.0:1789760747.904607:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760747.904705:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520957696
00000100:00100000:0.0:1789760747.904723:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520957696
00000100:00100000:0.0:1789760747.904793:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719459112570 time 719532298665 state 0x0 ref 1
00000100:00100000:0.0:1789760747.904811:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719532559081 time 719532298665 state 0x1 ref 1
00000100:00100000:0.0:1789760747.904844:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719532559081 time 719591526213 state 0x0 ref 1
00000100:00100000:0.0:1789760747.904858:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520957696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760747.904923:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22351872, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:0.0:1789760747.904935:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.904954:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:0.0:1789760747.904959:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760747.904966:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.904983:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760747.943740:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22351872 -> 22355968
00010000:00010000:0.0:1789760747.943769:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.943785:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.943794:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.943802:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760747.943808:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.943817:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.943844:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760747.943852:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c818 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22351872->22355967] (req 22351872->22355967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760747.943978:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520957696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39114us (39378us total) trans 4294972777 rc 0/0
00000100:00100000:0.0:1789760747.943994:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5490
00000100:00100000:0.0:1789760747.944006:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719532559081 time 719591526213 state 0x2 ref 0
00000001:00080000:2.0:1789760747.944240:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972777 is committed
00000100:00100000:1.0:1789760747.958106:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760747.958523:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520957824
00000100:00100000:2.0:1789760747.958538:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520957824
00000100:00100000:2.0:1789760747.958613:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719532559081 time 719591526213 state 0x0 ref 1
00000100:00100000:2.0:1789760747.958632:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719591786629 time 719591526213 state 0x1 ref 1
00000100:00100000:2.0:1789760747.958725:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719591786629 time 719645406475 state 0x0 ref 1
00000100:00100000:2.0:1789760747.958740:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520957824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760747.958813:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22355968, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:2.0:1789760747.958825:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.958845:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:2.0:1789760747.958852:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760747.958860:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760747.958877:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760748.030382:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972778 is committed
00002000:00010000:2.0:1789760748.030559:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22355968 -> 22360064
00010000:00010000:2.0:1789760748.030582:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.030598:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.030619:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.030628:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760748.030633:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.030644:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.030668:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.030678:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c81f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22355968->22360063] (req 22355968->22360063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760748.030870:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520957824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 72125us (73183us total) trans 4294972778 rc 0/0
00000100:00100000:2.0:1789760748.030882:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5491
00000100:00100000:2.0:1789760748.030894:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719591786629 time 719645406475 state 0x2 ref 0
00000100:00100000:3.0:1789760748.036468:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760748.036540:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520957952
00000100:00100000:1.0:1789760748.036555:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520957952
00000100:00100000:1.0:1789760748.036798:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719591786629 time 719645406475 state 0x0 ref 1
00000100:00100000:1.0:1789760748.036818:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719645666891 time 719645406475 state 0x1 ref 1
00000100:00100000:1.0:1789760748.036902:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719645666891 time 719723583243 state 0x0 ref 1
00000100:00100000:1.0:1789760748.036927:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520957952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.036993:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22360064, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.037004:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.037025:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:1.0:1789760748.037030:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.037039:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.037055:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760748.037807:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:1.0:1789760748.079444:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972779 is committed
00002000:00010000:0.0:1789760748.079807:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22360064 -> 22364160
00010000:00010000:0.0:1789760748.079828:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.079844:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.079854:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.079862:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760748.079868:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.079879:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.079903:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.079913:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60c826 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22360064->22364159] (req 22360064->22364159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760748.080046:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520957952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43125us (43582us total) trans 4294972779 rc 0/0
00000100:00100000:0.0:1789760748.080059:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5492
00000100:00100000:0.0:1789760748.080071:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719645666891 time 719723583243 state 0x2 ref 0
00000100:00100000:1.0:1789760748.083716:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760748.083811:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520958080
00000100:00100000:0.0:1789760748.083824:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520958080
00000100:00100000:0.0:1789760748.083900:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719645666891 time 719723583243 state 0x0 ref 1
00000100:00100000:0.0:1789760748.083918:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719723843659 time 719723583243 state 0x1 ref 1
00000100:00100000:0.0:1789760748.083952:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719723843659 time 719770634472 state 0x0 ref 1
00000100:00100000:0.0:1789760748.083967:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520958080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.084030:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22364160, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:0.0:1789760748.084042:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.084062:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:0.0:1789760748.084066:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.084074:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.084090:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.091866:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760748.128705:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972780 is committed
00002000:00010000:0.0:1789760748.128858:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22364160 -> 22368256
00010000:00010000:0.0:1789760748.128879:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.128895:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.128906:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.128914:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760748.128921:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.128930:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.128953:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.128962:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c82d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22364160->22368255] (req 22364160->22368255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760748.129114:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520958080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45143us (45404us total) trans 4294972780 rc 0/0
00000100:00100000:0.0:1789760748.129127:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5493
00000100:00100000:0.0:1789760748.129144:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719723843659 time 719770634472 state 0x2 ref 0
00000100:00100000:1.0:1789760748.132191:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760748.134423:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520958208
00000100:00100000:0.0:1789760748.134445:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520958208
00000100:00100000:0.0:1789760748.134536:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719723843659 time 719770634472 state 0x0 ref 1
00000100:00100000:0.0:1789760748.134737:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719770894888 time 719770634472 state 0x1 ref 1
00000100:00100000:1.0:1789760748.134877:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719770894888 time 719821555298 state 0x0 ref 1
00000100:00100000:1.0:1789760748.134896:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520958208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.134968:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22368256, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.134980:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.135003:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:1.0:1789760748.135009:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.135017:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.135106:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760748.173275:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972781 is committed
00002000:00010000:2.0:1789760748.173479:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22368256 -> 22372352
00010000:00010000:2.0:1789760748.173502:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.173517:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.173528:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.173541:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760748.173547:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.173558:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.173584:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.173592:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60c834 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22368256->22372351] (req 22368256->22372351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760748.173723:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520958208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38825us (41539us total) trans 4294972781 rc 0/0
00000100:00100000:2.0:1789760748.173745:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5494
00000100:00100000:2.0:1789760748.173758:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719770894888 time 719821555298 state 0x2 ref 0
00000100:00100000:3.0:1789760748.180892:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760748.181133:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520958336
00000100:00100000:2.0:1789760748.181148:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520958336
00000100:00100000:2.0:1789760748.181222:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719770894888 time 719821555298 state 0x0 ref 1
00000100:00100000:2.0:1789760748.181242:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719821815714 time 719821555298 state 0x1 ref 1
00000100:00100000:2.0:1789760748.181278:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719821815714 time 719867960305 state 0x0 ref 1
00000100:00100000:2.0:1789760748.181291:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520958336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.181985:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22372352, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.182000:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.182070:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:1.0:1789760748.182076:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.182085:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.182103:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760748.222616:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972782 is committed
00002000:00010000:1.0:1789760748.222788:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22372352 -> 22376448
00010000:00010000:1.0:1789760748.222809:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.222825:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.222836:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.222845:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.222851:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.222862:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.222890:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.222897:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c83b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22372352->22376447] (req 22372352->22376447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.223031:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520958336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41733us (42145us total) trans 4294972782 rc 0/0
00000100:00100000:1.0:1789760748.223045:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5495
00000100:00100000:1.0:1789760748.223058:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719821815714 time 719867960305 state 0x2 ref 0
00000100:00100000:2.0:1789760748.226953:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760748.227068:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520958464
00000100:00100000:1.0:1789760748.227081:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520958464
00000100:00100000:0.0:1789760748.228543:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719821815714 time 719867960305 state 0x0 ref 1
00000100:00100000:0.0:1789760748.228565:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719868220721 time 719867960305 state 0x1 ref 1
00000100:00100000:0.0:1789760748.228650:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719868220721 time 719915330257 state 0x0 ref 1
00000100:00100000:0.0:1789760748.228666:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520958464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.228754:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22376448, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:0.0:1789760748.228766:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.228904:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:0.0:1789760748.228910:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.228918:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.228945:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760748.275820:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22376448 -> 22380544
00010000:00010000:0.0:1789760748.275850:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.275866:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.275876:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.275884:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760748.275889:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.275899:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.275923:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.275932:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c842 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22376448->22380543] (req 22376448->22380543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760748.276059:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520958464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47389us (49116us total) trans 4294972783 rc 0/0
00000100:00100000:0.0:1789760748.276072:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5496
00000100:00100000:0.0:1789760748.276083:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719868220721 time 719915330257 state 0x2 ref 0
00000001:00080000:1.0:1789760748.277294:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972783 is committed
00000100:00100000:0.0:1789760748.282203:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760748.282413:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520958592
00000100:00100000:1.0:1789760748.282426:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520958592
00000100:00100000:1.0:1789760748.282501:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719868220721 time 719915330257 state 0x0 ref 1
00000100:00100000:1.0:1789760748.282522:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719915590673 time 719915330257 state 0x1 ref 1
00000100:00100000:1.0:1789760748.282612:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719915590673 time 719969292579 state 0x0 ref 1
00000100:00100000:1.0:1789760748.282628:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520958592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.282705:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22380544, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.282716:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.282735:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=719s v=(0 0)
00010000:00010000:1.0:1789760748.282740:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.282758:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.282781:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760748.330838:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22380544 -> 22384640
00010000:00010000:1.0:1789760748.330864:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.330881:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.330892:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.330901:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.330906:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.330917:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.330943:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.330951:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60c849 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22380544->22384639] (req 22380544->22384639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.331078:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520958592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48447us (48883us total) trans 4294972784 rc 0/0
00000100:00100000:1.0:1789760748.331090:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5497
00000100:00100000:1.0:1789760748.331102:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719915590673 time 719969292579 state 0x2 ref 0
00000001:00080000:2.0:1789760748.331981:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972784 is committed
00000100:00100000:3.0:1789760748.338862:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760748.340753:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520958720
00000100:00100000:2.0:1789760748.340775:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520958720
00000100:00100000:2.0:1789760748.340945:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719915590673 time 719969292579 state 0x0 ref 1
00000100:00100000:2.0:1789760748.341517:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719969552995 time 719969292579 state 0x1 ref 1
00000100:00100000:0.0:1789760748.341608:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719969552995 time 720028285349 state 0x0 ref 1
00000100:00100000:0.0:1789760748.341632:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520958720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.341718:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22384640, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:0.0:1789760748.341728:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.341875:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:0.0:1789760748.341882:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.341890:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.341907:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760748.405642:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22384640 -> 22388736
00010000:00010000:0.0:1789760748.405667:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.405698:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.405709:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.405718:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760748.405724:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.405735:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.405761:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.405769:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c850 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22384640->22388735] (req 22384640->22388735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760748.405894:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520958720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64263us (67038us total) trans 4294972785 rc 0/0
00000100:00100000:0.0:1789760748.405907:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5498
00000100:00100000:0.0:1789760748.405919:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719969552995 time 720028285349 state 0x2 ref 0
00000001:00080000:2.0:1789760748.406797:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972785 is committed
00000100:00100000:0.0:1789760748.411546:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760748.413667:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520958848
00000100:00100000:1.0:1789760748.413697:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520958848
00000100:00100000:1.0:1789760748.413786:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 719969552995 time 720028285349 state 0x0 ref 1
00000100:00100000:1.0:1789760748.413807:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720028545765 time 720028285349 state 0x1 ref 1
00000100:00100000:1.0:1789760748.413907:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720028545765 time 720100588270 state 0x0 ref 1
00000100:00100000:1.0:1789760748.413923:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520958848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.413998:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22388736, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.414011:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.414032:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:1.0:1789760748.414037:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.414045:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.414062:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760748.461560:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972786 is committed
00002000:00010000:1.0:1789760748.461641:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22388736 -> 22392832
00010000:00010000:1.0:1789760748.461661:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.461675:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.461684:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.461702:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.461707:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.461717:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.461741:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.461994:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c857 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22388736->22392831] (req 22388736->22392831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.462151:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520958848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48225us (50613us total) trans 4294972786 rc 0/0
00000100:00100000:1.0:1789760748.462166:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5499
00000100:00100000:1.0:1789760748.462178:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720028545765 time 720100588270 state 0x2 ref 0
00000100:00100000:1.0:1789760748.466612:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760748.466847:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520958976
00000100:00100000:0.0:1789760748.466861:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520958976
00000100:00100000:0.0:1789760748.466934:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720028545765 time 720100588270 state 0x0 ref 1
00000100:00100000:0.0:1789760748.466954:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720100848686 time 720100588270 state 0x1 ref 1
00000100:00100000:0.0:1789760748.467155:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720100848686 time 720153835241 state 0x0 ref 1
00000100:00100000:0.0:1789760748.467170:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520958976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.467247:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22392832, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:0.0:1789760748.467258:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.467279:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:0.0:1789760748.467284:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.467291:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.467308:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760748.499609:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22392832 -> 22396928
00010000:00010000:2.0:1789760748.499639:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.499655:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.499666:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.499675:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760748.499681:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.499706:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.499731:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.499739:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c85e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22392832->22396927] (req 22392832->22396927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760748.499859:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520958976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32685us (33255us total) trans 4294972787 rc 0/0
00000100:00100000:2.0:1789760748.499871:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5500
00000100:00100000:2.0:1789760748.499884:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720100848686 time 720153835241 state 0x2 ref 0
00000001:00080000:3.0:1789760748.500645:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972787 is committed
00000100:00100000:3.0:1789760748.506435:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760748.506585:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520959104
00000100:00100000:0.0:1789760748.506599:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520959104
00000100:00100000:0.0:1789760748.506668:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720100848686 time 720153835241 state 0x0 ref 1
00000100:00100000:0.0:1789760748.506697:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720154095657 time 720153835241 state 0x1 ref 1
00000100:00100000:0.0:1789760748.506761:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720154095657 time 720193442881 state 0x0 ref 1
00000100:00100000:0.0:1789760748.506775:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520959104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.506834:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22396928, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:0.0:1789760748.506844:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.506863:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:0.0:1789760748.506868:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.506875:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.506890:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760748.543946:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972788 is committed
00002000:00010000:1.0:1789760748.544087:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22396928 -> 22401024
00010000:00010000:1.0:1789760748.544108:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.544124:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.544134:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.544143:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.544150:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.544160:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.544185:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.544193:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c865 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22396928->22401023] (req 22396928->22401023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.544581:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520959104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37798us (38152us total) trans 4294972788 rc 0/0
00000100:00100000:1.0:1789760748.544595:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5501
00000100:00100000:1.0:1789760748.544607:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720154095657 time 720193442881 state 0x2 ref 0
00000100:00100000:0.0:1789760748.552094:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760748.552400:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520959232
00000100:00100000:1.0:1789760748.552418:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520959232
00000100:00100000:1.0:1789760748.552515:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720154095657 time 720193442881 state 0x0 ref 1
00000100:00100000:1.0:1789760748.552536:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720193703297 time 720193442881 state 0x1 ref 1
00000100:00100000:1.0:1789760748.553220:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720193703297 time 720239895833 state 0x0 ref 1
00000100:00100000:1.0:1789760748.553361:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520959232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.553444:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22401024, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.553456:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.553478:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:1.0:1789760748.553484:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.553493:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.553513:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760748.605660:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972789 is committed
00002000:00010000:1.0:1789760748.605837:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22401024 -> 22405120
00010000:00010000:1.0:1789760748.605859:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.605875:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.605886:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.605895:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.605901:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.605911:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.605936:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.605945:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c86c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22401024->22405119] (req 22401024->22405119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.606107:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520959232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52862us (54013us total) trans 4294972789 rc 0/0
00000100:00100000:1.0:1789760748.606123:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5502
00000100:00100000:1.0:1789760748.606135:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720193703297 time 720239895833 state 0x2 ref 0
00000100:00100000:0.0:1789760748.612779:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760748.612888:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520959360
00000100:00100000:1.0:1789760748.612901:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520959360
00000100:00100000:1.0:1789760748.612978:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720193703297 time 720239895833 state 0x0 ref 1
00000100:00100000:1.0:1789760748.612997:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720240156249 time 720239895833 state 0x1 ref 1
00000100:00100000:1.0:1789760748.613035:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720240156249 time 720299717412 state 0x0 ref 1
00000100:00100000:1.0:1789760748.613050:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520959360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.613113:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22405120, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.613125:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.613145:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:1.0:1789760748.613151:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.613160:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.613177:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760748.666534:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22405120 -> 22409216
00010000:00010000:1.0:1789760748.666562:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.666577:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.666588:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.666596:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.666601:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.666611:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.666634:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.666641:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c873 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22405120->22409215] (req 22405120->22409215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.666763:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520959360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53708us (53998us total) trans 4294972790 rc 0/0
00000100:00100000:1.0:1789760748.666776:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5503
00000100:00100000:1.0:1789760748.666789:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720240156249 time 720299717412 state 0x2 ref 0
00000001:00080000:0.0:1789760748.667199:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972790 is committed
00000100:00100000:3.0:1789760748.673868:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760748.676524:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520959488
00000100:00100000:2.0:1789760748.676809:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520959488
00000100:00100000:2.0:1789760748.676917:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720240156249 time 720299717412 state 0x0 ref 1
00000100:00100000:2.0:1789760748.676937:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720299977828 time 720299717412 state 0x1 ref 1
00000100:00100000:2.0:1789760748.676980:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720299977828 time 720363662272 state 0x0 ref 1
00000100:00100000:2.0:1789760748.677000:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520959488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760748.677072:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22409216, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:2.0:1789760748.677368:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.677391:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:2.0:1789760748.677397:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760748.677406:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.677424:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760748.715574:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972791 is committed
00002000:00010000:2.0:1789760748.715808:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22409216 -> 22413312
00010000:00010000:2.0:1789760748.715833:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.715848:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.715858:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.715866:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760748.715871:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.715881:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.715904:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.715913:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c87a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22409216->22413311] (req 22409216->22413311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760748.716032:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520959488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39030us (43579us total) trans 4294972791 rc 0/0
00000100:00100000:2.0:1789760748.716045:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5504
00000100:00100000:2.0:1789760748.716056:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720299977828 time 720363662272 state 0x2 ref 0
00000100:00100000:2.0:1789760748.718569:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760748.718615:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520959616
00000100:00100000:0.0:1789760748.718627:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520959616
00000100:00100000:0.0:1789760748.718783:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720299977828 time 720363662272 state 0x0 ref 1
00000100:00100000:0.0:1789760748.718799:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720363922688 time 720363662272 state 0x1 ref 1
00000100:00100000:0.0:1789760748.718829:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720363922688 time 720405511616 state 0x0 ref 1
00000100:00100000:0.0:1789760748.718844:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520959616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.718904:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22413312, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:0.0:1789760748.718914:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.718931:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:0.0:1789760748.718935:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.718940:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.718952:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760748.755563:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972792 is committed
00002000:00010000:1.0:1789760748.755793:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22413312 -> 22417408
00010000:00010000:1.0:1789760748.755814:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.755829:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.755840:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.755848:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.755854:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.755865:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.755888:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.755896:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60c881 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22413312->22417407] (req 22413312->22417407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.756044:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520959616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37196us (37481us total) trans 4294972792 rc 0/0
00000100:00100000:1.0:1789760748.756057:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5505
00000100:00100000:1.0:1789760748.756069:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720363922688 time 720405511616 state 0x2 ref 0
00000100:00100000:0.0:1789760748.763055:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760748.764210:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520959744
00000100:00100000:1.0:1789760748.764230:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520959744
00000100:00100000:1.0:1789760748.764326:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720363922688 time 720405511616 state 0x0 ref 1
00000100:00100000:1.0:1789760748.764348:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720405772032 time 720405511616 state 0x1 ref 1
00000100:00100000:1.0:1789760748.764445:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720405772032 time 720451126096 state 0x0 ref 1
00000100:00100000:1.0:1789760748.764460:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520959744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.764542:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22417408, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.764553:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.764580:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:1.0:1789760748.764585:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.764593:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.764616:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760748.802594:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972793 is committed
00002000:00010000:1.0:1789760748.802866:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22417408 -> 22421504
00010000:00010000:1.0:1789760748.802887:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.802902:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.802914:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.802923:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.802929:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.802940:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.802965:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.802974:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60c888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22417408->22421503] (req 22417408->22421503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.803106:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520959744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38641us (40058us total) trans 4294972793 rc 0/0
00000100:00100000:1.0:1789760748.803748:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5506
00000100:00100000:1.0:1789760748.803761:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720405772032 time 720451126096 state 0x2 ref 0
00000100:00100000:3.0:1789760748.806892:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760748.806999:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520959872
00000100:00100000:1.0:1789760748.807013:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520959872
00000100:00100000:1.0:1789760748.807090:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720405772032 time 720451126096 state 0x0 ref 1
00000100:00100000:1.0:1789760748.807110:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720451386512 time 720451126096 state 0x1 ref 1
00000100:00100000:1.0:1789760748.807158:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720451386512 time 720493840805 state 0x0 ref 1
00000100:00100000:1.0:1789760748.807171:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520959872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760748.807245:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22421504, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:1.0:1789760748.807256:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.807274:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:1.0:1789760748.807279:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760748.807287:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.807303:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760748.852072:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22421504 -> 22425600
00010000:00010000:1.0:1789760748.852098:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.852115:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.852125:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.852134:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760748.852141:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.852152:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.852176:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760748.852184:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c88f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22421504->22425599] (req 22421504->22425599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760748.852470:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520959872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45143us (45438us total) trans 4294972794 rc 0/0
00000100:00100000:1.0:1789760748.852483:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5507
00000100:00100000:1.0:1789760748.852496:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720451386512 time 720493840805 state 0x2 ref 0
00000001:00080000:3.0:1789760748.852588:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972794 is committed
00000100:00100000:2.0:1789760748.856921:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760748.857025:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520960000
00000100:00100000:0.0:1789760748.857038:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520960000
00000100:00100000:0.0:1789760748.857109:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720451386512 time 720493840805 state 0x0 ref 1
00000100:00100000:0.0:1789760748.857130:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720494101221 time 720493840805 state 0x1 ref 1
00000100:00100000:0.0:1789760748.857197:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720494101221 time 720543879333 state 0x0 ref 1
00000100:00100000:0.0:1789760748.857220:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520960000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.857283:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22425600, mtime: 0x6aad94ed, atime: 0x0, ctime: 0x6aad94ed, blocks: 0xb007
00010000:00010000:0.0:1789760748.857295:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.857533:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:0.0:1789760748.857539:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.857547:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.857564:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760748.892990:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22425600 -> 22429696
00002000:00010000:0.0:1789760748.893002:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760749 -> 1789760750
00002000:00010000:0.0:1789760748.893006:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760749 -> 1789760750
00010000:00010000:0.0:1789760748.893024:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.893040:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.893050:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.893058:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760748.893064:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.893073:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.893106:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.893122:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60c896 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22425600->22429695] (req 22425600->22429695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760748.893250:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520960000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36033us (36335us total) trans 4294972795 rc 0/0
00000100:00100000:0.0:1789760748.893263:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5508
00000100:00100000:0.0:1789760748.893276:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720494101221 time 720543879333 state 0x2 ref 0
00000001:00080000:3.0:1789760748.893505:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972795 is committed
00000100:00100000:2.0:1789760748.896756:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760748.896854:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520960128
00000100:00100000:0.0:1789760748.896868:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520960128
00000100:00100000:0.0:1789760748.896944:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720494101221 time 720543879333 state 0x0 ref 1
00000100:00100000:0.0:1789760748.896961:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720544139749 time 720543879333 state 0x1 ref 1
00000100:00100000:0.0:1789760748.897001:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720544139749 time 720583683960 state 0x0 ref 1
00000100:00100000:0.0:1789760748.897015:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520960128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.897077:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22429696, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:0.0:1789760748.897088:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.897107:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:0.0:1789760748.897112:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.897131:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.897148:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760748.939373:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972796 is committed
00002000:00010000:2.0:1789760748.940269:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22429696 -> 22433792
00010000:00010000:2.0:1789760748.940292:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.940308:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.940355:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.940364:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760748.940370:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.940379:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.940405:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760748.940414:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60c89d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22429696->22433791] (req 22429696->22433791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760748.940930:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520960128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43908us (44180us total) trans 4294972796 rc 0/0
00000100:00100000:2.0:1789760748.940945:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5509
00000100:00100000:2.0:1789760748.940958:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720544139749 time 720583683960 state 0x2 ref 0
00000100:00100000:1.0:1789760748.946907:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760748.947240:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520960256
00000100:00100000:0.0:1789760748.947256:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520960256
00000100:00100000:0.0:1789760748.947365:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720544139749 time 720583683960 state 0x0 ref 1
00000100:00100000:0.0:1789760748.947383:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720583944376 time 720583683960 state 0x1 ref 1
00000100:00100000:0.0:1789760748.947416:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720583944376 time 720634098962 state 0x0 ref 1
00000100:00100000:0.0:1789760748.947429:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520960256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760748.947507:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22433792, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:0.0:1789760748.947518:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.947548:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:0.0:1789760748.947554:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760748.947563:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760748.947581:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760749.004513:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22433792 -> 22437888
00010000:00010000:0.0:1789760749.004547:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.004564:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.004575:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.004583:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760749.004589:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.004599:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.004625:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.004633:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22433792->22437887] (req 22433792->22437887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760749.004833:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520960256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57398us (57935us total) trans 4294972797 rc 0/0
00000100:00100000:0.0:1789760749.004851:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5510
00000100:00100000:0.0:1789760749.004864:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720583944376 time 720634098962 state 0x2 ref 0
00000001:00080000:2.0:1789760749.006128:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972797 is committed
00000100:00100000:0.0:1789760749.007302:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760749.007419:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520960384
00000100:00100000:2.0:1789760749.007433:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520960384
00000100:00100000:2.0:1789760749.007504:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720583944376 time 720634098962 state 0x0 ref 1
00000100:00100000:2.0:1789760749.007525:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720634359378 time 720634098962 state 0x1 ref 1
00000100:00100000:2.0:1789760749.007559:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720634359378 time 720694241286 state 0x0 ref 1
00000100:00100000:2.0:1789760749.007572:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520960384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760749.007639:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22437888, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:2.0:1789760749.007650:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.007671:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:2.0:1789760749.007677:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760749.007693:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.007719:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760749.077396:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972798 is committed
00002000:00010000:0.0:1789760749.077505:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22437888 -> 22441984
00010000:00010000:0.0:1789760749.077525:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.077540:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.077550:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.077558:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760749.077564:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.077574:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.077598:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.077721:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c8ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22437888->22441983] (req 22437888->22441983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760749.077916:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520960384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70337us (70616us total) trans 4294972798 rc 0/0
00000100:00100000:0.0:1789760749.077928:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5511
00000100:00100000:0.0:1789760749.077941:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720634359378 time 720694241286 state 0x2 ref 0
00000100:00100000:3.0:1789760749.082764:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760749.083093:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520960512
00000100:00100000:2.0:1789760749.083107:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520960512
00000100:00100000:2.0:1789760749.083186:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720634359378 time 720694241286 state 0x0 ref 1
00000100:00100000:2.0:1789760749.083206:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720694501702 time 720694241286 state 0x1 ref 1
00000100:00100000:2.0:1789760749.083385:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720694501702 time 720770065423 state 0x0 ref 1
00000100:00100000:2.0:1789760749.083402:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520960512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760749.083469:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22441984, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:2.0:1789760749.083480:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.083503:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:2.0:1789760749.083508:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760749.083516:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.083534:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.115358:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760749.131491:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972799 is committed
00002000:00010000:0.0:1789760749.131563:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22441984 -> 22446080
00010000:00010000:0.0:1789760749.131581:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.131597:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.131606:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.131614:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760749.131619:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.131628:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.131649:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.131663:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c8b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22441984->22446079] (req 22441984->22446079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760749.131772:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520960512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48370us (49020us total) trans 4294972799 rc 0/0
00000100:00100000:0.0:1789760749.131783:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5512
00000100:00100000:0.0:1789760749.131793:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720694501702 time 720770065423 state 0x2 ref 0
00000100:00100000:1.0:1789760749.135079:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760749.135362:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520960640
00000100:00100000:0.0:1789760749.135373:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520960640
00000100:00100000:0.0:1789760749.135432:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720694501702 time 720770065423 state 0x0 ref 1
00000100:00100000:0.0:1789760749.135613:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720770325839 time 720770065423 state 0x1 ref 1
00000100:00100000:2.0:1789760749.135716:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720770325839 time 720822396575 state 0x0 ref 1
00000100:00100000:2.0:1789760749.135731:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520960640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760749.135885:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22446080, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:2.0:1789760749.135892:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.135905:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:2.0:1789760749.135909:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760749.135913:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.135923:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760749.165725:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972800 is committed
00002000:00010000:2.0:1789760749.165833:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22446080 -> 22450176
00010000:00010000:2.0:1789760749.165850:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.165864:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.165873:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.165880:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760749.165885:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.165893:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.165927:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.165934:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22446080->22450175] (req 22446080->22450175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760749.166027:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520960640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30294us (30953us total) trans 4294972800 rc 0/0
00000100:00100000:2.0:1789760749.166037:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5513
00000100:00100000:2.0:1789760749.166046:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720770325839 time 720822396575 state 0x2 ref 0
00000100:00100000:2.0:1789760749.172164:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760749.172527:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520960768
00000100:00100000:0.0:1789760749.172537:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520960768
00000100:00100000:1.0:1789760749.172668:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720770325839 time 720822396575 state 0x0 ref 1
00000100:00100000:1.0:1789760749.172694:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720822656991 time 720822396575 state 0x1 ref 1
00000100:00100000:1.0:1789760749.172755:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720822656991 time 720859437821 state 0x0 ref 1
00000100:00100000:1.0:1789760749.172768:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520960768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760749.172820:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22450176, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:1.0:1789760749.172830:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.172846:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:1.0:1789760749.172851:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760749.172857:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.172871:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760749.212018:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972801 is committed
00002000:00010000:2.0:1789760749.212116:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22450176 -> 22454272
00010000:00010000:2.0:1789760749.212132:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.212145:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.212154:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.212161:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760749.212165:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.212175:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.212193:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.212340:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60c8c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22450176->22454271] (req 22450176->22454271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760749.212430:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520960768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39659us (40270us total) trans 4294972801 rc 0/0
00000100:00100000:2.0:1789760749.212440:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5514
00000100:00100000:2.0:1789760749.212448:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720822656991 time 720859437821 state 0x2 ref 0
00000100:00100000:3.0:1789760749.219208:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760749.219299:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520960896
00000100:00100000:0.0:1789760749.219310:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520960896
00000100:00100000:0.0:1789760749.219397:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720822656991 time 720859437821 state 0x0 ref 1
00000100:00100000:0.0:1789760749.219414:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720859698237 time 720859437821 state 0x1 ref 1
00000100:00100000:0.0:1789760749.219439:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720859698237 time 720906122208 state 0x0 ref 1
00000100:00100000:0.0:1789760749.219452:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520960896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760749.219502:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22454272, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:0.0:1789760749.219511:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.219527:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=720s v=(0 0)
00010000:00010000:0.0:1789760749.219532:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760749.219538:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.219551:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760749.312625:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972802 is committed
00002000:00010000:2.0:1789760749.312730:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22454272 -> 22458368
00010000:00010000:2.0:1789760749.312763:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.312776:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.312785:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.312793:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760749.312798:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.312807:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.312831:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.312840:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60c8c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22454272->22458367] (req 22454272->22458367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760749.312933:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520960896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 93478us (93741us total) trans 4294972802 rc 0/0
00000100:00100000:2.0:1789760749.312943:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5515
00000100:00100000:2.0:1789760749.312954:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720859698237 time 720906122208 state 0x2 ref 0
00000100:00100000:3.0:1789760749.322936:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760749.323063:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520961024
00000100:00100000:0.0:1789760749.323072:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520961024
00000100:00100000:0.0:1789760749.323128:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720859698237 time 720906122208 state 0x0 ref 1
00000100:00100000:0.0:1789760749.323144:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720906382624 time 720906122208 state 0x1 ref 1
00000100:00100000:0.0:1789760749.323179:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720906382624 time 721009861073 state 0x0 ref 1
00000100:00100000:0.0:1789760749.323192:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760749.323402:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22458368, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:0.0:1789760749.323412:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.323427:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:0.0:1789760749.323433:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760749.323439:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.323456:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760749.385600:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972803 is committed
00002000:00010000:2.0:1789760749.386422:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22458368 -> 22462464
00010000:00010000:2.0:1789760749.386440:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.386454:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.386463:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.386471:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760749.386476:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.386484:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.386503:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.386510:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c8ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22458368->22462463] (req 22458368->22462463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760749.386674:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63479us (63744us total) trans 4294972803 rc 0/0
00000100:00100000:2.0:1789760749.386699:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5516
00000100:00100000:2.0:1789760749.386709:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720906382624 time 721009861073 state 0x2 ref 0
00000100:00100000:0.0:1789760749.393217:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760749.393346:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520961152
00000100:00100000:2.0:1789760749.393355:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520961152
00000100:00100000:2.0:1789760749.393410:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 720906382624 time 721009861073 state 0x0 ref 1
00000100:00100000:2.0:1789760749.393425:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721010121489 time 721009861073 state 0x1 ref 1
00000100:00100000:2.0:1789760749.393448:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721010121489 time 721080130995 state 0x0 ref 1
00000100:00100000:2.0:1789760749.393460:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760749.393509:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22462464, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:2.0:1789760749.393519:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.393534:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:2.0:1789760749.393538:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760749.393545:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.393570:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760749.459482:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972804 is committed
00002000:00010000:3.0:1789760749.459691:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22462464 -> 22466560
00010000:00010000:3.0:1789760749.459706:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.459719:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.459728:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.459736:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760749.459740:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.459750:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.459768:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.459776:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60c8d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22462464->22466559] (req 22462464->22466559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760749.459863:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66400us (66653us total) trans 4294972804 rc 0/0
00000100:00100000:3.0:1789760749.459874:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5517
00000100:00100000:3.0:1789760749.459883:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721010121489 time 721080130995 state 0x2 ref 0
00000100:00100000:2.0:1789760749.465122:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760749.465199:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520961280
00000100:00100000:1.0:1789760749.465216:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520961280
00000100:00100000:1.0:1789760749.465263:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721010121489 time 721080130995 state 0x0 ref 1
00000100:00100000:1.0:1789760749.465277:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721080391411 time 721080130995 state 0x1 ref 1
00000100:00100000:1.0:1789760749.465307:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721080391411 time 721151989647 state 0x0 ref 1
00000100:00100000:1.0:1789760749.465342:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520961280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760749.465385:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22466560, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:1.0:1789760749.465395:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.465410:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:1.0:1789760749.465415:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760749.465421:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.465434:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760749.500520:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22466560 -> 22470656
00010000:00010000:1.0:1789760749.500541:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.500554:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.500564:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.500572:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760749.500577:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.500586:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.500605:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.500612:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22466560->22470655] (req 22466560->22470655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760749.500732:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520961280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35386us (35612us total) trans 4294972805 rc 0/0
00000100:00100000:1.0:1789760749.500743:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5518
00000100:00100000:1.0:1789760749.500753:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721080391411 time 721151989647 state 0x2 ref 0
00000001:00080000:0.0:1789760749.501305:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972805 is committed
00000100:00100000:1.0:1789760749.504689:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760749.505091:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520961408
00000100:00100000:0.0:1789760749.505101:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520961408
00000100:00100000:0.0:1789760749.505152:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721080391411 time 721151989647 state 0x0 ref 1
00000100:00100000:0.0:1789760749.505166:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721152250063 time 721151989647 state 0x1 ref 1
00000100:00100000:0.0:1789760749.505190:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721152250063 time 721191872612 state 0x0 ref 1
00000100:00100000:0.0:1789760749.505202:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760749.505258:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22470656, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:0.0:1789760749.505267:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.505282:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:0.0:1789760749.505286:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760749.505291:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.505305:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760749.532206:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972806 is committed
00002000:00010000:0.0:1789760749.532455:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22470656 -> 22474752
00010000:00010000:0.0:1789760749.532472:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.532486:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.532496:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.532503:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760749.532507:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.532516:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.532535:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.532542:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60c8e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22470656->22474751] (req 22470656->22474751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760749.532783:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27577us (28109us total) trans 4294972806 rc 0/0
00000100:00100000:0.0:1789760749.532797:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5519
00000100:00100000:0.0:1789760749.532807:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721152250063 time 721191872612 state 0x2 ref 0
00000100:00100000:2.0:1789760749.536577:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760749.536663:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520961536
00000100:00100000:0.0:1789760749.536672:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520961536
00000100:00100000:0.0:1789760749.536862:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721152250063 time 721191872612 state 0x0 ref 1
00000100:00100000:0.0:1789760749.536877:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721192133028 time 721191872612 state 0x1 ref 1
00000100:00100000:0.0:1789760749.536989:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721192133028 time 721223670419 state 0x0 ref 1
00000100:00100000:0.0:1789760749.537003:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520961536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760749.537052:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22474752, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:0.0:1789760749.537061:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.537078:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:0.0:1789760749.537082:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760749.537088:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.537103:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760749.575859:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972807 is committed
00002000:00010000:1.0:1789760749.576088:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22474752 -> 22478848
00010000:00010000:1.0:1789760749.576109:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.576121:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.576131:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.576139:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760749.576144:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.576153:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.576171:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.576183:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c8ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22474752->22478847] (req 22474752->22478847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760749.576404:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520961536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39400us (39833us total) trans 4294972807 rc 0/0
00000100:00100000:1.0:1789760749.576415:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5520
00000100:00100000:1.0:1789760749.576424:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721192133028 time 721223670419 state 0x2 ref 0
00000100:00100000:2.0:1789760749.580760:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760749.580834:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520961664
00000100:00100000:3.0:1789760749.580844:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520961664
00000100:00100000:3.0:1789760749.580905:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721192133028 time 721223670419 state 0x0 ref 1
00000100:00100000:3.0:1789760749.580920:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721223930835 time 721223670419 state 0x1 ref 1
00000100:00100000:3.0:1789760749.580948:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721223930835 time 721267630620 state 0x0 ref 1
00000100:00100000:3.0:1789760749.580960:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520961664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760749.581007:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22478848, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:3.0:1789760749.581017:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.581033:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:3.0:1789760749.581037:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760749.581043:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.581058:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760749.611758:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972808 is committed
00002000:00010000:3.0:1789760749.611852:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22478848 -> 22482944
00010000:00010000:3.0:1789760749.611868:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.611881:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.611890:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.611960:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760749.611965:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.611975:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.611994:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.612002:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c8f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22478848->22482943] (req 22478848->22482943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760749.612098:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+6:2405:x1876699520961664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31135us (31344us total) trans 4294972808 rc 0/0
00000100:00100000:3.0:1789760749.612109:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5521
00000100:00100000:3.0:1789760749.612119:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721223930835 time 721267630620 state 0x2 ref 0
00000100:00100000:2.0:1789760749.616881:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760749.617043:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520961792
00000100:00100000:1.0:1789760749.617053:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520961792
00000100:00100000:1.0:1789760749.617107:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721223930835 time 721267630620 state 0x0 ref 1
00000100:00100000:1.0:1789760749.617122:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721267891036 time 721267630620 state 0x1 ref 1
00000100:00100000:1.0:1789760749.617206:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721267891036 time 721303886438 state 0x0 ref 1
00000100:00100000:1.0:1789760749.617219:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760749.617264:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22482944, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:1.0:1789760749.617273:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.617288:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:1.0:1789760749.617292:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760749.617298:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.617356:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760749.648028:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972809 is committed
00002000:00010000:3.0:1789760749.648133:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22482944 -> 22487040
00010000:00010000:3.0:1789760749.648148:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.648160:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.648169:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.648177:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760749.648181:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.648189:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.648270:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.648285:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c8f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22482944->22487039] (req 22482944->22487039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760749.648405:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31185us (31529us total) trans 4294972809 rc 0/0
00000100:00100000:3.0:1789760749.648417:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5522
00000100:00100000:3.0:1789760749.648426:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721267891036 time 721303886438 state 0x2 ref 0
00000100:00100000:3.0:1789760749.651802:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760749.651996:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520961920
00000100:00100000:0.0:1789760749.652006:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520961920
00000100:00100000:0.0:1789760749.652060:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721267891036 time 721303886438 state 0x0 ref 1
00000100:00100000:0.0:1789760749.652073:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721304146854 time 721303886438 state 0x1 ref 1
00000100:00100000:0.0:1789760749.652103:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721304146854 time 721338785367 state 0x0 ref 1
00000100:00100000:0.0:1789760749.652117:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760749.652163:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22487040, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:0.0:1789760749.652172:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.652186:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:0.0:1789760749.652189:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760749.652195:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760749.652208:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760749.686140:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972810 is committed
00002000:00010000:3.0:1789760749.686237:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22487040 -> 22491136
00010000:00010000:3.0:1789760749.686252:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.686265:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.686274:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.686282:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760749.686286:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.686297:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.686445:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.686453:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c8ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22487040->22491135] (req 22487040->22491135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760749.686533:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520961920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34416us (34735us total) trans 4294972810 rc 0/0
00000100:00100000:3.0:1789760749.686543:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5523
00000100:00100000:3.0:1789760749.686552:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721304146854 time 721338785367 state 0x2 ref 0
00000100:00100000:0.0:1789760749.689766:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760749.689970:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520962048
00000100:00100000:2.0:1789760749.689980:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520962048
00000100:00100000:2.0:1789760749.690030:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721304146854 time 721338785367 state 0x0 ref 1
00000100:00100000:2.0:1789760749.690044:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721339045783 time 721338785367 state 0x1 ref 1
00000100:00100000:2.0:1789760749.690070:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721339045783 time 721376753563 state 0x0 ref 1
00000100:00100000:2.0:1789760749.690081:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520962048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760749.690123:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22491136, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:2.0:1789760749.690131:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.690147:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:2.0:1789760749.690151:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760749.690156:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.690170:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760749.714885:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972811 is committed
00002000:00010000:3.0:1789760749.715126:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22491136 -> 22495232
00010000:00010000:3.0:1789760749.715143:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.715158:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.715168:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.715175:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760749.715181:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.715245:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.715266:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.715274:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60c906 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22491136->22495231] (req 22491136->22495231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760749.715407:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520962048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25313us (25636us total) trans 4294972811 rc 0/0
00000100:00100000:3.0:1789760749.715419:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5524
00000100:00100000:3.0:1789760749.715429:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721339045783 time 721376753563 state 0x2 ref 0
00000100:00100000:2.0:1789760749.726508:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760749.726696:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520962176
00000100:00100000:3.0:1789760749.726706:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520962176
00000100:00100000:3.0:1789760749.726760:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721339045783 time 721376753563 state 0x0 ref 1
00000100:00100000:3.0:1789760749.726775:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721377013979 time 721376753563 state 0x1 ref 1
00000100:00100000:3.0:1789760749.726803:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721377013979 time 721413484749 state 0x0 ref 1
00000100:00100000:3.0:1789760749.726815:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520962176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760749.726860:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22495232, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:3.0:1789760749.726869:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.726885:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:3.0:1789760749.726890:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760749.727069:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.727086:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760749.765933:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972812 is committed
00002000:00010000:3.0:1789760749.766091:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22495232 -> 22499328
00010000:00010000:3.0:1789760749.766108:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.766121:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.766130:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.766137:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760749.766142:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.766150:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.766169:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.766178:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c90d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22495232->22499327] (req 22495232->22499327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760749.766280:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520962176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39463us (39778us total) trans 4294972812 rc 0/0
00000100:00100000:3.0:1789760749.766290:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5525
00000100:00100000:3.0:1789760749.766300:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721377013979 time 721413484749 state 0x2 ref 0
00000100:00100000:2.0:1789760749.776482:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760749.776654:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520962304
00000100:00100000:3.0:1789760749.776667:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520962304
00000100:00100000:3.0:1789760749.776749:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721377013979 time 721413484749 state 0x0 ref 1
00000100:00100000:3.0:1789760749.776767:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721413745165 time 721413484749 state 0x1 ref 1
00000100:00100000:3.0:1789760749.776806:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721413745165 time 721463487871 state 0x0 ref 1
00000100:00100000:3.0:1789760749.776822:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520962304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760749.776887:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22499328, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:3.0:1789760749.776898:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.776918:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:3.0:1789760749.776924:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760749.776931:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.776953:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760749.819227:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972813 is committed
00002000:00010000:1.0:1789760749.819546:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22499328 -> 22503424
00010000:00010000:1.0:1789760749.819569:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.819585:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.819596:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.819604:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760749.819611:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.819620:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.819642:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.819651:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60c914 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22499328->22503423] (req 22499328->22503423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760749.819785:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520962304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42960us (43311us total) trans 4294972813 rc 0/0
00000100:00100000:1.0:1789760749.819797:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5526
00000100:00100000:1.0:1789760749.819808:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721413745165 time 721463487871 state 0x2 ref 0
00000100:00100000:2.0:1789760749.822976:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760749.823145:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520962432
00000100:00100000:3.0:1789760749.823157:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520962432
00000100:00100000:3.0:1789760749.823291:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721413745165 time 721463487871 state 0x0 ref 1
00000100:00100000:3.0:1789760749.823506:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721463748287 time 721463487871 state 0x1 ref 1
00000100:00100000:3.0:1789760749.823589:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721463748287 time 721510270789 state 0x0 ref 1
00000100:00100000:3.0:1789760749.823607:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520962432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760749.823673:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22503424, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:3.0:1789760749.823694:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.823713:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:3.0:1789760749.823720:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760749.823728:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.823745:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760749.860616:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22503424 -> 22507520
00010000:00010000:2.0:1789760749.860645:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.860661:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.860671:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.860691:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760749.860697:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.860708:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.860734:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.860743:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60c91b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22503424->22507519] (req 22503424->22507519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760749.860895:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520962432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37284us (37926us total) trans 4294972814 rc 0/0
00000100:00100000:2.0:1789760749.860920:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5527
00000100:00100000:2.0:1789760749.860934:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721463748287 time 721510270789 state 0x2 ref 0
00000001:00080000:1.0:1789760749.862370:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972814 is committed
00000100:00100000:3.0:1789760749.870527:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760749.870654:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520962560
00000100:00100000:2.0:1789760749.870669:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520962560
00000100:00100000:2.0:1789760749.870753:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721463748287 time 721510270789 state 0x0 ref 1
00000100:00100000:2.0:1789760749.870772:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721510531205 time 721510270789 state 0x1 ref 1
00000100:00100000:2.0:1789760749.870808:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721510531205 time 721557489936 state 0x0 ref 1
00000100:00100000:2.0:1789760749.870823:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520962560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760749.870899:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22507520, mtime: 0x6aad94ee, atime: 0x0, ctime: 0x6aad94ee, blocks: 0xb007
00010000:00010000:2.0:1789760749.870911:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.870933:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:2.0:1789760749.870939:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760749.870948:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.870964:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760749.909200:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972815 is committed
00002000:00010000:3.0:1789760749.909455:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22507520 -> 22511616
00002000:00010000:3.0:1789760749.909461:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760750 -> 1789760751
00002000:00010000:3.0:1789760749.909464:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760750 -> 1789760751
00010000:00010000:3.0:1789760749.909484:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.909500:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.909511:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.909519:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760749.909525:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.909535:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.909561:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.909570:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60c922 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22507520->22511615] (req 22507520->22511615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760749.909714:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520962560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38887us (39196us total) trans 4294972815 rc 0/0
00000100:00100000:3.0:1789760749.909727:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5528
00000100:00100000:3.0:1789760749.909739:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721510531205 time 721557489936 state 0x2 ref 0
00000100:00100000:3.0:1789760749.913161:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760749.913438:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520962688
00000100:00100000:2.0:1789760749.913451:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520962688
00000100:00100000:2.0:1789760749.913524:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721510531205 time 721557489936 state 0x0 ref 1
00000100:00100000:2.0:1789760749.913543:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721557750352 time 721557489936 state 0x1 ref 1
00000100:00100000:2.0:1789760749.913615:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721557750352 time 721600296853 state 0x0 ref 1
00000100:00100000:2.0:1789760749.913630:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520962688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760749.913708:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22511616, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:2.0:1789760749.913720:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.913740:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:2.0:1789760749.913745:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760749.913753:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760749.913770:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760749.969588:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972816 is committed
00002000:00010000:3.0:1789760749.969649:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22511616 -> 22515712
00010000:00010000:3.0:1789760749.969665:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.969688:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.969698:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.969706:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760749.969711:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.969719:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.969735:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760749.969744:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60c929 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22511616->22515711] (req 22511616->22515711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760749.969831:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520962688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56198us (56678us total) trans 4294972816 rc 0/0
00000100:00100000:3.0:1789760749.969841:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5529
00000100:00100000:3.0:1789760749.969851:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721557750352 time 721600296853 state 0x2 ref 0
00000100:00100000:0.0:1789760749.981709:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760749.981911:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520962816
00000100:00100000:1.0:1789760749.981923:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520962816
00000100:00100000:1.0:1789760749.981978:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721557750352 time 721600296853 state 0x0 ref 1
00000100:00100000:1.0:1789760749.981994:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721600557269 time 721600296853 state 0x1 ref 1
00000100:00100000:1.0:1789760749.982019:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721600557269 time 721668702037 state 0x0 ref 1
00000100:00100000:1.0:1789760749.982032:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520962816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760749.982078:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22515712, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:1.0:1789760749.982087:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.982101:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:1.0:1789760749.982106:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760749.982113:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760749.982127:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760750.012849:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972817 is committed
00002000:00010000:1.0:1789760750.012947:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22515712 -> 22519808
00010000:00010000:1.0:1789760750.012963:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.012975:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.012984:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.012991:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760750.012995:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.013004:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.013023:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.013031:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60c930 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22515712->22519807] (req 22515712->22519807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760750.013133:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520962816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31098us (31428us total) trans 4294972817 rc 0/0
00000100:00100000:1.0:1789760750.013147:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5530
00000100:00100000:1.0:1789760750.013156:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721600557269 time 721668702037 state 0x2 ref 0
00000100:00100000:0.0:1789760750.023126:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760750.023717:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520962944
00000100:00100000:3.0:1789760750.023735:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520962944
00000100:00100000:3.0:1789760750.023845:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721600557269 time 721668702037 state 0x0 ref 1
00000100:00100000:3.0:1789760750.023867:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721668962453 time 721668702037 state 0x1 ref 1
00000100:00100000:3.0:1789760750.023904:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721668962453 time 721710585745 state 0x0 ref 1
00000100:00100000:3.0:1789760750.023923:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520962944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760750.023995:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22519808, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:3.0:1789760750.024007:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.024027:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:3.0:1789760750.024033:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760750.024042:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.024060:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760750.025628:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760750.084128:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972818 is committed
00002000:00010000:3.0:1789760750.084242:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22519808 -> 22523904
00010000:00010000:3.0:1789760750.084264:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.084280:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.084292:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.084300:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760750.085196:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.085217:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.085244:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.085253:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c937 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22519808->22523903] (req 22519808->22523903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760750.085599:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520962944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61673us (62474us total) trans 4294972818 rc 0/0
00000100:00100000:3.0:1789760750.085614:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5531
00000100:00100000:3.0:1789760750.085627:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721668962453 time 721710585745 state 0x2 ref 0
00000100:00100000:3.0:1789760750.091902:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760750.095497:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520963072
00000100:00100000:2.0:1789760750.095522:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520963072
00000100:00100000:2.0:1789760750.095613:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721668962453 time 721710585745 state 0x0 ref 1
00000100:00100000:2.0:1789760750.095634:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721710846161 time 721710585745 state 0x1 ref 1
00000100:00100000:2.0:1789760750.095682:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721710846161 time 721782356122 state 0x0 ref 1
00000100:00100000:2.0:1789760750.095701:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520963072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760750.095770:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22523904, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:2.0:1789760750.095783:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.095803:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:2.0:1789760750.095808:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760750.095815:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.095834:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.145200:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760750.199407:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972819 is committed
00002000:00010000:3.0:1789760750.199511:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22523904 -> 22528000
00010000:00010000:3.0:1789760750.199542:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.199557:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.199570:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.199579:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760750.199585:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.199595:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.199618:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.199628:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60c93e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22523904->22527999] (req 22523904->22527999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760750.199759:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520963072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 104056us (108457us total) trans 4294972819 rc 0/0
00000100:00100000:3.0:1789760750.199771:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5532
00000100:00100000:3.0:1789760750.199783:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721710846161 time 721782356122 state 0x2 ref 0
00000100:00100000:1.0:1789760750.202180:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789760750.202210:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548757120:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760750.202305:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760750.202629:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548757120
00000100:00100000:2.0:1789760750.202642:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548757120
00000100:00100000:2.0:1789760750.202718:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433
00000100:00100000:2.0:1789760750.202730:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548757120:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1789760750.202791:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:2.0:1789760750.202894:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548757120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (588us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760750.202902:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433
00000100:00100000:3.0:1789760750.203086:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548757120:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760750.205923:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760750.206115:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520963200
00000100:00100000:2.0:1789760750.206127:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520963200
00000100:00100000:2.0:1789760750.206191:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721710846161 time 721782356122 state 0x0 ref 1
00000100:00100000:2.0:1789760750.206209:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721782616538 time 721782356122 state 0x1 ref 1
00000100:00100000:2.0:1789760750.206239:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721782616538 time 721892922428 state 0x0 ref 1
00000100:00100000:2.0:1789760750.206252:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520963200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760750.206343:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22528000, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:2.0:1789760750.206354:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.206372:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:2.0:1789760750.206376:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760750.206383:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.206398:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760750.276283:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972820 is committed
00002000:00010000:3.0:1789760750.276585:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22528000 -> 22532096
00010000:00010000:3.0:1789760750.276609:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.276626:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.276637:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.276647:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760750.276653:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.276664:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.276704:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.276713:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60c945 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22528000->22532095] (req 22528000->22532095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760750.276848:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520963200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70589us (70931us total) trans 4294972820 rc 0/0
00000100:00100000:3.0:1789760750.276863:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5533
00000100:00100000:3.0:1789760750.276876:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721782616538 time 721892922428 state 0x2 ref 0
00000100:00100000:0.0:1789760750.282940:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760750.283021:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520963328
00000100:00100000:1.0:1789760750.283034:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520963328
00000100:00100000:1.0:1789760750.283111:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721782616538 time 721892922428 state 0x0 ref 1
00000100:00100000:1.0:1789760750.283132:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721893182844 time 721892922428 state 0x1 ref 1
00000100:00100000:1.0:1789760750.283169:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721893182844 time 721969850500 state 0x0 ref 1
00000100:00100000:1.0:1789760750.283183:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520963328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760750.283259:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22532096, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:1.0:1789760750.283276:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.283298:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=721s v=(0 0)
00010000:00010000:1.0:1789760750.283303:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760750.283311:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.283374:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760750.373066:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972821 is committed
00002000:00010000:0.0:1789760750.373283:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22532096 -> 22536192
00010000:00010000:0.0:1789760750.373305:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.373363:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.373374:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.373382:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760750.373388:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.373398:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.373428:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.373437:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60c94c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22532096->22536191] (req 22532096->22536191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760750.373557:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520963328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 90369us (90624us total) trans 4294972821 rc 0/0
00000100:00100000:0.0:1789760750.373570:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5534
00000100:00100000:0.0:1789760750.373584:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721893182844 time 721969850500 state 0x2 ref 0
00000100:00100000:2.0:1789760750.380710:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760750.380811:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520963456
00000100:00100000:3.0:1789760750.380825:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520963456
00000100:00100000:3.0:1789760750.380909:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721893182844 time 721969850500 state 0x0 ref 1
00000100:00100000:3.0:1789760750.380927:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721970110916 time 721969850500 state 0x1 ref 1
00000100:00100000:3.0:1789760750.380965:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721970110916 time 722067647861 state 0x0 ref 1
00000100:00100000:3.0:1789760750.380978:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520963456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760750.381045:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22536192, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:3.0:1789760750.381056:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.381076:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:3.0:1789760750.381082:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760750.381090:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.381107:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760750.441028:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972822 is committed
00002000:00010000:1.0:1789760750.441073:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22536192 -> 22540288
00010000:00010000:1.0:1789760750.441094:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.441108:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.441118:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.441126:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760750.441133:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.441143:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.441167:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.441175:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60c953 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22536192->22540287] (req 22536192->22540287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760750.441406:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520963456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60423us (60705us total) trans 4294972822 rc 0/0
00000100:00100000:1.0:1789760750.441419:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5535
00000100:00100000:1.0:1789760750.441431:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721970110916 time 722067647861 state 0x2 ref 0
00000100:00100000:1.0:1789760750.445719:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760750.445877:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520963584
00000100:00100000:3.0:1789760750.445890:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520963584
00000100:00100000:3.0:1789760750.445964:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 721970110916 time 722067647861 state 0x0 ref 1
00000100:00100000:3.0:1789760750.445994:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722067908277 time 722067647861 state 0x1 ref 1
00000100:00100000:3.0:1789760750.446020:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722067908277 time 722132703398 state 0x0 ref 1
00000100:00100000:3.0:1789760750.446035:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520963584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760750.446098:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22540288, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:3.0:1789760750.446110:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.446128:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:3.0:1789760750.446133:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760750.446141:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.446158:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760750.491829:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972823 is committed
00002000:00010000:2.0:1789760750.492015:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22540288 -> 22544384
00010000:00010000:2.0:1789760750.492034:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.492049:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.492059:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.492068:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760750.492075:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.492085:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.492107:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.492115:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60c95a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22540288->22544383] (req 22540288->22544383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760750.492260:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520963584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46221us (46556us total) trans 4294972823 rc 0/0
00000100:00100000:2.0:1789760750.492273:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5536
00000100:00100000:2.0:1789760750.492285:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722067908277 time 722132703398 state 0x2 ref 0
00000100:00100000:1.0:1789760750.496025:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760750.496111:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520963712
00000100:00100000:2.0:1789760750.496123:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520963712
00000100:00100000:2.0:1789760750.496191:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722067908277 time 722132703398 state 0x0 ref 1
00000100:00100000:2.0:1789760750.496264:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722132963814 time 722132703398 state 0x1 ref 1
00000100:00100000:2.0:1789760750.496344:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722132963814 time 722183026459 state 0x0 ref 1
00000100:00100000:2.0:1789760750.496359:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520963712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760750.496418:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22544384, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:2.0:1789760750.496429:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.496448:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:2.0:1789760750.496454:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760750.496461:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.496477:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760750.539616:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972824 is committed
00002000:00010000:2.0:1789760750.539757:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22544384 -> 22548480
00010000:00010000:2.0:1789760750.539787:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.539803:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.539813:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.539821:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760750.539826:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.539836:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.539866:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.539875:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c961 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22544384->22548479] (req 22544384->22548479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760750.539999:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520963712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43636us (43979us total) trans 4294972824 rc 0/0
00000100:00100000:2.0:1789760750.540012:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5537
00000100:00100000:2.0:1789760750.540025:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722132963814 time 722183026459 state 0x2 ref 0
00000100:00100000:0.0:1789760750.543021:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760750.543149:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520963840
00000100:00100000:3.0:1789760750.543161:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520963840
00000100:00100000:3.0:1789760750.543243:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722132963814 time 722183026459 state 0x0 ref 1
00000100:00100000:3.0:1789760750.543260:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722183286875 time 722183026459 state 0x1 ref 1
00000100:00100000:3.0:1789760750.543294:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722183286875 time 722229977096 state 0x0 ref 1
00000100:00100000:3.0:1789760750.543345:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520963840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760750.543481:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22548480, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:0.0:1789760750.543494:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.543515:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:0.0:1789760750.543520:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760750.543528:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.543545:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760750.590282:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972825 is committed
00002000:00010000:0.0:1789760750.590393:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22548480 -> 22552576
00010000:00010000:0.0:1789760750.590413:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.590430:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.590440:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.590449:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760750.590455:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.590465:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.590490:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.590499:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60c968 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22548480->22552575] (req 22548480->22552575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760750.590633:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520963840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47319us (47618us total) trans 4294972825 rc 0/0
00000100:00100000:0.0:1789760750.590647:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5538
00000100:00100000:0.0:1789760750.590660:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722183286875 time 722229977096 state 0x2 ref 0
00000100:00100000:0.0:1789760750.594754:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760750.594871:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520963968
00000100:00100000:1.0:1789760750.594885:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520963968
00000100:00100000:1.0:1789760750.594972:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722183286875 time 722229977096 state 0x0 ref 1
00000100:00100000:1.0:1789760750.594992:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722230237512 time 722229977096 state 0x1 ref 1
00000100:00100000:1.0:1789760750.595032:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722230237512 time 722281713228 state 0x0 ref 1
00000100:00100000:1.0:1789760750.595047:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520963968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760750.595114:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22552576, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:1.0:1789760750.595126:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.595147:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:1.0:1789760750.595153:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760750.595161:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.595184:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760750.630983:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972826 is committed
00002000:00010000:1.0:1789760750.631110:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22552576 -> 22556672
00010000:00010000:1.0:1789760750.631131:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.631147:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.631158:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.631166:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760750.631173:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.631182:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.631219:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.631229:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60c96f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22552576->22556671] (req 22552576->22556671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760750.631392:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520963968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36340us (36645us total) trans 4294972826 rc 0/0
00000100:00100000:1.0:1789760750.631405:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5539
00000100:00100000:1.0:1789760750.631417:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722230237512 time 722281713228 state 0x2 ref 0
00000100:00100000:1.0:1789760750.634279:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760750.634532:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520964096
00000100:00100000:2.0:1789760750.634545:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520964096
00000100:00100000:2.0:1789760750.634620:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722230237512 time 722281713228 state 0x0 ref 1
00000100:00100000:2.0:1789760750.634638:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722281973644 time 722281713228 state 0x1 ref 1
00000100:00100000:2.0:1789760750.634730:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722281973644 time 722321410750 state 0x0 ref 1
00000100:00100000:2.0:1789760750.634745:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520964096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760750.634818:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22556672, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:2.0:1789760750.634830:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.634850:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:2.0:1789760750.634855:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760750.634863:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.634879:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760750.679087:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972827 is committed
00002000:00010000:0.0:1789760750.679197:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22556672 -> 22560768
00010000:00010000:0.0:1789760750.679287:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.679303:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.679384:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.679396:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760750.679403:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.679415:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.679440:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.679449:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c976 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22556672->22560767] (req 22556672->22560767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760750.679623:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520964096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44873us (45351us total) trans 4294972827 rc 0/0
00000100:00100000:0.0:1789760750.679639:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5540
00000100:00100000:0.0:1789760750.679655:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722281973644 time 722321410750 state 0x2 ref 0
00000100:00100000:0.0:1789760750.683514:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760750.683635:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520964224
00000100:00100000:2.0:1789760750.683649:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520964224
00000100:00100000:2.0:1789760750.683729:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722281973644 time 722321410750 state 0x0 ref 1
00000100:00100000:2.0:1789760750.683748:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722321671166 time 722321410750 state 0x1 ref 1
00000100:00100000:2.0:1789760750.683891:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722321671166 time 722370570937 state 0x0 ref 1
00000100:00100000:2.0:1789760750.683908:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520964224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760750.683986:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22560768, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:2.0:1789760750.683997:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.684017:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:2.0:1789760750.684021:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760750.684029:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.684045:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760750.728272:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972828 is committed
00002000:00010000:2.0:1789760750.728650:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22560768 -> 22564864
00010000:00010000:2.0:1789760750.728682:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.728703:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.728713:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.728721:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760750.728728:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.728739:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.728772:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.728781:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c97d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22560768->22564863] (req 22560768->22564863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760750.729066:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520964224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45154us (45559us total) trans 4294972828 rc 0/0
00000100:00100000:2.0:1789760750.729083:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5541
00000100:00100000:2.0:1789760750.729095:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722321671166 time 722370570937 state 0x2 ref 0
00000100:00100000:1.0:1789760750.733512:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760750.733886:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520964352
00000100:00100000:0.0:1789760750.733899:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520964352
00000100:00100000:0.0:1789760750.733978:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722321671166 time 722370570937 state 0x0 ref 1
00000100:00100000:0.0:1789760750.733997:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722370831353 time 722370570937 state 0x1 ref 1
00000100:00100000:0.0:1789760750.734034:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722370831353 time 722420716228 state 0x0 ref 1
00000100:00100000:0.0:1789760750.734050:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520964352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760750.734120:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22564864, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:0.0:1789760750.734133:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.734153:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:0.0:1789760750.734158:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760750.734166:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.734183:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760750.780695:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22564864 -> 22568960
00010000:00010000:1.0:1789760750.780728:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.780744:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.780758:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.780767:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760750.780772:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.780781:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.780814:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.780823:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60c984 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22564864->22568959] (req 22564864->22568959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760750.781000:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972829 is committed
00000100:00100000:1.0:1789760750.781099:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520964352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47045us (47595us total) trans 4294972829 rc 0/0
00000100:00100000:1.0:1789760750.781112:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5542
00000100:00100000:1.0:1789760750.781125:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722370831353 time 722420716228 state 0x2 ref 0
00000100:00100000:1.0:1789760750.784437:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760750.784649:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520964480
00000100:00100000:3.0:1789760750.784662:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520964480
00000100:00100000:3.0:1789760750.784747:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722370831353 time 722420716228 state 0x0 ref 1
00000100:00100000:3.0:1789760750.784767:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722420976644 time 722420716228 state 0x1 ref 1
00000100:00100000:3.0:1789760750.784850:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722420976644 time 722471531516 state 0x0 ref 1
00000100:00100000:3.0:1789760750.784864:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520964480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760750.784940:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22568960, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:3.0:1789760750.784953:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.784973:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:3.0:1789760750.784978:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760750.784986:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.785006:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760750.824397:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22568960 -> 22573056
00010000:00010000:0.0:1789760750.824427:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.824442:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.824452:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.824460:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760750.824467:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.824477:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.824710:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.824720:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60c98b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22568960->22573055] (req 22568960->22573055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760750.825173:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972830 is committed
00000100:00100000:1.0:1789760750.825818:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520964480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40947us (41389us total) trans 4294972830 rc 0/0
00000100:00100000:1.0:1789760750.825833:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5543
00000100:00100000:1.0:1789760750.825845:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722420976644 time 722471531516 state 0x2 ref 0
00000100:00100000:0.0:1789760750.829987:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760750.830117:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520964608
00000100:00100000:2.0:1789760750.830130:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520964608
00000100:00100000:2.0:1789760750.830206:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722420976644 time 722471531516 state 0x0 ref 1
00000100:00100000:2.0:1789760750.830295:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722471791932 time 722471531516 state 0x1 ref 1
00000100:00100000:2.0:1789760750.830369:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722471791932 time 722517050091 state 0x0 ref 1
00000100:00100000:2.0:1789760750.830386:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520964608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760750.830451:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22573056, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:2.0:1789760750.830462:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.830579:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:2.0:1789760750.830585:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760750.830593:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.830610:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760750.880967:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972831 is committed
00002000:00010000:0.0:1789760750.881101:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22573056 -> 22577152
00010000:00010000:0.0:1789760750.881128:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.881143:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.881153:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.881162:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760750.881167:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.881177:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.881611:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760750.881621:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60c992 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22573056->22577151] (req 22573056->22577151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760750.881758:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520964608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51368us (51780us total) trans 4294972831 rc 0/0
00000100:00100000:0.0:1789760750.881771:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5544
00000100:00100000:0.0:1789760750.881783:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722471791932 time 722517050091 state 0x2 ref 0
00000100:00100000:2.0:1789760750.886694:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760750.886939:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520964736
00000100:00100000:3.0:1789760750.886954:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520964736
00000100:00100000:3.0:1789760750.887017:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722471791932 time 722517050091 state 0x0 ref 1
00000100:00100000:3.0:1789760750.887032:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722517310507 time 722517050091 state 0x1 ref 1
00000100:00100000:3.0:1789760750.887077:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722517310507 time 722573759294 state 0x0 ref 1
00000100:00100000:3.0:1789760750.887090:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520964736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760750.887138:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22577152, mtime: 0x6aad94ef, atime: 0x0, ctime: 0x6aad94ef, blocks: 0xb007
00010000:00010000:3.0:1789760750.887146:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.887161:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:3.0:1789760750.887165:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760750.887172:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760750.887185:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760750.922413:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972832 is committed
00002000:00010000:2.0:1789760750.922558:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22577152 -> 22581248
00002000:00010000:2.0:1789760750.922563:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760751 -> 1789760752
00002000:00010000:2.0:1789760750.922566:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760751 -> 1789760752
00010000:00010000:2.0:1789760750.922580:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.922594:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.922603:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.922611:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760750.922616:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.922625:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.922644:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.922651:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c999 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22577152->22581247] (req 22577152->22581247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760750.922800:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520964736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35708us (36127us total) trans 4294972832 rc 0/0
00000100:00100000:2.0:1789760750.922811:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5545
00000100:00100000:2.0:1789760750.922820:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722517310507 time 722573759294 state 0x2 ref 0
00000100:00100000:2.0:1789760750.928789:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760750.929240:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520964864
00000100:00100000:1.0:1789760750.929250:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520964864
00000100:00100000:1.0:1789760750.929305:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722517310507 time 722573759294 state 0x0 ref 1
00000100:00100000:1.0:1789760750.929353:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722574019710 time 722573759294 state 0x1 ref 1
00000100:00100000:1.0:1789760750.929384:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722574019710 time 722616066625 state 0x0 ref 1
00000100:00100000:1.0:1789760750.929396:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520964864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760750.929447:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22581248, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:1.0:1789760750.929467:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.929483:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:1.0:1789760750.929487:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760750.929710:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.929727:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760750.991954:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972833 is committed
00002000:00010000:2.0:1789760750.992065:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22581248 -> 22585344
00010000:00010000:2.0:1789760750.992086:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.992101:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.992111:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.992120:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760750.992126:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.992137:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.992162:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760750.992177:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60c9a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22581248->22585343] (req 22581248->22585343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760750.992618:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520964864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63216us (63843us total) trans 4294972833 rc 0/0
00000100:00100000:2.0:1789760750.992632:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5546
00000100:00100000:2.0:1789760750.992645:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722574019710 time 722616066625 state 0x2 ref 0
00000100:00100000:0.0:1789760750.996185:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760750.996572:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520964992
00000100:00100000:1.0:1789760750.996586:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520964992
00000100:00100000:1.0:1789760750.996660:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722574019710 time 722616066625 state 0x0 ref 1
00000100:00100000:1.0:1789760750.996687:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722616327041 time 722616066625 state 0x1 ref 1
00000100:00100000:1.0:1789760750.996751:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722616327041 time 722683432590 state 0x0 ref 1
00000100:00100000:1.0:1789760750.996765:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520964992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760750.996828:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22585344, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:1.0:1789760750.996840:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.996860:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:1.0:1789760750.996866:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760750.996873:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760750.996890:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760751.031517:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972834 is committed
00002000:00010000:3.0:1789760751.031722:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22585344 -> 22589440
00010000:00010000:3.0:1789760751.031743:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.031759:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.031770:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.031779:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.031786:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.031797:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.031823:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.031830:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22585344->22589439] (req 22585344->22589439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.031994:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520964992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35226us (35818us total) trans 4294972834 rc 0/0
00000100:00100000:3.0:1789760751.032008:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5547
00000100:00100000:3.0:1789760751.032020:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722616327041 time 722683432590 state 0x2 ref 0
00000100:00100000:2.0:1789760751.036681:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760751.036915:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520965120
00000100:00100000:0.0:1789760751.036928:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520965120
00000100:00100000:0.0:1789760751.036998:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722616327041 time 722683432590 state 0x0 ref 1
00000100:00100000:0.0:1789760751.037017:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722683693006 time 722683432590 state 0x1 ref 1
00000100:00100000:0.0:1789760751.037084:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722683693006 time 722723765707 state 0x0 ref 1
00000100:00100000:0.0:1789760751.037100:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520965120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760751.037165:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22589440, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:0.0:1789760751.037176:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.037268:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:0.0:1789760751.037274:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760751.037284:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.037483:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760751.079618:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972835 is committed
00002000:00010000:3.0:1789760751.079854:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22589440 -> 22593536
00010000:00010000:3.0:1789760751.079874:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.079890:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.079900:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.079909:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.079915:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.079926:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.079950:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.079959:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60c9ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22589440->22593535] (req 22589440->22593535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.080095:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520965120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42990us (43428us total) trans 4294972835 rc 0/0
00000100:00100000:3.0:1789760751.080107:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5548
00000100:00100000:3.0:1789760751.080120:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722683693006 time 722723765707 state 0x2 ref 0
00000100:00100000:2.0:1789760751.083942:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760751.084074:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520965248
00000100:00100000:0.0:1789760751.084089:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520965248
00000100:00100000:0.0:1789760751.084166:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722683693006 time 722723765707 state 0x0 ref 1
00000100:00100000:0.0:1789760751.084185:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722724026123 time 722723765707 state 0x1 ref 1
00000100:00100000:0.0:1789760751.084392:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722724026123 time 722771071647 state 0x0 ref 1
00000100:00100000:0.0:1789760751.084410:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520965248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760751.084484:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22593536, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:0.0:1789760751.084621:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.084645:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:0.0:1789760751.084650:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760751.084659:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.084692:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760751.120619:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972836 is committed
00002000:00010000:3.0:1789760751.120748:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22593536 -> 22597632
00010000:00010000:3.0:1789760751.120769:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.120787:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.120798:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.120806:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.120812:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.120823:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.120846:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.120860:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60c9b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22593536->22597631] (req 22593536->22597631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.120985:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520965248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36573us (37052us total) trans 4294972836 rc 0/0
00000100:00100000:3.0:1789760751.120998:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5549
00000100:00100000:3.0:1789760751.121011:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722724026123 time 722771071647 state 0x2 ref 0
00000100:00100000:0.0:1789760751.124706:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.124843:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520965376
00000100:00100000:2.0:1789760751.124857:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520965376
00000100:00100000:2.0:1789760751.124934:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722724026123 time 722771071647 state 0x0 ref 1
00000100:00100000:2.0:1789760751.124955:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722771332063 time 722771071647 state 0x1 ref 1
00000100:00100000:2.0:1789760751.125022:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722771332063 time 722811703036 state 0x0 ref 1
00000100:00100000:2.0:1789760751.125038:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520965376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760751.125104:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22597632, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:2.0:1789760751.125117:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.125152:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:2.0:1789760751.125158:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760751.125165:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.125182:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760751.161578:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760751.168745:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972837 is committed
00002000:00010000:3.0:1789760751.169039:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22597632 -> 22601728
00010000:00010000:3.0:1789760751.169061:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.169077:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.169087:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.169096:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.169102:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.169113:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.169149:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.169158:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60c9bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22597632->22601727] (req 22597632->22601727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.169609:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520965376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44564us (44907us total) trans 4294972837 rc 0/0
00000100:00100000:3.0:1789760751.169624:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5550
00000100:00100000:3.0:1789760751.169638:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722771332063 time 722811703036 state 0x2 ref 0
00000100:00100000:0.0:1789760751.173621:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760751.173722:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520965504
00000100:00100000:3.0:1789760751.173736:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520965504
00000100:00100000:3.0:1789760751.173814:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722771332063 time 722811703036 state 0x0 ref 1
00000100:00100000:3.0:1789760751.173833:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722811963452 time 722811703036 state 0x1 ref 1
00000100:00100000:3.0:1789760751.173868:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722811963452 time 722860550621 state 0x0 ref 1
00000100:00100000:3.0:1789760751.173882:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520965504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760751.173961:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22601728, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:3.0:1789760751.173972:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.173991:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:3.0:1789760751.173997:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760751.174004:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.174020:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760751.225351:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972838 is committed
00000100:00100000:0.0:1789760751.225674:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1789760751.225765:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda742fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548757248:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760751.225856:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00002000:00010000:3.0:1789760751.226234:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22601728 -> 22605824
00010000:00010000:3.0:1789760751.226256:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.226271:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.226282:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.226292:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.226307:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.226349:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.226376:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.226385:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22601728->22605823] (req 22601728->22605823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760751.227457:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520965504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53567us (53842us total) trans 4294972838 rc 0/0
00000100:00100000:0.0:1789760751.227473:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5551
00000100:00100000:0.0:1789760751.227486:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722811963452 time 722860550621 state 0x2 ref 0
00000100:00100000:1.0:1789760751.228609:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548757248
00000100:00100000:1.0:1789760751.228625:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548757248
00000100:00100000:1.0:1789760751.228865:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434
00000100:00100000:1.0:1789760751.228876:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548757248:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1789760751.228948:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:1.0:1789760751.229057:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548757248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (3200us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760751.229065:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434
00000100:00100000:0.0:1789760751.229145:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda742fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548757248:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1789760751.233433:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760751.233701:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520965632
00000100:00100000:3.0:1789760751.233716:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520965632
00000100:00100000:3.0:1789760751.235181:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722811963452 time 722860550621 state 0x0 ref 1
00000100:00100000:3.0:1789760751.235208:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722860811037 time 722860550621 state 0x1 ref 1
00000100:00100000:3.0:1789760751.235487:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722860811037 time 722922166986 state 0x0 ref 1
00000100:00100000:3.0:1789760751.235514:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520965632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760751.235587:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22605824, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:3.0:1789760751.235600:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.235620:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:3.0:1789760751.235626:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760751.235636:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.235653:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760751.305589:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972839 is committed
00002000:00010000:3.0:1789760751.305934:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22605824 -> 22609920
00010000:00010000:3.0:1789760751.305955:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.305976:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.305986:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.305995:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.306001:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.306012:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.306037:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.306046:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22605824->22609919] (req 22605824->22609919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.306184:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520965632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70675us (72759us total) trans 4294972839 rc 0/0
00000100:00100000:3.0:1789760751.306206:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5552
00000100:00100000:3.0:1789760751.306220:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722860811037 time 722922166986 state 0x2 ref 0
00000100:00100000:2.0:1789760751.309991:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760751.310126:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520965760
00000100:00100000:0.0:1789760751.310139:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520965760
00000100:00100000:0.0:1789760751.310202:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722860811037 time 722922166986 state 0x0 ref 1
00000100:00100000:0.0:1789760751.310220:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722922427402 time 722922166986 state 0x1 ref 1
00000100:00100000:0.0:1789760751.310292:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722922427402 time 722996974678 state 0x0 ref 1
00000100:00100000:0.0:1789760751.310339:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520965760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760751.310399:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22609920, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:0.0:1789760751.310409:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.310427:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=722s v=(0 0)
00010000:00010000:0.0:1789760751.310432:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760751.310438:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.310453:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760751.382133:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972840 is committed
00002000:00010000:3.0:1789760751.382300:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22609920 -> 22614016
00010000:00010000:3.0:1789760751.382343:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.382358:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.382368:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.382377:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.382383:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.382461:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.382491:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.382567:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60c9d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22609920->22614015] (req 22609920->22614015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.382746:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520965760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 72426us (72761us total) trans 4294972840 rc 0/0
00000100:00100000:3.0:1789760751.382760:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5553
00000100:00100000:3.0:1789760751.382773:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722922427402 time 722996974678 state 0x2 ref 0
00000100:00100000:2.0:1789760751.390089:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760751.390265:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520965888
00000100:00100000:3.0:1789760751.390279:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520965888
00000100:00100000:2.0:1789760751.390693:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722922427402 time 722996974678 state 0x0 ref 1
00000100:00100000:2.0:1789760751.390775:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722997235094 time 722996974678 state 0x1 ref 1
00000100:00100000:2.0:1789760751.390844:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722997235094 time 723077525451 state 0x0 ref 1
00000100:00100000:2.0:1789760751.390861:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520965888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760751.390926:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22614016, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:2.0:1789760751.390937:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.390958:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:2.0:1789760751.390963:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760751.390971:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.390988:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760751.439448:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22614016 -> 22618112
00010000:00010000:3.0:1789760751.439478:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.439493:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.439504:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.439513:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.439519:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.439529:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.439554:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.439575:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60c9d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22614016->22618111] (req 22614016->22618111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.439711:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520965888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48847us (49628us total) trans 4294972841 rc 0/0
00000100:00100000:3.0:1789760751.439729:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5554
00000100:00100000:3.0:1789760751.439741:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722997235094 time 723077525451 state 0x2 ref 0
00000001:00080000:0.0:1789760751.442467:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972841 is committed
00000100:00100000:2.0:1789760751.442859:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760751.442951:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520966016
00000100:00100000:1.0:1789760751.442964:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520966016
00000100:00100000:1.0:1789760751.443035:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 722997235094 time 723077525451 state 0x0 ref 1
00000100:00100000:1.0:1789760751.443055:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723077785867 time 723077525451 state 0x1 ref 1
00000100:00100000:1.0:1789760751.443089:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723077785867 time 723129771696 state 0x0 ref 1
00000100:00100000:1.0:1789760751.443103:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520966016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760751.443172:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22618112, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:1.0:1789760751.443183:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760751.444788:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:1.0:1789760751.444798:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760751.444809:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760751.444833:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760751.450114:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.450160:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.450191:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.450231:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.450259:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.450284:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.450340:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520966144
00000100:00100000:2.0:1789760751.450352:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520966144
00000100:00100000:2.0:1789760751.450418:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 474
00000100:00100000:2.0:1789760751.450431:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699520966144:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760751.450511:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699520966144:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 82us (279us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760751.450518:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 474
00000100:00100000:2.0:1789760751.450572:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520966272
00000100:00100000:2.0:1789760751.450576:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520966272
00000100:00100000:2.0:1789760751.450613:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520966784
00000100:00100000:2.0:1789760751.450615:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520966784
00000100:00100000:2.0:1789760751.450629:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520966400
00000100:00100000:2.0:1789760751.450631:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520966400
00000100:00100000:2.0:1789760751.450642:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520966656
00000100:00100000:2.0:1789760751.450644:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520966656
00000100:00100000:2.0:1789760751.450656:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 893
00000100:00100000:2.0:1789760751.450662:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520966272:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760751.450704:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520966272:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 42us (606us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760751.450715:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 893
00000100:00100000:2.0:1789760751.450726:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 894
00000100:00100000:2.0:1789760751.450742:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520966784:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760751.450762:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520966784:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (572us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760751.450768:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 894
00000100:00100000:2.0:1789760751.450777:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 895
00000100:00100000:2.0:1789760751.450783:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520966400:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760751.450800:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520966400:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 17us (541us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760751.450805:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 895
00000100:00100000:2.0:1789760751.450813:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 896
00000100:00100000:2.0:1789760751.450818:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520966656:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760751.450835:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520966656:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 17us (551us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760751.450840:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 896
00000100:00080000:2.0:1789760751.450864:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1789760751.450868:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789760751.451661:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520966528
00000100:00100000:1.0:1789760751.451681:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520966528
00000100:00100000:1.0:1789760751.451799:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 290
00000100:00100000:1.0:1789760751.451813:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520966528:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760751.452901:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520966528:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1082us (2731us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760751.452914:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 290
00000001:00080000:2.0:1789760751.532181:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972842 is committed
00002000:00010000:0.0:1789760751.532483:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22618112 -> 22622208
00010000:00010000:0.0:1789760751.532504:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.532519:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.532529:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.532537:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760751.532543:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.532558:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.532581:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.532589:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60c9df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22618112->22622207] (req 22618112->22622207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760751.532831:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520966016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 89723us (89972us total) trans 4294972842 rc 0/0
00000100:00100000:0.0:1789760751.532845:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5555
00000100:00100000:0.0:1789760751.532857:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723077785867 time 723129771696 state 0x2 ref 0
00000100:00100000:3.0:1789760751.540430:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760751.540606:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520966912
00000100:00100000:0.0:1789760751.540620:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520966912
00000100:00100000:0.0:1789760751.540711:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723077785867 time 723129771696 state 0x0 ref 1
00000100:00100000:0.0:1789760751.540730:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723130032112 time 723129771696 state 0x1 ref 1
00000100:00100000:0.0:1789760751.540769:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723130032112 time 723227451319 state 0x0 ref 1
00000100:00100000:0.0:1789760751.540782:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520966912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760751.540849:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22622208, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:0.0:1789760751.540859:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.540878:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:0.0:1789760751.540883:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760751.540891:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.540909:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760751.594021:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972843 is committed
00002000:00010000:0.0:1789760751.594111:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22622208 -> 22626304
00010000:00010000:0.0:1789760751.594126:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.594138:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.594147:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.594155:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760751.594160:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.594169:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.594189:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.594198:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22622208->22626303] (req 22622208->22626303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760751.595535:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520966912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54745us (55109us total) trans 4294972843 rc 0/0
00000100:00100000:0.0:1789760751.595550:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5556
00000100:00100000:0.0:1789760751.595562:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723130032112 time 723227451319 state 0x2 ref 0
00000100:00100000:0.0:1789760751.602019:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760751.602106:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520967040
00000100:00100000:3.0:1789760751.602117:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520967040
00000100:00100000:3.0:1789760751.602173:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723130032112 time 723227451319 state 0x0 ref 1
00000100:00100000:3.0:1789760751.602189:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723227711735 time 723227451319 state 0x1 ref 1
00000100:00100000:3.0:1789760751.602213:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723227711735 time 723288895182 state 0x0 ref 1
00000100:00100000:3.0:1789760751.602224:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520967040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760751.602270:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22626304, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:3.0:1789760751.602280:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.602295:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:3.0:1789760751.602299:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760751.602305:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.602616:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760751.648870:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972844 is committed
00002000:00010000:2.0:1789760751.650000:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22626304 -> 22630400
00010000:00010000:2.0:1789760751.650017:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.650031:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.650041:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.650049:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760751.650054:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.650063:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.650084:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.650091:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60c9ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22626304->22630399] (req 22626304->22630399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760751.651161:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520967040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47967us (48181us total) trans 4294972844 rc 0/0
00000100:00100000:2.0:1789760751.651175:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5557
00000100:00100000:2.0:1789760751.651184:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723227711735 time 723288895182 state 0x2 ref 0
00000100:00100000:3.0:1789760751.653154:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.653294:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520967168
00000100:00100000:2.0:1789760751.653304:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520967168
00000100:00100000:2.0:1789760751.653380:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723227711735 time 723288895182 state 0x0 ref 1
00000100:00100000:2.0:1789760751.653393:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723289155598 time 723288895182 state 0x1 ref 1
00000100:00100000:2.0:1789760751.653412:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723289155598 time 723340095444 state 0x0 ref 1
00000100:00100000:2.0:1789760751.653433:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520967168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760751.653479:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22630400, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:2.0:1789760751.653488:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.653502:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:2.0:1789760751.653506:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760751.653512:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.653526:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760751.688376:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972845 is committed
00002000:00010000:0.0:1789760751.688726:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22630400 -> 22634496
00010000:00010000:0.0:1789760751.688742:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.688756:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.688765:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.688772:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760751.688777:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.688786:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.688805:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.688812:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60c9f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22630400->22634495] (req 22630400->22634495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760751.688908:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520967168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35482us (35756us total) trans 4294972845 rc 0/0
00000100:00100000:0.0:1789760751.688920:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5558
00000100:00100000:0.0:1789760751.688930:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723289155598 time 723340095444 state 0x2 ref 0
00000100:00100000:3.0:1789760751.692986:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760751.693062:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520967296
00000100:00100000:0.0:1789760751.693074:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520967296
00000100:00100000:0.0:1789760751.693130:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723289155598 time 723340095444 state 0x0 ref 1
00000100:00100000:0.0:1789760751.693146:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723340355860 time 723340095444 state 0x1 ref 1
00000100:00100000:0.0:1789760751.693177:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723340355860 time 723379859963 state 0x0 ref 1
00000100:00100000:0.0:1789760751.693191:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520967296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760751.693249:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22634496, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:0.0:1789760751.693259:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.693275:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:0.0:1789760751.693281:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760751.693287:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.693337:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760751.725562:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22634496 -> 22638592
00010000:00010000:2.0:1789760751.725584:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.725597:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.725607:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.725625:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760751.725631:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.725639:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.725660:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.725679:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60c9fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22634496->22638591] (req 22634496->22638591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760751.725776:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520967296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32582us (32794us total) trans 4294972846 rc 0/0
00000100:00100000:2.0:1789760751.725792:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5559
00000100:00100000:2.0:1789760751.725802:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723340355860 time 723379859963 state 0x2 ref 0
00000001:00080000:3.0:1789760751.726689:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972846 is committed
00000100:00100000:2.0:1789760751.730037:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760751.730131:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520967424
00000100:00100000:0.0:1789760751.730143:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520967424
00000100:00100000:0.0:1789760751.730205:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723340355860 time 723379859963 state 0x0 ref 1
00000100:00100000:0.0:1789760751.730230:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723380120379 time 723379859963 state 0x1 ref 1
00000100:00100000:0.0:1789760751.730260:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723380120379 time 723416943016 state 0x0 ref 1
00000100:00100000:0.0:1789760751.730273:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520967424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760751.730367:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22638592, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:0.0:1789760751.730377:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.730392:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:0.0:1789760751.730397:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760751.730404:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.730419:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760751.737727:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548757376:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1789760751.737801:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760751.737847:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548757376
00000100:00100000:3.0:1789760751.737857:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548757376
00000100:00100000:3.0:1789760751.737929:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366
00000100:00100000:3.0:1789760751.737940:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548757376:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1789760751.737963:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527630336 pending 1703936 free 3835691008 avail 3827302400
00000100:00100000:0.0:1789760751.738011:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548757504:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760751.738013:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548757376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (210us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760751.738024:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366
00000100:00080000:3.0:1789760751.738046:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760751.738050:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760751.738080:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548757504
00000100:00100000:3.0:1789760751.738085:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548757504
00000100:00100000:0.0:1789760751.738116:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548757376:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1789760751.738180:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367
00000100:00100000:3.0:1789760751.738189:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548757504:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1789760751.738200:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527630336 pending 1703936 free 3835691008 avail 3827302400
00000100:00100000:3.0:1789760751.738236:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548757504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (188us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760751.738241:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367
00000100:00080000:3.0:1789760751.738254:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760751.738275:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548757504:0@lo:13:osp-pre-0-0.0
00002000:00010000:3.0:1789760751.776724:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22638592 -> 22642688
00010000:00010000:3.0:1789760751.776743:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.776758:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.776768:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.776775:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.776780:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.776788:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.776808:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.776815:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ca02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22638592->22642687] (req 22638592->22642687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.776910:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520967424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46635us (46880us total) trans 4294972847 rc 0/0
00000100:00100000:3.0:1789760751.776921:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5560
00000100:00100000:3.0:1789760751.776931:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723380120379 time 723416943016 state 0x2 ref 0
00000100:00100000:0.0:1789760751.780747:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760751.780876:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520967552
00000100:00100000:3.0:1789760751.780887:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520967552
00000100:00100000:3.0:1789760751.780940:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723380120379 time 723416943016 state 0x0 ref 1
00000100:00100000:3.0:1789760751.780954:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723417203432 time 723416943016 state 0x1 ref 1
00000100:00100000:3.0:1789760751.780988:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723417203432 time 723467671074 state 0x0 ref 1
00000100:00100000:3.0:1789760751.781001:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520967552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760751.781047:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22642688, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:3.0:1789760751.781056:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.781071:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:3.0:1789760751.781076:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760751.781083:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.781096:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760751.781751:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972847 is committed
00000001:00080000:2.0:1789760751.814927:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972848 is committed
00002000:00010000:2.0:1789760751.814993:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22642688 -> 22646784
00010000:00010000:2.0:1789760751.815010:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.815024:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.815033:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.815039:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760751.815043:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.815049:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.815063:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.815068:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ca09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22642688->22646783] (req 22642688->22646783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760751.815151:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520967552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34149us (34408us total) trans 4294972848 rc 0/0
00000100:00100000:2.0:1789760751.815158:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5561
00000100:00100000:2.0:1789760751.815165:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723417203432 time 723467671074 state 0x2 ref 0
00000100:00100000:0.0:1789760751.818686:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.818783:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520967680
00000100:00100000:2.0:1789760751.818792:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520967680
00000100:00100000:2.0:1789760751.818846:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723417203432 time 723467671074 state 0x0 ref 1
00000100:00100000:2.0:1789760751.818933:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723467931490 time 723467671074 state 0x1 ref 1
00000100:00100000:2.0:1789760751.818960:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723467931490 time 723505642419 state 0x0 ref 1
00000100:00100000:2.0:1789760751.818977:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520967680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760751.819028:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22646784, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:2.0:1789760751.819040:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.819056:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:2.0:1789760751.819062:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760751.819070:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.819229:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760751.871211:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22646784 -> 22650880
00010000:00010000:0.0:1789760751.871241:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.871254:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.871263:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.871271:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760751.871276:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.871285:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.871304:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.871342:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60ca10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22646784->22650879] (req 22646784->22650879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760751.871422:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520967680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52448us (52753us total) trans 4294972849 rc 0/0
00000100:00100000:0.0:1789760751.871431:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5562
00000100:00100000:0.0:1789760751.871441:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723467931490 time 723505642419 state 0x2 ref 0
00000001:00080000:2.0:1789760751.872077:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972849 is committed
00000100:00100000:0.0:1789760751.873862:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760751.874028:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520967808
00000100:00100000:2.0:1789760751.874037:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520967808
00000100:00100000:2.0:1789760751.874084:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723467931490 time 723505642419 state 0x0 ref 1
00000100:00100000:2.0:1789760751.874099:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723505902835 time 723505642419 state 0x1 ref 1
00000100:00100000:2.0:1789760751.874160:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723505902835 time 723560842573 state 0x0 ref 1
00000100:00100000:2.0:1789760751.874174:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520967808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760751.874227:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22650880, mtime: 0x6aad94f0, atime: 0x0, ctime: 0x6aad94f0, blocks: 0xb007
00010000:00010000:2.0:1789760751.874242:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.874257:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:2.0:1789760751.874262:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760751.874268:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760751.874282:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760751.911712:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22650880 -> 22654976
00002000:00010000:0.0:1789760751.911721:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760752 -> 1789760753
00002000:00010000:0.0:1789760751.911724:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760752 -> 1789760753
00010000:00010000:0.0:1789760751.911738:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.911751:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.911759:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.911765:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760751.911770:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.911784:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.911803:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760751.911810:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ca17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22650880->22654975] (req 22650880->22654975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760751.912029:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520967808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37852us (38178us total) trans 4294972850 rc 0/0
00000100:00100000:0.0:1789760751.912040:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5563
00000100:00100000:0.0:1789760751.912049:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723505902835 time 723560842573 state 0x2 ref 0
00000001:00080000:3.0:1789760751.912131:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972850 is committed
00000100:00100000:3.0:1789760751.927945:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760751.928604:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520967936
00000100:00100000:1.0:1789760751.928614:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520967936
00000100:00100000:1.0:1789760751.928681:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723505902835 time 723560842573 state 0x0 ref 1
00000100:00100000:1.0:1789760751.928696:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723561102989 time 723560842573 state 0x1 ref 1
00000100:00100000:1.0:1789760751.928782:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723561102989 time 723615463281 state 0x0 ref 1
00000100:00100000:1.0:1789760751.928798:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520967936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760751.928846:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22654976, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:1.0:1789760751.928855:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760751.928871:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:1.0:1789760751.928875:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760751.928881:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760751.928895:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760751.962300:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972851 is committed
00002000:00010000:3.0:1789760751.962459:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22654976 -> 22659072
00010000:00010000:3.0:1789760751.962474:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.962487:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.962496:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.962504:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760751.962508:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.962517:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.962537:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.962545:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ca1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22654976->22659071] (req 22654976->22659071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760751.962636:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520967936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33836us (34700us total) trans 4294972851 rc 0/0
00000100:00100000:3.0:1789760751.962647:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5564
00000100:00100000:3.0:1789760751.962656:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723561102989 time 723615463281 state 0x2 ref 0
00000100:00100000:2.0:1789760751.966125:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760751.966394:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520968064
00000100:00100000:3.0:1789760751.966404:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520968064
00000100:00100000:3.0:1789760751.966456:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723561102989 time 723615463281 state 0x0 ref 1
00000100:00100000:3.0:1789760751.966472:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723615723697 time 723615463281 state 0x1 ref 1
00000100:00100000:3.0:1789760751.966506:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723615723697 time 723653188832 state 0x0 ref 1
00000100:00100000:3.0:1789760751.966519:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520968064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760751.966565:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22659072, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760751.966575:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.966591:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:3.0:1789760751.966596:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760751.966602:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760751.966615:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760752.021039:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22659072 -> 22663168
00010000:00010000:3.0:1789760752.021059:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.021073:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.021083:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.021090:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.021096:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.021105:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.021124:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.021132:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22659072->22663167] (req 22659072->22663167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.021232:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520968064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54710us (55112us total) trans 4294972852 rc 0/0
00000100:00100000:3.0:1789760752.021243:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5565
00000100:00100000:3.0:1789760752.021253:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723615723697 time 723653188832 state 0x2 ref 0
00000001:00080000:2.0:1789760752.022590:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972852 is committed
00000100:00100000:0.0:1789760752.024725:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.024807:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520968192
00000100:00100000:3.0:1789760752.024819:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520968192
00000100:00100000:3.0:1789760752.024897:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723615723697 time 723653188832 state 0x0 ref 1
00000100:00100000:3.0:1789760752.024914:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723653449248 time 723653188832 state 0x1 ref 1
00000100:00100000:3.0:1789760752.024949:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723653449248 time 723711631395 state 0x0 ref 1
00000100:00100000:3.0:1789760752.024961:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520968192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.025009:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22663168, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760752.025019:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.025035:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:3.0:1789760752.025039:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.025045:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.025059:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760752.025581:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760752.069530:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972853 is committed
00002000:00010000:3.0:1789760752.069633:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22663168 -> 22667264
00010000:00010000:3.0:1789760752.069650:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.069674:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.069683:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.069690:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.069695:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.069703:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.069726:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.069734:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22663168->22667263] (req 22663168->22667263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.069827:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520968192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44864us (45107us total) trans 4294972853 rc 0/0
00000100:00100000:3.0:1789760752.069838:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5566
00000100:00100000:3.0:1789760752.069848:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723653449248 time 723711631395 state 0x2 ref 0
00000100:00100000:0.0:1789760752.074186:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760752.074506:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520968320
00000100:00100000:2.0:1789760752.074518:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520968320
00000100:00100000:2.0:1789760752.074574:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723653449248 time 723711631395 state 0x0 ref 1
00000100:00100000:2.0:1789760752.074592:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723711891811 time 723711631395 state 0x1 ref 1
00000100:00100000:2.0:1789760752.074653:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723711891811 time 723761334806 state 0x0 ref 1
00000100:00100000:2.0:1789760752.074674:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520968320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760752.074723:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22667264, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:2.0:1789760752.074733:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.074755:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:2.0:1789760752.074759:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760752.074765:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.074780:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760752.121045:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972854 is committed
00002000:00010000:2.0:1789760752.121140:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22667264 -> 22671360
00010000:00010000:2.0:1789760752.121157:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.121170:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.121179:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.121186:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760752.122609:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.122624:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.122647:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.122655:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22667264->22671359] (req 22667264->22671359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760752.122802:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520968320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48125us (48621us total) trans 4294972854 rc 0/0
00000100:00100000:2.0:1789760752.122814:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5567
00000100:00100000:2.0:1789760752.122823:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723711891811 time 723761334806 state 0x2 ref 0
00000100:00100000:2.0:1789760752.129071:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760752.129166:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520968448
00000100:00100000:1.0:1789760752.129177:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520968448
00000100:00100000:1.0:1789760752.129250:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723711891811 time 723761334806 state 0x0 ref 1
00000100:00100000:1.0:1789760752.129266:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723761595222 time 723761334806 state 0x1 ref 1
00000100:00100000:1.0:1789760752.129306:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723761595222 time 723815988422 state 0x0 ref 1
00000100:00100000:1.0:1789760752.129357:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520968448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760752.129410:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22671360, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:1.0:1789760752.129420:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.129442:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:1.0:1789760752.129447:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760752.129453:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.129467:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760752.178875:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972855 is committed
00002000:00010000:1.0:1789760752.181387:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22671360 -> 22675456
00010000:00010000:1.0:1789760752.181407:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.181422:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.181431:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.181438:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760752.181443:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.181452:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.181472:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.181481:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ca3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22671360->22675455] (req 22671360->22675455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760752.181581:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520968448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52222us (52514us total) trans 4294972855 rc 0/0
00000100:00100000:1.0:1789760752.181591:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5568
00000100:00100000:1.0:1789760752.181601:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723761595222 time 723815988422 state 0x2 ref 0
00010000:00010000:0.0:1789760752.187015:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789760752.196641:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.196780:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520968576
00000100:00100000:3.0:1789760752.196791:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520968576
00000100:00100000:3.0:1789760752.196847:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723761595222 time 723815988422 state 0x0 ref 1
00000100:00100000:3.0:1789760752.196863:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723816248838 time 723815988422 state 0x1 ref 1
00000100:00100000:3.0:1789760752.196894:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723816248838 time 723883576527 state 0x0 ref 1
00000100:00100000:3.0:1789760752.196907:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520968576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.196953:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22675456, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760752.196963:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.196979:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:3.0:1789760752.196984:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.196990:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.197004:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760752.266129:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22675456 -> 22679552
00010000:00010000:2.0:1789760752.266150:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.266164:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.266173:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.266182:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760752.266196:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.266207:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.266471:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.266482:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ca41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22675456->22679551] (req 22675456->22679551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760752.266581:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520968576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 69672us (69944us total) trans 4294972856 rc 0/0
00000100:00100000:2.0:1789760752.266592:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5569
00000100:00100000:2.0:1789760752.266602:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723816248838 time 723883576527 state 0x2 ref 0
00000001:00080000:0.0:1789760752.267622:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972856 is committed
00000100:00100000:0.0:1789760752.280629:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.280983:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520968704
00000100:00100000:3.0:1789760752.280993:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520968704
00000100:00100000:3.0:1789760752.281048:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723816248838 time 723883576527 state 0x0 ref 1
00000100:00100000:3.0:1789760752.281063:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723883836943 time 723883576527 state 0x1 ref 1
00000100:00100000:3.0:1789760752.281142:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723883836943 time 723967824260 state 0x0 ref 1
00000100:00100000:3.0:1789760752.281155:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520968704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.281210:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22679552, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760752.281219:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.281234:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=723s v=(0 0)
00010000:00010000:3.0:1789760752.281239:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.281245:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.281258:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760752.342448:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22679552 -> 22683648
00010000:00010000:0.0:1789760752.342465:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760752.342482:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760752.342490:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760752.342497:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760752.342501:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760752.342509:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760752.342528:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760752.342535:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ca48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22679552->22683647] (req 22679552->22683647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760752.342596:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972857 is committed
00000100:00100000:0.0:1789760752.342633:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520968704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61476us (62009us total) trans 4294972857 rc 0/0
00000100:00100000:0.0:1789760752.342643:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5570
00000100:00100000:0.0:1789760752.342651:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723883836943 time 723967824260 state 0x2 ref 0
00000100:00100000:1.0:1789760752.349616:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760752.349733:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520968832
00000100:00100000:2.0:1789760752.349744:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520968832
00000100:00100000:2.0:1789760752.349795:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723883836943 time 723967824260 state 0x0 ref 1
00000100:00100000:2.0:1789760752.349811:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723968084676 time 723967824260 state 0x1 ref 1
00000100:00100000:2.0:1789760752.349846:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723968084676 time 724036528681 state 0x0 ref 1
00000100:00100000:2.0:1789760752.349858:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520968832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760752.349905:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22683648, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:2.0:1789760752.349915:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.349936:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:2.0:1789760752.349942:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760752.349948:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.349962:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760752.401462:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22683648 -> 22687744
00010000:00010000:2.0:1789760752.401485:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.401499:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.401509:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.401517:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760752.401521:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.401530:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.401549:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.401557:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ca4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22683648->22687743] (req 22683648->22687743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760752.401640:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520968832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51780us (52029us total) trans 4294972858 rc 0/0
00000100:00100000:2.0:1789760752.401651:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5571
00000100:00100000:2.0:1789760752.401668:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723968084676 time 724036528681 state 0x2 ref 0
00000001:00080000:1.0:1789760752.401804:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972858 is committed
00000100:00100000:3.0:1789760752.405046:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760752.405185:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520968960
00000100:00100000:0.0:1789760752.405251:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520968960
00000100:00100000:0.0:1789760752.405469:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 723968084676 time 724036528681 state 0x0 ref 1
00000100:00100000:0.0:1789760752.405484:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724036789097 time 724036528681 state 0x1 ref 1
00000100:00100000:1.0:1789760752.405590:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724036789097 time 724092271194 state 0x0 ref 1
00000100:00100000:1.0:1789760752.405605:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520968960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760752.405665:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22687744, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:1.0:1789760752.405674:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.405689:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:1.0:1789760752.405694:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760752.405700:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.405715:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760752.449890:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972859 is committed
00002000:00010000:1.0:1789760752.449960:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22687744 -> 22691840
00010000:00010000:1.0:1789760752.449974:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.449988:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.449997:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.450005:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760752.450010:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.450019:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.450038:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.450046:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22687744->22691839] (req 22687744->22691839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760752.450138:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520968960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44522us (45089us total) trans 4294972859 rc 0/0
00000100:00100000:1.0:1789760752.450151:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5572
00000100:00100000:1.0:1789760752.450160:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724036789097 time 724092271194 state 0x2 ref 0
00000100:00100000:1.0:1789760752.453712:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.453793:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520969088
00000100:00100000:3.0:1789760752.453804:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520969088
00000100:00100000:3.0:1789760752.453856:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724036789097 time 724092271194 state 0x0 ref 1
00000100:00100000:3.0:1789760752.453871:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724092531610 time 724092271194 state 0x1 ref 1
00000100:00100000:3.0:1789760752.453904:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724092531610 time 724140585526 state 0x0 ref 1
00000100:00100000:3.0:1789760752.453915:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520969088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.453958:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22691840, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760752.453966:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.453980:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:3.0:1789760752.453985:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.453992:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.454003:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760752.488211:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972860 is committed
00002000:00010000:3.0:1789760752.488371:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22691840 -> 22695936
00010000:00010000:3.0:1789760752.488386:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.488405:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.488414:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.488421:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.488426:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.488434:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.488451:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.488459:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22691840->22695935] (req 22691840->22695935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.488543:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520969088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34626us (34834us total) trans 4294972860 rc 0/0
00000100:00100000:3.0:1789760752.488552:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5573
00000100:00100000:3.0:1789760752.488561:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724092531610 time 724140585526 state 0x2 ref 0
00000100:00100000:1.0:1789760752.492822:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.492916:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520969216
00000100:00100000:3.0:1789760752.492926:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520969216
00000100:00100000:3.0:1789760752.492979:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724092531610 time 724140585526 state 0x0 ref 1
00000100:00100000:3.0:1789760752.492996:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724140845942 time 724140585526 state 0x1 ref 1
00000100:00100000:3.0:1789760752.493057:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724140845942 time 724179738941 state 0x0 ref 1
00000100:00100000:3.0:1789760752.493070:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520969216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.493117:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22695936, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760752.493126:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.493141:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:3.0:1789760752.493145:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.493152:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.493166:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760752.534164:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972861 is committed
00002000:00010000:2.0:1789760752.534427:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22695936 -> 22700032
00010000:00010000:2.0:1789760752.534443:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.534455:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.534464:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.534471:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760752.534477:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.534487:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.534512:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.534519:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ca64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22695936->22700031] (req 22695936->22700031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760752.534606:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520969216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41533us (41788us total) trans 4294972861 rc 0/0
00000100:00100000:2.0:1789760752.534618:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5574
00000100:00100000:2.0:1789760752.534627:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724140845942 time 724179738941 state 0x2 ref 0
00000100:00100000:2.0:1789760752.538686:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760752.540591:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520969344
00000100:00100000:1.0:1789760752.540606:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520969344
00000100:00100000:1.0:1789760752.540677:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724140845942 time 724179738941 state 0x0 ref 1
00000100:00100000:1.0:1789760752.540692:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724179999357 time 724179738941 state 0x1 ref 1
00000100:00100000:1.0:1789760752.540725:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724179999357 time 724227407443 state 0x0 ref 1
00000100:00100000:1.0:1789760752.540738:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520969344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760752.540788:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22700032, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:1.0:1789760752.540798:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.540816:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:1.0:1789760752.540821:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760752.540827:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.540842:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760752.567520:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22700032 -> 22704128
00010000:00010000:1.0:1789760752.567539:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.567551:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.567560:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.567566:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760752.567571:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.567580:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.567599:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.567607:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60ca6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22700032->22704127] (req 22700032->22704127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760752.567698:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520969344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26958us (29020us total) trans 4294972862 rc 0/0
00000100:00100000:1.0:1789760752.567713:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5575
00000100:00100000:1.0:1789760752.567722:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724179999357 time 724227407443 state 0x2 ref 0
00000001:00080000:2.0:1789760752.570975:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972862 is committed
00000100:00100000:1.0:1789760752.571589:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760752.571882:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520969472
00000100:00100000:2.0:1789760752.571892:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520969472
00000100:00100000:2.0:1789760752.571944:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724179999357 time 724227407443 state 0x0 ref 1
00000100:00100000:2.0:1789760752.571961:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724227667859 time 724227407443 state 0x1 ref 1
00000100:00100000:2.0:1789760752.571992:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724227667859 time 724258674281 state 0x0 ref 1
00000100:00100000:2.0:1789760752.572004:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520969472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760752.572050:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22704128, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:2.0:1789760752.572060:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.572080:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:2.0:1789760752.572085:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760752.572091:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.572105:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760752.622721:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972863 is committed
00002000:00010000:3.0:1789760752.623287:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22704128 -> 22708224
00010000:00010000:3.0:1789760752.623302:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.623343:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.623359:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.623367:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.623371:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.623380:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.623400:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.623409:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ca72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22704128->22708223] (req 22704128->22708223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.623540:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520969472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51532us (51950us total) trans 4294972863 rc 0/0
00000100:00100000:3.0:1789760752.623551:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5576
00000100:00100000:3.0:1789760752.623560:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724227667859 time 724258674281 state 0x2 ref 0
00000100:00100000:2.0:1789760752.628718:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.630906:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520969600
00000100:00100000:3.0:1789760752.630920:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520969600
00000100:00100000:3.0:1789760752.630981:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724227667859 time 724258674281 state 0x0 ref 1
00000100:00100000:3.0:1789760752.630997:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724258934697 time 724258674281 state 0x1 ref 1
00000100:00100000:3.0:1789760752.631068:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724258934697 time 724317750061 state 0x0 ref 1
00000100:00100000:3.0:1789760752.631081:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520969600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.631129:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22708224, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760752.631139:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.631154:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:3.0:1789760752.631159:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.631165:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.631180:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760752.689011:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972864 is committed
00002000:00010000:3.0:1789760752.689128:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22708224 -> 22712320
00010000:00010000:3.0:1789760752.689145:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.689160:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.689170:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.689178:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.689393:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.689406:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.689426:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.689435:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22708224->22712319] (req 22708224->22712319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.689524:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520969600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58440us (60811us total) trans 4294972864 rc 0/0
00000100:00100000:3.0:1789760752.689535:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5577
00000100:00100000:3.0:1789760752.689546:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724258934697 time 724317750061 state 0x2 ref 0
00000100:00100000:2.0:1789760752.697443:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.697573:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520969728
00000100:00100000:3.0:1789760752.697582:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520969728
00000100:00100000:3.0:1789760752.697636:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724258934697 time 724317750061 state 0x0 ref 1
00000100:00100000:3.0:1789760752.697653:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724318010477 time 724317750061 state 0x1 ref 1
00000100:00100000:3.0:1789760752.697693:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724318010477 time 724384375318 state 0x0 ref 1
00000100:00100000:3.0:1789760752.697704:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520969728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.697764:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22712320, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760752.697775:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.697792:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:3.0:1789760752.697796:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.697803:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.697818:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760752.754568:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972865 is committed
00002000:00010000:2.0:1789760752.754663:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22712320 -> 22716416
00010000:00010000:2.0:1789760752.754680:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.754693:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.754702:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.754710:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760752.754714:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.754724:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.754751:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.754757:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22712320->22716415] (req 22712320->22716415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760752.754851:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520969728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57143us (57413us total) trans 4294972865 rc 0/0
00000100:00100000:2.0:1789760752.754863:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5578
00000100:00100000:2.0:1789760752.754872:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724318010477 time 724384375318 state 0x2 ref 0
00000100:00100000:1.0:1789760752.758029:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760752.758101:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520969856
00000100:00100000:2.0:1789760752.758110:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520969856
00000100:00100000:2.0:1789760752.758166:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724318010477 time 724384375318 state 0x0 ref 1
00000100:00100000:2.0:1789760752.758181:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724384635734 time 724384375318 state 0x1 ref 1
00000100:00100000:2.0:1789760752.758251:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724384635734 time 724444933279 state 0x0 ref 1
00000100:00100000:2.0:1789760752.758264:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520969856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760752.758430:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22716416, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:2.0:1789760752.758440:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.758455:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:2.0:1789760752.758460:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760752.758466:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.758480:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.761833:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548757632:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.761905:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.761956:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548758144:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.761983:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762001:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548758656:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762021:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762036:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548759168:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762054:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762075:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:3.0:1789760752.762080:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548757760:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762102:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762117:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548758272:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762135:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762149:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548758784:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762169:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762211:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548757888:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762233:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762250:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548758400:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762270:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762457:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548758912:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762484:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762503:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:3.0:1789760752.762509:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548758016:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762527:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762537:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548758528:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762553:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762567:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548759040:0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762585:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.762614:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548757632
00000100:00100000:3.0:1789760752.762621:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548757632
00000100:00100000:3.0:1789760752.762674:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475
00000100:00100000:3.0:1789760752.762682:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548757632:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762728:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548757632:12345-0@lo:400:kworker.0 Request processed in 46us (823us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.762735:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475
00000100:00100000:3.0:1789760752.762765:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548758144
00000100:00100000:3.0:1789760752.762769:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548758144
00000100:00100000:3.0:1789760752.762790:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548757888
00000100:00100000:3.0:1789760752.762793:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548757888
00000100:00100000:3.0:1789760752.762807:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435
00000100:00100000:3.0:1789760752.762813:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548758144:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762847:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548758144:12345-0@lo:400:kworker.0 Request processed in 34us (864us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.762853:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435
00000100:00100000:3.0:1789760752.762865:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436
00000100:00100000:3.0:1789760752.762871:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548757888:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.762898:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548757888:12345-0@lo:400:kworker.0 Request processed in 27us (663us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.762904:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436
00000100:00100000:3.0:1789760752.762919:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548758656
00000100:00100000:3.0:1789760752.762922:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548758656
00000100:00100000:3.0:1789760752.762945:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548759168
00000100:00100000:3.0:1789760752.762947:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548759168
00000100:00100000:3.0:1789760752.762964:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548758528
00000100:00100000:3.0:1789760752.762967:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548758528
00000100:00100000:3.0:1789760752.762977:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548759040
00000100:00100000:3.0:1789760752.762979:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548759040
00000100:00100000:3.0:1789760752.762993:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291
00000100:00100000:3.0:1789760752.762999:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548758656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763025:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548758656:12345-0@lo:400:kworker.0 Request processed in 27us (1003us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763032:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291
00000100:00100000:3.0:1789760752.763042:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292
00000100:00100000:3.0:1789760752.763047:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548759168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763067:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548759168:12345-0@lo:400:kworker.0 Request processed in 21us (1013us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763073:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292
00000100:00100000:3.0:1789760752.763083:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293
00000100:00100000:3.0:1789760752.763088:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548758528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763108:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548758528:12345-0@lo:400:kworker.0 Request processed in 21us (554us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763114:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293
00000100:00100000:3.0:1789760752.763123:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294
00000100:00100000:3.0:1789760752.763128:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548759040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763149:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548759040:12345-0@lo:400:kworker.0 Request processed in 21us (564us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763155:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294
00000100:00100000:3.0:1789760752.763175:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548757760
00000100:00100000:3.0:1789760752.763178:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548757760
00000100:00100000:3.0:1789760752.763260:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548758272
00000100:00100000:3.0:1789760752.763264:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548758272
00000100:00100000:3.0:1789760752.763276:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548758784
00000100:00100000:3.0:1789760752.763278:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548758784
00000100:00100000:3.0:1789760752.763373:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548758400
00000100:00100000:3.0:1789760752.763376:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548758400
00000100:00100000:3.0:1789760752.763388:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548758912
00000100:00100000:3.0:1789760752.763391:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548758912
00000100:00100000:3.0:1789760752.763401:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548758016
00000100:00100000:3.0:1789760752.763404:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548758016
00000100:00100000:3.0:1789760752.763414:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897
00000100:00100000:3.0:1789760752.763420:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548757760:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763451:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548757760:12345-0@lo:400:kworker.0 Request processed in 30us (1347us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763456:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897
00000100:00100000:3.0:1789760752.763467:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898
00000100:00100000:3.0:1789760752.763472:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548758272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763497:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548758272:12345-0@lo:400:kworker.0 Request processed in 24us (1361us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763503:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898
00000100:00100000:3.0:1789760752.763512:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899
00000100:00100000:3.0:1789760752.763518:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548758784:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763540:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548758784:12345-0@lo:400:kworker.0 Request processed in 22us (1371us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763546:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899
00000100:00100000:3.0:1789760752.763555:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900
00000100:00100000:3.0:1789760752.763560:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548758400:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763583:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548758400:12345-0@lo:400:kworker.0 Request processed in 23us (1311us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763588:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900
00000100:00100000:3.0:1789760752.763598:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901
00000100:00100000:3.0:1789760752.763603:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548758912:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763624:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548758912:12345-0@lo:400:kworker.0 Request processed in 22us (1140us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763631:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901
00000100:00100000:3.0:1789760752.763640:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902
00000100:00100000:3.0:1789760752.763645:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548758016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760752.763680:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548758016:12345-0@lo:400:kworker.0 Request processed in 34us (1152us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.763686:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902
00000100:00080000:3.0:1789760752.763738:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1789760752.763743:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:3.0:1789760752.763746:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1789760752.764627:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda742d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548759296:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1789760752.764684:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760752.764726:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548759296
00000100:00100000:3.0:1789760752.764732:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548759296
00000100:00100000:3.0:1789760752.764765:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368
00000100:00100000:3.0:1789760752.764772:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548759296:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1789760752.764803:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:3.0:1789760752.764840:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548759296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (157us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760752.764847:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368
00000100:00100000:3.0:1789760752.764886:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda742d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548759296:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1789760752.765241:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:3.0:1789760752.765252:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548759424:0@lo:13:osp-pre-1-0.0
00000100:00100000:3.0:1789760752.765282:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760752.765410:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548758016:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765423:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548758528:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765432:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548759040:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765443:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548757888:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765454:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548758400:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765466:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548758912:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765502:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548757760:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765512:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548758272:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765522:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548758784:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765531:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548757632:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765541:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548758144:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765552:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548758656:0@lo:400:kworker.0
00000100:00100000:2.0:1789760752.765561:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b9c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548759168:0@lo:400:kworker.0
00000100:00100000:1.0:1789760752.770881:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548759424
00000100:00100000:1.0:1789760752.770896:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548759424
00000100:00100000:1.0:1789760752.770966:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369
00000100:00100000:1.0:1789760752.770975:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548759424:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:1.0:1789760752.770998:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760752.771069:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548759424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (5786us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760752.771077:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369
00000100:00100000:1.0:1789760752.771124:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548759424:0@lo:13:osp-pre-1-0.0
00000001:00080000:1.0:1789760752.808967:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972866 is committed
00002000:00010000:2.0:1789760752.809062:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22716416 -> 22720512
00010000:00010000:2.0:1789760752.809077:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.809090:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.809098:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.809105:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760752.809110:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.809119:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.809139:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.809149:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ca87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22716416->22720511] (req 22716416->22720511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760752.809463:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520969856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51197us (51439us total) trans 4294972866 rc 0/0
00000100:00100000:2.0:1789760752.809475:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5579
00000100:00100000:2.0:1789760752.809484:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724384635734 time 724444933279 state 0x2 ref 0
00000100:00100000:2.0:1789760752.812890:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.812963:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520969984
00000100:00100000:3.0:1789760752.812972:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520969984
00000100:00100000:3.0:1789760752.813021:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724384635734 time 724444933279 state 0x0 ref 1
00000100:00100000:3.0:1789760752.813036:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724445193695 time 724444933279 state 0x1 ref 1
00000100:00100000:3.0:1789760752.813063:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724445193695 time 724499745611 state 0x0 ref 1
00000100:00100000:3.0:1789760752.813074:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520969984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.813120:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22720512, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:3.0:1789760752.813128:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.813144:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:3.0:1789760752.813149:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.813155:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.813170:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760752.840945:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972867 is committed
00002000:00010000:3.0:1789760752.841062:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22720512 -> 22724608
00010000:00010000:3.0:1789760752.841077:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.841091:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.841101:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.841109:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.841113:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.841123:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.841143:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.841153:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22720512->22724607] (req 22720512->22724607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.841268:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520969984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28190us (28381us total) trans 4294972867 rc 0/0
00000100:00100000:3.0:1789760752.841279:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5580
00000100:00100000:3.0:1789760752.841290:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724445193695 time 724499745611 state 0x2 ref 0
00000100:00100000:3.0:1789760752.844538:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760752.844887:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520970112
00000100:00100000:1.0:1789760752.844899:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520970112
00000100:00100000:1.0:1789760752.844953:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724445193695 time 724499745611 state 0x0 ref 1
00000100:00100000:1.0:1789760752.844969:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724500006027 time 724499745611 state 0x1 ref 1
00000100:00100000:1.0:1789760752.845002:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724500006027 time 724531684207 state 0x0 ref 1
00000100:00100000:1.0:1789760752.845014:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520970112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760752.845063:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22724608, mtime: 0x6aad94f1, atime: 0x0, ctime: 0x6aad94f1, blocks: 0xb007
00010000:00010000:1.0:1789760752.845072:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.845086:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:1.0:1789760752.845090:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760752.845097:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.845112:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760752.874679:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972868 is committed
00002000:00010000:3.0:1789760752.874779:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22724608 -> 22728704
00002000:00010000:3.0:1789760752.874784:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760753 -> 1789760754
00002000:00010000:3.0:1789760752.874787:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760753 -> 1789760754
00010000:00010000:3.0:1789760752.874800:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.874814:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.874823:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.874831:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.874836:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.874851:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.874869:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.874877:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ca95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22724608->22728703] (req 22724608->22728703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.874963:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520970112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29946us (30430us total) trans 4294972868 rc 0/0
00000100:00100000:3.0:1789760752.874973:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5581
00000100:00100000:3.0:1789760752.874984:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724500006027 time 724531684207 state 0x2 ref 0
00000100:00100000:2.0:1789760752.878704:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.878796:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520970240
00000100:00100000:3.0:1789760752.878806:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520970240
00000100:00100000:3.0:1789760752.878857:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724500006027 time 724531684207 state 0x0 ref 1
00000100:00100000:3.0:1789760752.878872:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724531944623 time 724531684207 state 0x1 ref 1
00000100:00100000:3.0:1789760752.878900:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724531944623 time 724565582879 state 0x0 ref 1
00000100:00100000:3.0:1789760752.878912:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520970240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.878957:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22728704, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:3.0:1789760752.878967:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.878984:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:3.0:1789760752.878989:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.878995:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.879009:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760752.913016:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972869 is committed
00002000:00010000:3.0:1789760752.913099:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22728704 -> 22732800
00010000:00010000:3.0:1789760752.913115:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.913128:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.913138:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.913146:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.913150:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.913159:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.913177:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.913194:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60ca9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22728704->22732799] (req 22728704->22732799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.913422:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520970240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34505us (34721us total) trans 4294972869 rc 0/0
00000100:00100000:3.0:1789760752.913433:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5582
00000100:00100000:3.0:1789760752.913443:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724531944623 time 724565582879 state 0x2 ref 0
00000100:00100000:2.0:1789760752.921762:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760752.921863:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520970368
00000100:00100000:1.0:1789760752.921874:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520970368
00000100:00100000:1.0:1789760752.921931:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724531944623 time 724565582879 state 0x0 ref 1
00000100:00100000:1.0:1789760752.921947:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724565843295 time 724565582879 state 0x1 ref 1
00000100:00100000:1.0:1789760752.921977:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724565843295 time 724608659831 state 0x0 ref 1
00000100:00100000:1.0:1789760752.921989:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520970368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760752.922036:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22732800, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:1.0:1789760752.922045:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.922061:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:1.0:1789760752.922065:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760752.922071:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760752.922084:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760752.955150:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972870 is committed
00002000:00010000:2.0:1789760752.955256:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22732800 -> 22736896
00010000:00010000:2.0:1789760752.955270:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.955283:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.955292:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.955300:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760752.955305:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.955495:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.955516:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760752.955524:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60caa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22732800->22736895] (req 22732800->22736895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.955759:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520970368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33765us (34000us total) trans 4294972870 rc 0/0
00000100:00100000:3.0:1789760752.955769:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5583
00000100:00100000:3.0:1789760752.955778:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724565843295 time 724608659831 state 0x2 ref 0
00000100:00100000:2.0:1789760752.959762:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.959852:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520970496
00000100:00100000:3.0:1789760752.959866:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520970496
00000100:00100000:3.0:1789760752.959923:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724565843295 time 724608659831 state 0x0 ref 1
00000100:00100000:3.0:1789760752.959937:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724608920247 time 724608659831 state 0x1 ref 1
00000100:00100000:3.0:1789760752.959970:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724608920247 time 724646652307 state 0x0 ref 1
00000100:00100000:3.0:1789760752.959981:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520970496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.960026:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22736896, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:3.0:1789760752.960034:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.960051:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:3.0:1789760752.960055:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.960061:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.960072:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760752.992090:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972871 is committed
00002000:00010000:3.0:1789760752.992146:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22736896 -> 22740992
00010000:00010000:3.0:1789760752.992160:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.992173:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.992192:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.992200:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760752.992205:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.992214:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.992301:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.992309:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60caaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22736896->22740991] (req 22736896->22740991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760752.992415:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520970496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32431us (32668us total) trans 4294972871 rc 0/0
00000100:00100000:3.0:1789760752.992425:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5584
00000100:00100000:3.0:1789760752.992435:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724608920247 time 724646652307 state 0x2 ref 0
00000100:00100000:2.0:1789760752.997095:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760752.997587:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520970624
00000100:00100000:3.0:1789760752.997597:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520970624
00000100:00100000:3.0:1789760752.997660:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724608920247 time 724646652307 state 0x0 ref 1
00000100:00100000:3.0:1789760752.997676:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724646912723 time 724646652307 state 0x1 ref 1
00000100:00100000:3.0:1789760752.997735:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724646912723 time 724684418088 state 0x0 ref 1
00000100:00100000:3.0:1789760752.997747:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520970624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760752.997788:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22740992, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:3.0:1789760752.997796:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.997812:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:3.0:1789760752.997817:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760752.997823:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760752.997835:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760753.026925:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972872 is committed
00002000:00010000:0.0:1789760753.027008:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22740992 -> 22745088
00010000:00010000:0.0:1789760753.027022:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.027034:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.027042:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.027049:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760753.027054:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.027062:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.027079:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.027085:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cab1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22740992->22745087] (req 22740992->22745087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760753.027215:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520970624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29465us (30125us total) trans 4294972872 rc 0/0
00000100:00100000:0.0:1789760753.027354:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5585
00000100:00100000:0.0:1789760753.027363:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724646912723 time 724684418088 state 0x2 ref 0
00000100:00100000:1.0:1789760753.042160:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760753.042375:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520970752
00000100:00100000:2.0:1789760753.042386:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520970752
00000100:00100000:2.0:1789760753.042444:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724646912723 time 724684418088 state 0x0 ref 1
00000100:00100000:2.0:1789760753.042458:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724684678504 time 724684418088 state 0x1 ref 1
00000100:00100000:2.0:1789760753.042521:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724684678504 time 724729203607 state 0x0 ref 1
00000100:00100000:2.0:1789760753.042532:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520970752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760753.042579:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22745088, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:2.0:1789760753.042588:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.042602:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:2.0:1789760753.042605:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760753.042609:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.042620:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760753.069114:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972873 is committed
00002000:00010000:3.0:1789760753.069257:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22745088 -> 22749184
00010000:00010000:3.0:1789760753.069272:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.069396:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.069408:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.069416:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760753.069420:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.069431:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.069451:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.069459:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60cab8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22745088->22749183] (req 22745088->22749183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760753.069676:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520970752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27137us (27517us total) trans 4294972873 rc 0/0
00000100:00100000:0.0:1789760753.069689:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5586
00000100:00100000:0.0:1789760753.069700:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724684678504 time 724729203607 state 0x2 ref 0
00000100:00100000:0.0:1789760753.073665:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760753.073763:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520970880
00000100:00100000:1.0:1789760753.073773:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520970880
00000100:00100000:1.0:1789760753.073826:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724684678504 time 724729203607 state 0x0 ref 1
00000100:00100000:1.0:1789760753.073842:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724729464023 time 724729203607 state 0x1 ref 1
00000100:00100000:1.0:1789760753.073900:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724729464023 time 724760582372 state 0x0 ref 1
00000100:00100000:1.0:1789760753.073912:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520970880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760753.073957:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22749184, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:1.0:1789760753.073967:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.073982:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:1.0:1789760753.073986:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760753.073992:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.074005:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760753.111822:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972874 is committed
00002000:00010000:2.0:1789760753.112041:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22749184 -> 22753280
00010000:00010000:2.0:1789760753.112056:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.112069:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.112078:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.112086:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760753.112091:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.112101:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.112119:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.112126:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cabf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22749184->22753279] (req 22749184->22753279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760753.112528:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520970880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38611us (38875us total) trans 4294972874 rc 0/0
00000100:00100000:3.0:1789760753.112540:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5587
00000100:00100000:3.0:1789760753.112549:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724729464023 time 724760582372 state 0x2 ref 0
00000100:00100000:3.0:1789760753.119538:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.119641:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520971008
00000100:00100000:0.0:1789760753.119650:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520971008
00000100:00100000:0.0:1789760753.119871:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724729464023 time 724760582372 state 0x0 ref 1
00000100:00100000:0.0:1789760753.119887:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724760842788 time 724760582372 state 0x1 ref 1
00000100:00100000:0.0:1789760753.120026:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724760842788 time 724806707809 state 0x0 ref 1
00000100:00100000:0.0:1789760753.120041:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520971008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.120092:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22753280, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:0.0:1789760753.120101:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.120118:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:0.0:1789760753.120123:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.120130:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.120144:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760753.170027:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972875 is committed
00002000:00010000:0.0:1789760753.170112:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22753280 -> 22757376
00010000:00010000:0.0:1789760753.170128:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.170142:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.170151:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.170159:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760753.170164:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.170173:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.170260:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.170270:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cac6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22753280->22757375] (req 22753280->22757375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760753.170563:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520971008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50519us (51030us total) trans 4294972875 rc 0/0
00000100:00100000:0.0:1789760753.170575:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5588
00000100:00100000:0.0:1789760753.170584:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724760842788 time 724806707809 state 0x2 ref 0
00000100:00100000:1.0:1789760753.176551:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.176628:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520971136
00000100:00100000:0.0:1789760753.176637:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520971136
00000100:00100000:0.0:1789760753.176771:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724760842788 time 724806707809 state 0x0 ref 1
00000100:00100000:0.0:1789760753.176786:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724806968225 time 724806707809 state 0x1 ref 1
00000100:00100000:0.0:1789760753.176818:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724806968225 time 724863501412 state 0x0 ref 1
00000100:00100000:0.0:1789760753.176830:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520971136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.176944:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22757376, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:0.0:1789760753.176954:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.176970:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:0.0:1789760753.176975:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.176983:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.176996:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.209600:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760753.214167:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972876 is committed
00002000:00010000:0.0:1789760753.214356:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22757376 -> 22761472
00010000:00010000:0.0:1789760753.214373:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.214513:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.214522:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.214529:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760753.214534:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.214543:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.214563:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.214570:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cacd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22757376->22761471] (req 22757376->22761471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760753.214662:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520971136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37821us (38108us total) trans 4294972876 rc 0/0
00000100:00100000:0.0:1789760753.214678:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5589
00000100:00100000:0.0:1789760753.214762:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724806968225 time 724863501412 state 0x2 ref 0
00000100:00100000:2.0:1789760753.222619:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.222810:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520971264
00000100:00100000:0.0:1789760753.222820:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520971264
00000100:00100000:0.0:1789760753.222948:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724806968225 time 724863501412 state 0x0 ref 1
00000100:00100000:0.0:1789760753.222962:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724863761828 time 724863501412 state 0x1 ref 1
00000100:00100000:0.0:1789760753.223032:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724863761828 time 724909714542 state 0x0 ref 1
00000100:00100000:0.0:1789760753.223045:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520971264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.223090:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22761472, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:0.0:1789760753.223100:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.223116:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:0.0:1789760753.223121:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.223127:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.223140:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760753.267639:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972877 is committed
00002000:00010000:2.0:1789760753.267947:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22761472 -> 22765568
00010000:00010000:2.0:1789760753.267963:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.267976:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.267984:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.267991:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760753.267996:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.268004:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.268023:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.268030:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cad4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22761472->22765567] (req 22761472->22765567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760753.268159:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520971264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45112us (45545us total) trans 4294972877 rc 0/0
00000100:00100000:2.0:1789760753.268176:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5590
00000100:00100000:2.0:1789760753.268193:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724863761828 time 724909714542 state 0x2 ref 0
00000100:00100000:3.0:1789760753.273671:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.274079:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520971392
00000100:00100000:0.0:1789760753.274088:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520971392
00000100:00100000:0.0:1789760753.274139:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724863761828 time 724909714542 state 0x0 ref 1
00000100:00100000:0.0:1789760753.274154:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724909974958 time 724909714542 state 0x1 ref 1
00000100:00100000:0.0:1789760753.274284:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724909974958 time 724960965056 state 0x0 ref 1
00000100:00100000:0.0:1789760753.274298:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520971392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.274367:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22765568, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:0.0:1789760753.274376:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.274392:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=724s v=(0 0)
00010000:00010000:0.0:1789760753.274396:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.274403:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.274416:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760753.340195:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972878 is committed
00002000:00010000:0.0:1789760753.340361:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22765568 -> 22769664
00010000:00010000:0.0:1789760753.340377:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.340391:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.340400:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.340408:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760753.340413:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.340422:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.340444:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.340451:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60cadb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22765568->22769663] (req 22765568->22769663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760753.340528:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520971392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66228us (66871us total) trans 4294972878 rc 0/0
00000100:00100000:0.0:1789760753.340538:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5591
00000100:00100000:0.0:1789760753.340548:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724909974958 time 724960965056 state 0x2 ref 0
00000100:00100000:3.0:1789760753.343615:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.343730:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520971520
00000100:00100000:0.0:1789760753.343740:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520971520
00000100:00100000:0.0:1789760753.343794:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724909974958 time 724960965056 state 0x0 ref 1
00000100:00100000:0.0:1789760753.343810:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724961225472 time 724960965056 state 0x1 ref 1
00000100:00100000:0.0:1789760753.343831:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724961225472 time 725030513567 state 0x0 ref 1
00000100:00100000:0.0:1789760753.343846:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520971520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.343894:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22769664, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:0.0:1789760753.343902:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.343919:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:0.0:1789760753.343923:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.343930:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.343942:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760753.397574:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972879 is committed
00002000:00010000:3.0:1789760753.397727:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22769664 -> 22773760
00010000:00010000:3.0:1789760753.397743:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.397756:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.397766:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.397898:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760753.397904:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.397913:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.397999:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.398009:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cae2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22769664->22773759] (req 22769664->22773759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760753.398098:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520971520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54249us (54486us total) trans 4294972879 rc 0/0
00000100:00100000:3.0:1789760753.398108:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5592
00000100:00100000:3.0:1789760753.398118:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724961225472 time 725030513567 state 0x2 ref 0
00000100:00100000:2.0:1789760753.403415:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760753.403495:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520971648
00000100:00100000:3.0:1789760753.403506:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520971648
00000100:00100000:3.0:1789760753.403561:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 724961225472 time 725030513567 state 0x0 ref 1
00000100:00100000:3.0:1789760753.403576:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725030773983 time 725030513567 state 0x1 ref 1
00000100:00100000:3.0:1789760753.403598:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725030773983 time 725090280693 state 0x0 ref 1
00000100:00100000:3.0:1789760753.403610:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520971648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760753.403666:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22773760, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:3.0:1789760753.403676:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.403691:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:3.0:1789760753.403696:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760753.403702:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.403716:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760753.430810:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972880 is committed
00002000:00010000:3.0:1789760753.430972:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22773760 -> 22777856
00010000:00010000:3.0:1789760753.430987:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.431000:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.431010:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.431017:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760753.431021:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.431030:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.431048:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.431057:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cae9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22773760->22777855] (req 22773760->22777855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760753.431143:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520971648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27531us (27733us total) trans 4294972880 rc 0/0
00000100:00100000:3.0:1789760753.431153:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5593
00000100:00100000:3.0:1789760753.431162:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725030773983 time 725090280693 state 0x2 ref 0
00000100:00100000:1.0:1789760753.440136:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760753.440233:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520971776
00000100:00100000:2.0:1789760753.440242:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520971776
00000100:00100000:2.0:1789760753.440300:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725030773983 time 725090280693 state 0x0 ref 1
00000100:00100000:2.0:1789760753.440354:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725090541109 time 725090280693 state 0x1 ref 1
00000100:00100000:2.0:1789760753.440380:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725090541109 time 725127063223 state 0x0 ref 1
00000100:00100000:2.0:1789760753.440394:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520971776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760753.440442:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22777856, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:2.0:1789760753.440451:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.440467:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:2.0:1789760753.440471:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760753.440477:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.440492:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760753.473241:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972881 is committed
00002000:00010000:2.0:1789760753.473360:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22777856 -> 22781952
00010000:00010000:2.0:1789760753.473376:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.473395:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.473404:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.473412:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760753.473416:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.473426:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.473444:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.473451:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60caf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22777856->22781951] (req 22777856->22781951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760753.473535:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520971776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33139us (33404us total) trans 4294972881 rc 0/0
00000100:00100000:2.0:1789760753.473545:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5594
00000100:00100000:2.0:1789760753.473554:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725090541109 time 725127063223 state 0x2 ref 0
00000100:00100000:2.0:1789760753.485093:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.485190:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520971904
00000100:00100000:0.0:1789760753.485199:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520971904
00000100:00100000:0.0:1789760753.485249:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725090541109 time 725127063223 state 0x0 ref 1
00000100:00100000:0.0:1789760753.485263:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725127323639 time 725127063223 state 0x1 ref 1
00000100:00100000:0.0:1789760753.485291:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725127323639 time 725171973894 state 0x0 ref 1
00000100:00100000:0.0:1789760753.485303:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520971904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.485382:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22781952, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:0.0:1789760753.485391:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.485412:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:0.0:1789760753.485416:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.485423:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.485436:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760753.537861:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972882 is committed
00002000:00010000:1.0:1789760753.538439:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22781952 -> 22786048
00010000:00010000:1.0:1789760753.538456:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.538469:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.538479:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.538487:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760753.538492:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.538501:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.538521:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.538530:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60caf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22781952->22786047] (req 22781952->22786047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760753.538632:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520971904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53326us (53543us total) trans 4294972882 rc 0/0
00000100:00100000:1.0:1789760753.538643:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5595
00000100:00100000:1.0:1789760753.538661:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725127323639 time 725171973894 state 0x2 ref 0
00000100:00100000:3.0:1789760753.545602:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.546296:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520972032
00000100:00100000:0.0:1789760753.546309:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520972032
00000100:00100000:0.0:1789760753.546395:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725127323639 time 725171973894 state 0x0 ref 1
00000100:00100000:0.0:1789760753.546410:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725172234310 time 725171973894 state 0x1 ref 1
00000100:00100000:0.0:1789760753.546442:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725172234310 time 725233124260 state 0x0 ref 1
00000100:00100000:0.0:1789760753.546454:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520972032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.546504:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22786048, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:0.0:1789760753.546513:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.546528:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:0.0:1789760753.546533:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.546538:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.546555:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760753.606745:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972883 is committed
00002000:00010000:0.0:1789760753.607096:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22786048 -> 22790144
00010000:00010000:0.0:1789760753.607110:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.607119:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.607125:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.607130:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760753.607133:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.607139:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.607153:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.607157:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cafe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22786048->22790143] (req 22786048->22790143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760753.607298:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520972032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60838us (61697us total) trans 4294972883 rc 0/0
00000100:00100000:0.0:1789760753.607309:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5596
00000100:00100000:0.0:1789760753.607358:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725172234310 time 725233124260 state 0x2 ref 0
00000100:00100000:2.0:1789760753.611387:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760753.611527:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520972160
00000100:00100000:3.0:1789760753.611536:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520972160
00000100:00100000:3.0:1789760753.611579:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725172234310 time 725233124260 state 0x0 ref 1
00000100:00100000:3.0:1789760753.611590:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725233384676 time 725233124260 state 0x1 ref 1
00000100:00100000:3.0:1789760753.611611:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725233384676 time 725298293587 state 0x0 ref 1
00000100:00100000:3.0:1789760753.611623:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520972160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760753.611680:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22790144, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:3.0:1789760753.611690:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.611709:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:3.0:1789760753.611714:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760753.611719:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.611739:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760753.643611:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972884 is committed
00002000:00010000:1.0:1789760753.643723:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22790144 -> 22794240
00010000:00010000:1.0:1789760753.643739:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.643753:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.643764:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.643772:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760753.643777:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.643787:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.643807:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.643822:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cb05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22790144->22794239] (req 22790144->22794239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760753.643964:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520972160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32337us (32580us total) trans 4294972884 rc 0/0
00000100:00100000:1.0:1789760753.643975:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5597
00000100:00100000:1.0:1789760753.643986:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725233384676 time 725298293587 state 0x2 ref 0
00000100:00100000:2.0:1789760753.647732:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.647841:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520972288
00000100:00100000:0.0:1789760753.647852:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520972288
00000100:00100000:0.0:1789760753.647902:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725233384676 time 725298293587 state 0x0 ref 1
00000100:00100000:0.0:1789760753.647918:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725298554003 time 725298293587 state 0x1 ref 1
00000100:00100000:0.0:1789760753.647950:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725298554003 time 725334632634 state 0x0 ref 1
00000100:00100000:0.0:1789760753.647962:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520972288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.648013:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22794240, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:0.0:1789760753.648023:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.648038:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:0.0:1789760753.648043:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.648049:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.648062:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760753.678668:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22794240 -> 22798336
00010000:00010000:1.0:1789760753.678688:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.678701:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.678710:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.678718:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760753.678722:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.678730:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.678754:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.678762:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cb0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22794240->22798335] (req 22794240->22798335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760753.678854:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520972288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30888us (31126us total) trans 4294972885 rc 0/0
00000100:00100000:1.0:1789760753.678865:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5598
00000100:00100000:1.0:1789760753.678875:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725298554003 time 725334632634 state 0x2 ref 0
00000001:00080000:3.0:1789760753.679302:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972885 is committed
00000100:00100000:3.0:1789760753.683695:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760753.685341:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520972416
00000100:00100000:1.0:1789760753.685355:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520972416
00000100:00100000:1.0:1789760753.685414:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725298554003 time 725334632634 state 0x0 ref 1
00000100:00100000:1.0:1789760753.685429:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725334893050 time 725334632634 state 0x1 ref 1
00000100:00100000:1.0:1789760753.685462:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725334893050 time 725372145327 state 0x0 ref 1
00000100:00100000:1.0:1789760753.685483:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520972416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760753.685530:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22798336, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:1.0:1789760753.685539:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.685554:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:1.0:1789760753.685559:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760753.685565:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.685578:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760753.746411:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972886 is committed
00002000:00010000:2.0:1789760753.746528:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22798336 -> 22802432
00010000:00010000:2.0:1789760753.746544:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.746556:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.746566:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.746573:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760753.746579:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.746588:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.746607:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.746614:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cb13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22798336->22802431] (req 22798336->22802431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760753.746719:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520972416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61242us (63029us total) trans 4294972886 rc 0/0
00000100:00100000:2.0:1789760753.746732:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5599
00000100:00100000:2.0:1789760753.746742:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725334893050 time 725372145327 state 0x2 ref 0
00000100:00100000:2.0:1789760753.751043:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760753.751107:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520972544
00000100:00100000:3.0:1789760753.751115:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520972544
00000100:00100000:3.0:1789760753.751160:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725334893050 time 725372145327 state 0x0 ref 1
00000100:00100000:3.0:1789760753.751171:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725372405743 time 725372145327 state 0x1 ref 1
00000100:00100000:3.0:1789760753.751199:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725372405743 time 725437883020 state 0x0 ref 1
00000100:00100000:3.0:1789760753.751207:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520972544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760753.751244:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22802432, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:3.0:1789760753.751250:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.751261:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:3.0:1789760753.751265:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760753.751269:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.751280:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760753.779102:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22802432 -> 22806528
00010000:00010000:3.0:1789760753.779121:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.779133:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.779142:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.779149:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760753.779154:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.779163:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.779488:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.779498:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22802432->22806527] (req 22802432->22806527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760753.779599:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520972544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28386us (28558us total) trans 4294972887 rc 0/0
00000100:00100000:3.0:1789760753.779612:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5600
00000100:00100000:3.0:1789760753.779620:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725372405743 time 725437883020 state 0x2 ref 0
00000001:00080000:1.0:1789760753.780258:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972887 is committed
00000100:00100000:1.0:1789760753.783296:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760753.783377:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520972672
00000100:00100000:3.0:1789760753.783386:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520972672
00000100:00100000:3.0:1789760753.783440:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725372405743 time 725437883020 state 0x0 ref 1
00000100:00100000:3.0:1789760753.783455:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725438143436 time 725437883020 state 0x1 ref 1
00000100:00100000:3.0:1789760753.783487:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725438143436 time 725470169820 state 0x0 ref 1
00000100:00100000:3.0:1789760753.783498:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520972672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760753.783541:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22806528, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:3.0:1789760753.783550:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.783564:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:3.0:1789760753.783568:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760753.783573:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.783586:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760753.835234:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22806528 -> 22810624
00010000:00010000:1.0:1789760753.835255:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.835275:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.835285:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.835375:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760753.835381:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.835392:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.835413:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.835423:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cb21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22806528->22810623] (req 22806528->22810623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760753.835590:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972888 is committed
00000100:00100000:1.0:1789760753.835629:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520972672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52127us (52337us total) trans 4294972888 rc 0/0
00000100:00100000:1.0:1789760753.835640:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5601
00000100:00100000:1.0:1789760753.835657:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725438143436 time 725470169820 state 0x2 ref 0
00000100:00100000:2.0:1789760753.839075:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760753.839183:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520972800
00000100:00100000:1.0:1789760753.839192:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520972800
00000100:00100000:1.0:1789760753.839246:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725438143436 time 725470169820 state 0x0 ref 1
00000100:00100000:1.0:1789760753.839261:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725470430236 time 725470169820 state 0x1 ref 1
00000100:00100000:3.0:1789760753.839344:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725470430236 time 725525995842 state 0x0 ref 1
00000100:00100000:3.0:1789760753.839365:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520972800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760753.839417:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22810624, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:3.0:1789760753.839426:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.839554:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:3.0:1789760753.839559:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760753.839565:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760753.839577:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760753.874761:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972889 is committed
00002000:00010000:0.0:1789760753.875368:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22810624 -> 22814720
00010000:00010000:0.0:1789760753.875384:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.875399:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.875408:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.875416:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760753.875421:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.875430:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.875450:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.875458:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cb28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22810624->22814719] (req 22810624->22814719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760753.875559:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520972800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36194us (36489us total) trans 4294972889 rc 0/0
00000100:00100000:0.0:1789760753.875570:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5602
00000100:00100000:0.0:1789760753.875579:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725470430236 time 725525995842 state 0x2 ref 0
00000100:00100000:2.0:1789760753.879529:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760753.879593:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520972928
00000100:00100000:1.0:1789760753.879603:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520972928
00000100:00100000:1.0:1789760753.879669:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725470430236 time 725525995842 state 0x0 ref 1
00000100:00100000:1.0:1789760753.879684:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725526256258 time 725525995842 state 0x1 ref 1
00000100:00100000:1.0:1789760753.879715:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725526256258 time 725566397589 state 0x0 ref 1
00000100:00100000:1.0:1789760753.879728:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520972928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760753.879777:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22814720, mtime: 0x6aad94f2, atime: 0x0, ctime: 0x6aad94f2, blocks: 0xb007
00010000:00010000:1.0:1789760753.879788:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.879804:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:1.0:1789760753.879808:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760753.879883:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.879900:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760753.914668:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972890 is committed
00002000:00010000:1.0:1789760753.914770:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22814720 -> 22818816
00002000:00010000:1.0:1789760753.914774:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760754 -> 1789760755
00002000:00010000:1.0:1789760753.914776:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760754 -> 1789760755
00010000:00010000:1.0:1789760753.914790:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.914802:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.914812:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.914819:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760753.914824:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.914837:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.914855:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.914863:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22814720->22818815] (req 22814720->22818815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760753.914958:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520972928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35227us (35431us total) trans 4294972890 rc 0/0
00000100:00100000:1.0:1789760753.914968:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5603
00000100:00100000:1.0:1789760753.914978:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725526256258 time 725566397589 state 0x2 ref 0
00000100:00100000:1.0:1789760753.919218:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760753.919529:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520973056
00000100:00100000:0.0:1789760753.919539:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520973056
00000100:00100000:0.0:1789760753.919592:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725526256258 time 725566397589 state 0x0 ref 1
00000100:00100000:0.0:1789760753.919609:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725566658005 time 725566397589 state 0x1 ref 1
00000100:00100000:0.0:1789760753.919641:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725566658005 time 725606323733 state 0x0 ref 1
00000100:00100000:0.0:1789760753.919666:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520973056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760753.919714:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22818816, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:0.0:1789760753.919723:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.919739:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:0.0:1789760753.919743:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760753.919754:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760753.919769:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760753.964109:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22818816 -> 22822912
00010000:00010000:1.0:1789760753.964129:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.964143:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.964153:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.964165:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760753.964170:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.964243:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.964263:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760753.964271:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cb36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22818816->22822911] (req 22818816->22822911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760753.964517:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520973056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44849us (45304us total) trans 4294972891 rc 0/0
00000100:00100000:1.0:1789760753.964529:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5604
00000100:00100000:1.0:1789760753.964539:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725566658005 time 725606323733 state 0x2 ref 0
00000001:00080000:3.0:1789760753.967382:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972891 is committed
00000100:00100000:2.0:1789760753.968150:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760753.968262:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520973184
00000100:00100000:3.0:1789760753.968272:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520973184
00000100:00100000:3.0:1789760753.968573:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725566658005 time 725606323733 state 0x0 ref 1
00000100:00100000:3.0:1789760753.968589:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725606584149 time 725606323733 state 0x1 ref 1
00000100:00100000:2.0:1789760753.968714:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725606584149 time 725655394766 state 0x0 ref 1
00000100:00100000:2.0:1789760753.968728:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520973184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760753.968778:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22822912, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:2.0:1789760753.968788:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.968802:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:2.0:1789760753.968806:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760753.968813:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760753.968825:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760754.009001:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22822912 -> 22827008
00010000:00010000:1.0:1789760754.009021:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.009035:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.009049:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.009057:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760754.009063:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.009072:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.009092:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.009100:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cb3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22822912->22827007] (req 22822912->22827007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760754.009198:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520973184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40468us (41049us total) trans 4294972892 rc 0/0
00000100:00100000:1.0:1789760754.009209:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5605
00000100:00100000:1.0:1789760754.009218:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725606584149 time 725655394766 state 0x2 ref 0
00000100:00100000:0.0:1789760754.013744:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760754.013861:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972892 is committed
00000100:00100000:1.0:1789760754.013922:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520973312
00000100:00100000:1.0:1789760754.013931:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520973312
00000100:00100000:1.0:1789760754.013997:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725606584149 time 725655394766 state 0x0 ref 1
00000100:00100000:1.0:1789760754.014012:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725655655182 time 725655394766 state 0x1 ref 1
00000100:00100000:1.0:1789760754.014040:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725655655182 time 725700723421 state 0x0 ref 1
00000100:00100000:1.0:1789760754.014053:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520973312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.014113:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22827008, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:1.0:1789760754.014122:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.014137:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:1.0:1789760754.014142:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.014148:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.014161:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760754.015053:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:1.0:1789760754.056063:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22827008 -> 22831104
00010000:00010000:1.0:1789760754.056084:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.056098:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.056108:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.056117:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760754.056123:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.056133:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.056152:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.056161:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22827008->22831103] (req 22827008->22831103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760754.056264:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520973312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42209us (42526us total) trans 4294972893 rc 0/0
00000100:00100000:1.0:1789760754.056274:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5606
00000001:00080000:3.0:1789760754.057589:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972893 is committed
00000100:00100000:1.0:1789760754.057658:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725655655182 time 725700723421 state 0x2 ref 0
00000100:00100000:1.0:1789760754.059905:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760754.060155:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520973440
00000100:00100000:3.0:1789760754.060165:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520973440
00000100:00100000:3.0:1789760754.060226:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725655655182 time 725700723421 state 0x0 ref 1
00000100:00100000:3.0:1789760754.060240:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725700983837 time 725700723421 state 0x1 ref 1
00000100:00100000:3.0:1789760754.060269:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725700983837 time 725746952090 state 0x0 ref 1
00000100:00100000:3.0:1789760754.060290:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520973440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760754.060363:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22831104, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:3.0:1789760754.060372:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.060387:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:3.0:1789760754.060391:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760754.060397:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.060410:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760754.094077:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972894 is committed
00002000:00010000:3.0:1789760754.094591:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22831104 -> 22835200
00010000:00010000:3.0:1789760754.094609:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.094621:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.094630:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.094642:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760754.094656:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.094666:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.094685:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.094693:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22831104->22835199] (req 22831104->22835199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760754.094782:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520973440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34499us (34884us total) trans 4294972894 rc 0/0
00000100:00100000:3.0:1789760754.094792:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5607
00000100:00100000:3.0:1789760754.094801:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725700983837 time 725746952090 state 0x2 ref 0
00000100:00100000:3.0:1789760754.099856:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760754.099936:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520973568
00000100:00100000:0.0:1789760754.099946:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520973568
00000100:00100000:0.0:1789760754.100001:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725700983837 time 725746952090 state 0x0 ref 1
00000100:00100000:0.0:1789760754.100016:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725747212506 time 725746952090 state 0x1 ref 1
00000100:00100000:0.0:1789760754.100097:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725747212506 time 725786778827 state 0x0 ref 1
00000100:00100000:0.0:1789760754.100111:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520973568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760754.100171:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22835200, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:0.0:1789760754.100191:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.100206:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:0.0:1789760754.100210:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760754.100216:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.100230:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760754.133891:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22835200 -> 22839296
00010000:00010000:2.0:1789760754.133912:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.133926:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.133936:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.133943:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760754.133948:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.133958:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.133976:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.133984:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cb52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22835200->22839295] (req 22835200->22839295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760754.134085:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520973568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33972us (34233us total) trans 4294972895 rc 0/0
00000100:00100000:2.0:1789760754.134096:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5608
00000100:00100000:2.0:1789760754.134106:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725747212506 time 725786778827 state 0x2 ref 0
00000001:00080000:3.0:1789760754.134912:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972895 is committed
00000100:00100000:2.0:1789760754.140775:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760754.140868:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520973696
00000100:00100000:1.0:1789760754.140878:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520973696
00000100:00100000:1.0:1789760754.140931:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725747212506 time 725786778827 state 0x0 ref 1
00000100:00100000:1.0:1789760754.140947:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725787039243 time 725786778827 state 0x1 ref 1
00000100:00100000:1.0:1789760754.140978:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725787039243 time 725827661179 state 0x0 ref 1
00000100:00100000:1.0:1789760754.140991:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520973696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.141046:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22839296, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:1.0:1789760754.141055:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.141071:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:1.0:1789760754.141076:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.141082:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.141096:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760754.178852:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972896 is committed
00002000:00010000:3.0:1789760754.178965:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22839296 -> 22843392
00010000:00010000:3.0:1789760754.178981:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.178995:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.179005:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.179013:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760754.179018:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.179025:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.179045:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.179053:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22839296->22843391] (req 22839296->22843391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760754.179148:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520973696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38154us (38378us total) trans 4294972896 rc 0/0
00000100:00100000:3.0:1789760754.179159:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5609
00000100:00100000:3.0:1789760754.179170:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725787039243 time 725827661179 state 0x2 ref 0
00000100:00100000:1.0:1789760754.182653:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760754.182740:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520973824
00000100:00100000:3.0:1789760754.182750:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520973824
00000100:00100000:3.0:1789760754.182804:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725787039243 time 725827661179 state 0x0 ref 1
00000100:00100000:3.0:1789760754.182819:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725827921595 time 725827661179 state 0x1 ref 1
00000100:00100000:3.0:1789760754.182853:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725827921595 time 725869535070 state 0x0 ref 1
00000100:00100000:3.0:1789760754.182865:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520973824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760754.182912:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22843392, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:3.0:1789760754.182921:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.182937:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:3.0:1789760754.182941:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760754.182948:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.182962:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760754.221959:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22843392 -> 22847488
00010000:00010000:3.0:1789760754.221977:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.221990:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.221999:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.222006:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760754.222011:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.222020:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.222038:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.222046:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22843392->22847487] (req 22843392->22847487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760754.222056:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972897 is committed
00000100:00100000:3.0:1789760754.222137:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520973824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39270us (39498us total) trans 4294972897 rc 0/0
00000100:00100000:3.0:1789760754.222148:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5610
00000100:00100000:3.0:1789760754.222157:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725827921595 time 725869535070 state 0x2 ref 0
00000100:00100000:0.0:1789760754.228182:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760754.228348:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520973952
00000100:00100000:3.0:1789760754.228359:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520973952
00000100:00100000:3.0:1789760754.228424:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725827921595 time 725869535070 state 0x0 ref 1
00000100:00100000:3.0:1789760754.228440:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725869795486 time 725869535070 state 0x1 ref 1
00000100:00100000:1.0:1789760754.228534:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725869795486 time 725915213293 state 0x0 ref 1
00000100:00100000:1.0:1789760754.228550:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520973952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.228598:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22847488, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:1.0:1789760754.228606:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.228622:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:1.0:1789760754.228627:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.228633:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.228658:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.233705:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760754.268686:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972898 is committed
00002000:00010000:1.0:1789760754.268800:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22847488 -> 22851584
00010000:00010000:1.0:1789760754.268816:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.268828:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.268836:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.268842:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760754.268847:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.268856:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.268875:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.268882:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cb67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22847488->22851583] (req 22847488->22851583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760754.268971:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520973952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40419us (40794us total) trans 4294972898 rc 0/0
00000100:00100000:1.0:1789760754.268985:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5611
00000100:00100000:1.0:1789760754.268994:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725869795486 time 725915213293 state 0x2 ref 0
00000100:00100000:0.0:1789760754.272154:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760754.272232:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520974080
00000100:00100000:1.0:1789760754.272241:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520974080
00000100:00100000:1.0:1789760754.272306:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725869795486 time 725915213293 state 0x0 ref 1
00000100:00100000:1.0:1789760754.272340:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725915473709 time 725915213293 state 0x1 ref 1
00000100:00100000:1.0:1789760754.272410:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725915473709 time 725959092187 state 0x0 ref 1
00000100:00100000:1.0:1789760754.272423:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520974080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.272468:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22851584, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:1.0:1789760754.272477:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.272492:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:1.0:1789760754.272496:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.272502:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.272515:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760754.303110:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22851584 -> 22855680
00010000:00010000:0.0:1789760754.303129:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.303147:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.303157:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.303164:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760754.303169:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.303188:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.303206:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.303215:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cb6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22851584->22855679] (req 22851584->22855679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760754.303342:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520974080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30891us (31168us total) trans 4294972899 rc 0/0
00000100:00100000:0.0:1789760754.303353:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5612
00000100:00100000:0.0:1789760754.303362:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725915473709 time 725959092187 state 0x2 ref 0
00000001:00080000:3.0:1789760754.303925:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972899 is committed
00000100:00100000:3.0:1789760754.306932:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760754.307026:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520974208
00000100:00100000:0.0:1789760754.307036:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520974208
00000100:00100000:0.0:1789760754.307089:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725915473709 time 725959092187 state 0x0 ref 1
00000100:00100000:0.0:1789760754.307104:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725959352603 time 725959092187 state 0x1 ref 1
00000100:00100000:0.0:1789760754.307134:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725959352603 time 725993816938 state 0x0 ref 1
00000100:00100000:0.0:1789760754.307147:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520974208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760754.307201:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22855680, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:0.0:1789760754.307210:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.307224:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=725s v=(0 0)
00010000:00010000:0.0:1789760754.307228:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760754.307234:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.307247:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760754.348685:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972900 is committed
00002000:00010000:2.0:1789760754.348798:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22855680 -> 22859776
00010000:00010000:2.0:1789760754.348813:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.348827:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.348836:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.348844:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760754.348849:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.348858:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.348878:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.348886:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cb75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22855680->22859775] (req 22855680->22859775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760754.348967:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520974208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41817us (42041us total) trans 4294972900 rc 0/0
00000100:00100000:2.0:1789760754.348978:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5613
00000100:00100000:2.0:1789760754.348986:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725959352603 time 725993816938 state 0x2 ref 0
00000100:00100000:1.0:1789760754.351740:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760754.351824:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520974336
00000100:00100000:3.0:1789760754.351834:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520974336
00000100:00100000:3.0:1789760754.351882:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725959352603 time 725993816938 state 0x0 ref 1
00000100:00100000:3.0:1789760754.351897:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725994077354 time 725993816938 state 0x1 ref 1
00000100:00100000:3.0:1789760754.351985:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725994077354 time 726038666124 state 0x0 ref 1
00000100:00100000:3.0:1789760754.351999:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520974336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760754.352045:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22859776, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:3.0:1789760754.352064:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.352080:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:3.0:1789760754.352084:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760754.352090:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760754.352103:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760754.391753:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972901 is committed
00002000:00010000:1.0:1789760754.391860:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22859776 -> 22863872
00010000:00010000:1.0:1789760754.391876:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.391889:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.391898:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.391905:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760754.391910:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.391918:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.391936:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.391944:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cb7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22859776->22863871] (req 22859776->22863871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760754.392040:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520974336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40039us (40304us total) trans 4294972901 rc 0/0
00000100:00100000:1.0:1789760754.392051:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5614
00000100:00100000:1.0:1789760754.392060:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725994077354 time 726038666124 state 0x2 ref 0
00000100:00100000:0.0:1789760754.406278:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760754.406615:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520974464
00000100:00100000:1.0:1789760754.406624:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520974464
00000100:00100000:0.0:1789760754.406808:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 725994077354 time 726038666124 state 0x0 ref 1
00000100:00100000:0.0:1789760754.406824:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726038926540 time 726038666124 state 0x1 ref 1
00000100:00100000:0.0:1789760754.406901:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726038926540 time 726093582098 state 0x0 ref 1
00000100:00100000:0.0:1789760754.406924:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520974464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760754.406975:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22863872, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:0.0:1789760754.406985:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.407001:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:0.0:1789760754.407006:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760754.407012:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.407025:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760754.453400:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22863872 -> 22867968
00010000:00010000:0.0:1789760754.453421:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.453434:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.453441:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.453447:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760754.453451:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.453461:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.453481:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.453489:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22863872->22867967] (req 22863872->22867967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760754.453584:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520974464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46667us (47310us total) trans 4294972902 rc 0/0
00000100:00100000:0.0:1789760754.453594:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5615
00000100:00100000:0.0:1789760754.453604:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726038926540 time 726093582098 state 0x2 ref 0
00000001:00080000:1.0:1789760754.454599:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972902 is committed
00000100:00100000:2.0:1789760754.456659:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760754.456994:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520974592
00000100:00100000:0.0:1789760754.457005:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520974592
00000100:00100000:0.0:1789760754.457060:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726038926540 time 726093582098 state 0x0 ref 1
00000100:00100000:0.0:1789760754.457074:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726093842514 time 726093582098 state 0x1 ref 1
00000100:00100000:0.0:1789760754.457107:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726093842514 time 726143789306 state 0x0 ref 1
00000100:00100000:0.0:1789760754.457127:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520974592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760754.457175:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22867968, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:0.0:1789760754.457185:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.457202:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:0.0:1789760754.457207:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760754.457213:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.457227:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760754.538494:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972903 is committed
00002000:00010000:0.0:1789760754.538599:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22867968 -> 22872064
00010000:00010000:0.0:1789760754.538615:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.538628:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.538637:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.538655:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760754.538660:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.538669:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.538688:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.538697:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cb8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22867968->22872063] (req 22867968->22872063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760754.538785:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520974592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 81663us (82142us total) trans 4294972903 rc 0/0
00000100:00100000:0.0:1789760754.538795:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5616
00000100:00100000:0.0:1789760754.538805:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726093842514 time 726143789306 state 0x2 ref 0
00000100:00100000:1.0:1789760754.541932:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760754.542021:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520974720
00000100:00100000:0.0:1789760754.542030:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520974720
00000100:00100000:0.0:1789760754.542079:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726093842514 time 726143789306 state 0x0 ref 1
00000100:00100000:0.0:1789760754.542095:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726144049722 time 726143789306 state 0x1 ref 1
00000100:00100000:0.0:1789760754.542124:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726144049722 time 726228806042 state 0x0 ref 1
00000100:00100000:0.0:1789760754.542136:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520974720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760754.542194:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22872064, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:0.0:1789760754.542203:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.542219:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:0.0:1789760754.542223:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760754.542229:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.542248:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760754.569475:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972904 is committed
00002000:00010000:0.0:1789760754.569609:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22872064 -> 22876160
00010000:00010000:0.0:1789760754.569625:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.569651:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.569661:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.569669:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760754.569674:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.569683:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.569701:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.569710:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cb91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22872064->22876159] (req 22872064->22876159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760754.569809:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520974720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27669us (27881us total) trans 4294972904 rc 0/0
00000100:00100000:0.0:1789760754.569821:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5617
00000100:00100000:0.0:1789760754.569830:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726144049722 time 726228806042 state 0x2 ref 0
00000100:00100000:2.0:1789760754.574269:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760754.574457:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520974848
00000100:00100000:1.0:1789760754.574467:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520974848
00000100:00100000:1.0:1789760754.574522:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726144049722 time 726228806042 state 0x0 ref 1
00000100:00100000:1.0:1789760754.574537:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726229066458 time 726228806042 state 0x1 ref 1
00000100:00100000:1.0:1789760754.574568:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726229066458 time 726261251135 state 0x0 ref 1
00000100:00100000:1.0:1789760754.574581:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520974848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.574628:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22876160, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:1.0:1789760754.574637:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.574665:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:1.0:1789760754.574670:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.574677:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.574692:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760754.630938:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972905 is committed
00002000:00010000:2.0:1789760754.631044:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22876160 -> 22880256
00010000:00010000:2.0:1789760754.631060:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.631073:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.631083:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.631091:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760754.631095:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.631103:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.631122:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.631130:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cb98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22876160->22880255] (req 22876160->22880255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760754.631443:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520974848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56858us (57178us total) trans 4294972905 rc 0/0
00000100:00100000:2.0:1789760754.631454:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5618
00000100:00100000:2.0:1789760754.631463:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726229066458 time 726261251135 state 0x2 ref 0
00000100:00100000:3.0:1789760754.635704:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760754.635815:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520974976
00000100:00100000:1.0:1789760754.635825:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520974976
00000100:00100000:1.0:1789760754.635878:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726229066458 time 726261251135 state 0x0 ref 1
00000100:00100000:1.0:1789760754.635893:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726261511551 time 726261251135 state 0x1 ref 1
00000100:00100000:1.0:1789760754.635927:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726261511551 time 726322609883 state 0x0 ref 1
00000100:00100000:1.0:1789760754.635939:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520974976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.635988:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22880256, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:1.0:1789760754.635997:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.636013:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:1.0:1789760754.636017:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.636024:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.636038:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760754.694594:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972906 is committed
00002000:00010000:1.0:1789760754.694855:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22880256 -> 22884352
00010000:00010000:1.0:1789760754.694873:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.694886:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.694900:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.694908:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760754.694913:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.694921:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.694941:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.694948:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60cb9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22880256->22884351] (req 22880256->22884351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760754.695045:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520974976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59103us (59344us total) trans 4294972906 rc 0/0
00000100:00100000:1.0:1789760754.695056:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5619
00000100:00100000:1.0:1789760754.695066:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726261511551 time 726322609883 state 0x2 ref 0
00000100:00100000:2.0:1789760754.698685:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760754.698841:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520975104
00000100:00100000:0.0:1789760754.698852:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520975104
00000100:00100000:0.0:1789760754.698903:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726261511551 time 726322609883 state 0x0 ref 1
00000100:00100000:0.0:1789760754.698919:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726322870299 time 726322609883 state 0x1 ref 1
00000100:00100000:0.0:1789760754.698950:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726322870299 time 726385632857 state 0x0 ref 1
00000100:00100000:0.0:1789760754.698964:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520975104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760754.699013:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22884352, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:0.0:1789760754.699022:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.699038:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:0.0:1789760754.699043:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760754.699049:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.699063:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760754.762101:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972907 is committed
00002000:00010000:1.0:1789760754.762206:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22884352 -> 22888448
00010000:00010000:1.0:1789760754.762222:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.762242:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.762251:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.762259:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760754.762265:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.762283:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.762302:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.762310:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cba6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22884352->22888447] (req 22884352->22888447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760754.762603:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520975104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63637us (63922us total) trans 4294972907 rc 0/0
00000100:00100000:1.0:1789760754.762614:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5620
00000100:00100000:1.0:1789760754.762624:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726322870299 time 726385632857 state 0x2 ref 0
00000100:00100000:2.0:1789760754.767634:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760754.767725:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520975232
00000100:00100000:0.0:1789760754.767735:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520975232
00000100:00100000:0.0:1789760754.767787:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726322870299 time 726385632857 state 0x0 ref 1
00000100:00100000:0.0:1789760754.767802:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726385893273 time 726385632857 state 0x1 ref 1
00000100:00100000:0.0:1789760754.767835:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726385893273 time 726454517945 state 0x0 ref 1
00000100:00100000:0.0:1789760754.767848:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520975232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760754.767894:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22888448, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:0.0:1789760754.767904:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.767919:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:0.0:1789760754.767923:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760754.767930:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.767945:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760754.835650:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972908 is committed
00002000:00010000:0.0:1789760754.838457:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22888448 -> 22892544
00010000:00010000:0.0:1789760754.838477:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.838496:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.838505:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.838513:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760754.838518:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.838528:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.838546:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760754.838553:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60cbad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22888448->22892543] (req 22888448->22892543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760754.838663:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520975232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70812us (71034us total) trans 4294972908 rc 0/0
00000100:00100000:0.0:1789760754.838673:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5621
00000100:00100000:0.0:1789760754.838682:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726385893273 time 726454517945 state 0x2 ref 0
00000100:00100000:2.0:1789760754.846444:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760754.846624:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520975360
00000100:00100000:1.0:1789760754.846633:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520975360
00000100:00100000:1.0:1789760754.846696:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726385893273 time 726454517945 state 0x0 ref 1
00000100:00100000:1.0:1789760754.846710:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726454778361 time 726454517945 state 0x1 ref 1
00000100:00100000:1.0:1789760754.846740:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726454778361 time 726533423266 state 0x0 ref 1
00000100:00100000:1.0:1789760754.846752:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520975360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.846800:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22892544, mtime: 0x6aad94f3, atime: 0x0, ctime: 0x6aad94f3, blocks: 0xb007
00010000:00010000:1.0:1789760754.846809:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.846825:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:1.0:1789760754.846829:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.846835:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.846848:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760754.879601:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972909 is committed
00002000:00010000:1.0:1789760754.879754:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22892544 -> 22896640
00002000:00010000:1.0:1789760754.879759:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760755 -> 1789760756
00002000:00010000:1.0:1789760754.879762:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760755 -> 1789760756
00010000:00010000:1.0:1789760754.879789:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.879802:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.879813:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.879822:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760754.879827:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.879836:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.879856:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.879864:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22892544->22896639] (req 22892544->22896639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760754.879965:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520975360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33209us (33527us total) trans 4294972909 rc 0/0
00000100:00100000:1.0:1789760754.879976:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5622
00000100:00100000:1.0:1789760754.879985:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726454778361 time 726533423266 state 0x2 ref 0
00000100:00100000:2.0:1789760754.885215:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760754.887446:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520975488
00000100:00100000:1.0:1789760754.887461:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520975488
00000100:00100000:1.0:1789760754.887518:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726454778361 time 726533423266 state 0x0 ref 1
00000100:00100000:1.0:1789760754.887534:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726533683682 time 726533423266 state 0x1 ref 1
00000100:00100000:1.0:1789760754.887558:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726533683682 time 726574241211 state 0x0 ref 1
00000100:00100000:1.0:1789760754.887572:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520975488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.887620:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22896640, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:1.0:1789760754.887629:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.887660:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:1.0:1789760754.887664:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.887671:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.887685:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760754.928733:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972910 is committed
00002000:00010000:2.0:1789760754.928867:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22896640 -> 22900736
00010000:00010000:2.0:1789760754.928882:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.928895:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.928905:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.928913:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760754.928918:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.928927:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.928953:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.928960:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cbbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22896640->22900735] (req 22896640->22900735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760754.929050:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520975488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41476us (43840us total) trans 4294972910 rc 0/0
00000100:00100000:2.0:1789760754.929061:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5623
00000100:00100000:2.0:1789760754.929070:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726533683682 time 726574241211 state 0x2 ref 0
00000100:00100000:2.0:1789760754.932457:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760754.932590:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520975616
00000100:00100000:1.0:1789760754.932600:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520975616
00000100:00100000:1.0:1789760754.932670:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726533683682 time 726574241211 state 0x0 ref 1
00000100:00100000:1.0:1789760754.932686:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726574501627 time 726574241211 state 0x1 ref 1
00000100:00100000:1.0:1789760754.932718:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726574501627 time 726619399856 state 0x0 ref 1
00000100:00100000:1.0:1789760754.932730:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520975616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760754.932778:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22900736, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:1.0:1789760754.932788:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.932816:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:1.0:1789760754.932821:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760754.932828:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760754.932842:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760754.978819:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972911 is committed
00002000:00010000:2.0:1789760754.978918:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22900736 -> 22904832
00010000:00010000:2.0:1789760754.978934:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.978946:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.978955:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.978962:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760754.978967:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.978980:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.978998:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.979007:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cbc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22900736->22904831] (req 22900736->22904831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760754.979102:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520975616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46369us (46649us total) trans 4294972911 rc 0/0
00000100:00100000:2.0:1789760754.979112:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5624
00000100:00100000:2.0:1789760754.979122:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726574501627 time 726619399856 state 0x2 ref 0
00000100:00100000:0.0:1789760754.984841:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760754.987908:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520975744
00000100:00100000:2.0:1789760754.987923:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520975744
00000100:00100000:2.0:1789760754.987988:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726574501627 time 726619399856 state 0x0 ref 1
00000100:00100000:2.0:1789760754.988003:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726619660272 time 726619399856 state 0x1 ref 1
00000100:00100000:2.0:1789760754.988039:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726619660272 time 726674722398 state 0x0 ref 1
00000100:00100000:2.0:1789760754.988052:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520975744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760754.988100:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22904832, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:2.0:1789760754.988110:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.988125:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:2.0:1789760754.988130:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760754.988135:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760754.988148:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760755.062307:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22904832 -> 22908928
00000001:00080000:0.0:1789760755.062440:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972912 is committed
00010000:00010000:2.0:1789760755.062532:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.064032:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.064055:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.064064:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760755.064070:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.064081:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.064103:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.064114:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cbc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22904832->22908927] (req 22904832->22908927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760755.064269:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520975744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76213us (79434us total) trans 4294972912 rc 0/0
00000100:00100000:2.0:1789760755.064280:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5625
00000100:00100000:2.0:1789760755.064290:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726619660272 time 726674722398 state 0x2 ref 0
00000100:00100000:0.0:1789760755.067763:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760755.067852:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520975872
00000100:00100000:2.0:1789760755.067863:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520975872
00000100:00100000:2.0:1789760755.068111:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726619660272 time 726674722398 state 0x0 ref 1
00000100:00100000:2.0:1789760755.068126:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726674982814 time 726674722398 state 0x1 ref 1
00000100:00100000:2.0:1789760755.068188:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726674982814 time 726754870931 state 0x0 ref 1
00000100:00100000:2.0:1789760755.068198:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520975872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760755.068239:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22908928, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:2.0:1789760755.068246:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.068258:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:2.0:1789760755.068262:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760755.068267:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.068281:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760755.120993:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972913 is committed
00002000:00010000:3.0:1789760755.121247:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22908928 -> 22913024
00010000:00010000:3.0:1789760755.121263:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.121276:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.121287:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.121294:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760755.121299:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.121307:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.121360:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.121369:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22908928->22913023] (req 22908928->22913023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760755.121452:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520975872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53250us (53694us total) trans 4294972913 rc 0/0
00000100:00100000:3.0:1789760755.121461:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5626
00000100:00100000:3.0:1789760755.121470:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726674982814 time 726754870931 state 0x2 ref 0
00000100:00100000:0.0:1789760755.129826:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760755.129992:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520976000
00000100:00100000:1.0:1789760755.130003:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520976000
00000100:00100000:1.0:1789760755.130057:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726674982814 time 726754870931 state 0x0 ref 1
00000100:00100000:1.0:1789760755.130073:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726755131347 time 726754870931 state 0x1 ref 1
00000100:00100000:1.0:1789760755.130103:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726755131347 time 726816786151 state 0x0 ref 1
00000100:00100000:1.0:1789760755.131500:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520976000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760755.139118:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22913024, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:0.0:1789760755.139135:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.139152:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:0.0:1789760755.139156:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760755.139162:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.139179:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760755.187868:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972914 is committed
00002000:00010000:0.0:1789760755.188005:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22913024 -> 22917120
00010000:00010000:0.0:1789760755.188019:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.188032:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.188041:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.188055:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760755.188060:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.188069:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.188086:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.188095:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cbd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22913024->22917119] (req 22913024->22917119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760755.188492:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520976000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57097us (58671us total) trans 4294972914 rc 0/0
00000100:00100000:0.0:1789760755.188504:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5627
00000100:00100000:0.0:1789760755.188513:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726755131347 time 726816786151 state 0x2 ref 0
00000100:00100000:0.0:1789760755.200874:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760755.200990:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520976128
00000100:00100000:1.0:1789760755.201000:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520976128
00000100:00100000:1.0:1789760755.201055:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726755131347 time 726816786151 state 0x0 ref 1
00000100:00100000:1.0:1789760755.201072:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726817046567 time 726816786151 state 0x1 ref 1
00000100:00100000:1.0:1789760755.201106:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726817046567 time 726887788781 state 0x0 ref 1
00000100:00100000:1.0:1789760755.201131:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520976128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760755.201189:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22917120, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:1.0:1789760755.201198:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.201214:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:1.0:1789760755.201218:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760755.201225:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.201238:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760755.254928:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972915 is committed
00002000:00010000:2.0:1789760755.255037:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22917120 -> 22921216
00010000:00010000:2.0:1789760755.255054:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.255068:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.255077:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.255085:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760755.255090:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.255099:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.255118:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.255127:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cbde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22917120->22921215] (req 22917120->22921215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760755.255235:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520976128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54102us (54365us total) trans 4294972915 rc 0/0
00000100:00100000:2.0:1789760755.255245:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5628
00000100:00100000:2.0:1789760755.255255:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726817046567 time 726887788781 state 0x2 ref 0
00010000:00010000:1.0:1789760755.257526:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789760755.258209:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760755.258289:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520976256
00000100:00100000:0.0:1789760755.258300:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520976256
00000100:00100000:0.0:1789760755.258385:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726817046567 time 726887788781 state 0x0 ref 1
00000100:00100000:0.0:1789760755.258399:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726888049197 time 726887788781 state 0x1 ref 1
00000100:00100000:0.0:1789760755.258436:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726888049197 time 726945109802 state 0x0 ref 1
00000100:00100000:0.0:1789760755.258448:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520976256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760755.258491:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22921216, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:0.0:1789760755.258500:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.258515:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:0.0:1789760755.258520:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760755.258526:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.258540:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760755.284992:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22921216 -> 22925312
00010000:00010000:2.0:1789760755.285014:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.285027:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.285038:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.285046:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760755.285051:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.285060:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.285080:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.285093:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cbe5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22921216->22925311] (req 22921216->22925311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760755.285196:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520976256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26744us (26987us total) trans 4294972916 rc 0/0
00000100:00100000:2.0:1789760755.285207:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5629
00000100:00100000:2.0:1789760755.285216:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726888049197 time 726945109802 state 0x2 ref 0
00000001:00080000:0.0:1789760755.286256:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972916 is committed
00000100:00100000:0.0:1789760755.291059:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760755.291146:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520976384
00000100:00100000:2.0:1789760755.291157:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520976384
00000100:00100000:2.0:1789760755.291208:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726888049197 time 726945109802 state 0x0 ref 1
00000100:00100000:2.0:1789760755.291222:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726945370218 time 726945109802 state 0x1 ref 1
00000100:00100000:2.0:1789760755.291257:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726945370218 time 726977939136 state 0x0 ref 1
00000100:00100000:2.0:1789760755.291270:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520976384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760755.291339:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22925312, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:2.0:1789760755.291349:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.291366:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=726s v=(0 0)
00010000:00010000:2.0:1789760755.291371:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760755.291376:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.291395:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760755.321464:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789760755.321487:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda742b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548759552:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1789760755.321559:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760755.321719:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548759552
00000100:00100000:3.0:1789760755.321727:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548759552
00000100:00100000:3.0:1789760755.321779:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437
00000100:00100000:3.0:1789760755.321788:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548759552:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1789760755.321827:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:3.0:1789760755.321891:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548759552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (331us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760755.321899:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437
00000100:00100000:3.0:1789760755.321944:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda742b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548759552:0@lo:41:osp-pre-0-1.0
00002000:00010000:3.0:1789760755.328052:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22925312 -> 22929408
00010000:00010000:3.0:1789760755.328081:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.328095:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.328111:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.328120:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760755.328125:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.328135:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.328155:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.328163:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cbec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22925312->22929407] (req 22925312->22929407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760755.328263:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520976384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36990us (37207us total) trans 4294972917 rc 0/0
00000100:00100000:3.0:1789760755.328274:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5630
00000100:00100000:3.0:1789760755.328283:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726945370218 time 726977939136 state 0x2 ref 0
00000001:00080000:1.0:1789760755.329755:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972917 is committed
00000100:00100000:1.0:1789760755.332259:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760755.332384:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520976512
00000100:00100000:2.0:1789760755.332395:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520976512
00000100:00100000:2.0:1789760755.332447:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726945370218 time 726977939136 state 0x0 ref 1
00000100:00100000:2.0:1789760755.332462:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726978199552 time 726977939136 state 0x1 ref 1
00000100:00100000:2.0:1789760755.332495:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726978199552 time 727019176923 state 0x0 ref 1
00000100:00100000:2.0:1789760755.332518:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520976512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760755.332569:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22929408, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:2.0:1789760755.332578:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.332592:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:2.0:1789760755.332597:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760755.332603:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.332617:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760755.362092:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972918 is committed
00002000:00010000:2.0:1789760755.362275:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22929408 -> 22933504
00010000:00010000:2.0:1789760755.362296:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.362310:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.362336:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.362344:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760755.362348:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.362357:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.362376:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.362393:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cbf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22929408->22933503] (req 22929408->22933503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760755.362482:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520976512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29973us (30228us total) trans 4294972918 rc 0/0
00000100:00100000:2.0:1789760755.362497:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5631
00000100:00100000:2.0:1789760755.362507:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726978199552 time 727019176923 state 0x2 ref 0
00000100:00100000:2.0:1789760755.371100:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760755.371438:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520976640
00000100:00100000:1.0:1789760755.371449:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520976640
00000100:00100000:1.0:1789760755.371501:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 726978199552 time 727019176923 state 0x0 ref 1
00000100:00100000:1.0:1789760755.371516:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727019437339 time 727019176923 state 0x1 ref 1
00000100:00100000:1.0:1789760755.371548:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727019437339 time 727058230550 state 0x0 ref 1
00000100:00100000:1.0:1789760755.371562:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520976640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760755.371610:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22933504, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:1.0:1789760755.371620:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.371644:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:1.0:1789760755.371649:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760755.371655:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.371669:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760755.406857:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22933504 -> 22937600
00010000:00010000:1.0:1789760755.406880:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.406898:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.406909:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.406917:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760755.406922:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.406930:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.406956:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.406963:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cbfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22933504->22937599] (req 22933504->22937599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760755.407063:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520976640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35497us (35965us total) trans 4294972919 rc 0/0
00000100:00100000:1.0:1789760755.407073:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5632
00000100:00100000:1.0:1789760755.407288:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727019437339 time 727058230550 state 0x2 ref 0
00000001:00080000:1.0:1789760755.408384:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972919 is committed
00000100:00100000:0.0:1789760755.411152:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760755.411347:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520976768
00000100:00100000:2.0:1789760755.411358:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520976768
00000100:00100000:2.0:1789760755.411412:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727019437339 time 727058230550 state 0x0 ref 1
00000100:00100000:2.0:1789760755.411427:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727058490966 time 727058230550 state 0x1 ref 1
00000100:00100000:2.0:1789760755.411443:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727058490966 time 727098126316 state 0x0 ref 1
00000100:00100000:2.0:1789760755.411455:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520976768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760755.411502:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22937600, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:2.0:1789760755.411512:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.411527:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:2.0:1789760755.411532:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760755.411538:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.411551:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760755.439766:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972920 is committed
00002000:00010000:2.0:1789760755.439935:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22937600 -> 22941696
00010000:00010000:2.0:1789760755.439950:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.439963:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.439972:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.439979:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760755.439984:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.439993:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.440012:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.440021:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22937600->22941695] (req 22937600->22941695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760755.440109:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520976768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28651us (28960us total) trans 4294972920 rc 0/0
00000100:00100000:2.0:1789760755.440120:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5633
00000100:00100000:2.0:1789760755.440130:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727058490966 time 727098126316 state 0x2 ref 0
00000100:00100000:2.0:1789760755.443859:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760755.444063:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520976896
00000100:00100000:3.0:1789760755.444073:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520976896
00000100:00100000:3.0:1789760755.444128:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727058490966 time 727098126316 state 0x0 ref 1
00000100:00100000:3.0:1789760755.444144:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727098386732 time 727098126316 state 0x1 ref 1
00000100:00100000:3.0:1789760755.444185:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727098386732 time 727130867285 state 0x0 ref 1
00000100:00100000:3.0:1789760755.444198:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520976896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760755.444249:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22941696, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:3.0:1789760755.444259:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.444275:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:3.0:1789760755.444279:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760755.444285:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.444299:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760755.477155:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972921 is committed
00002000:00010000:3.0:1789760755.477391:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22941696 -> 22945792
00010000:00010000:3.0:1789760755.477409:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.477422:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.477431:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.477439:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760755.477444:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.477454:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.477474:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.477481:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22941696->22945791] (req 22941696->22945791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760755.477587:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520976896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33386us (33732us total) trans 4294972921 rc 0/0
00000100:00100000:3.0:1789760755.477601:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5634
00000100:00100000:3.0:1789760755.477610:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727098386732 time 727130867285 state 0x2 ref 0
00000100:00100000:0.0:1789760755.483660:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760755.484770:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520977024
00000100:00100000:2.0:1789760755.484782:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520977024
00000100:00100000:2.0:1789760755.484839:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727098386732 time 727130867285 state 0x0 ref 1
00000100:00100000:2.0:1789760755.484856:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727131127701 time 727130867285 state 0x1 ref 1
00000100:00100000:2.0:1789760755.484937:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727131127701 time 727171619050 state 0x0 ref 1
00000100:00100000:2.0:1789760755.484950:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520977024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760755.484998:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22945792, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:2.0:1789760755.485007:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.485023:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:2.0:1789760755.485028:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760755.485034:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.485047:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760755.513797:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972922 is committed
00002000:00010000:3.0:1789760755.513991:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22945792 -> 22949888
00010000:00010000:3.0:1789760755.514006:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.514018:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.514027:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.514035:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760755.514039:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.514047:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.514064:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.514071:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cc0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22945792->22949887] (req 22945792->22949887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760755.514165:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520977024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29212us (30510us total) trans 4294972922 rc 0/0
00000100:00100000:3.0:1789760755.514175:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5635
00000100:00100000:3.0:1789760755.514185:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727131127701 time 727171619050 state 0x2 ref 0
00000100:00100000:0.0:1789760755.517527:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760755.517686:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520977152
00000100:00100000:1.0:1789760755.517696:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520977152
00000100:00100000:1.0:1789760755.517745:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727131127701 time 727171619050 state 0x0 ref 1
00000100:00100000:1.0:1789760755.517758:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727171879466 time 727171619050 state 0x1 ref 1
00000100:00100000:1.0:1789760755.517784:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727171879466 time 727204467498 state 0x0 ref 1
00000100:00100000:1.0:1789760755.517803:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520977152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760755.517849:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22949888, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:1.0:1789760755.517858:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.517877:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:1.0:1789760755.517881:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760755.517887:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.517900:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760755.574061:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972923 is committed
00002000:00010000:1.0:1789760755.574145:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22949888 -> 22953984
00010000:00010000:1.0:1789760755.574160:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.574181:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.574190:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.574198:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760755.574202:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.574211:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.574229:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.574237:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cc16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22949888->22953983] (req 22949888->22953983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760755.574349:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520977152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56543us (56827us total) trans 4294972923 rc 0/0
00000100:00100000:1.0:1789760755.574359:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5636
00000100:00100000:1.0:1789760755.574368:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727171879466 time 727204467498 state 0x2 ref 0
00000100:00100000:1.0:1789760755.579907:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760755.579997:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520977280
00000100:00100000:0.0:1789760755.580006:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520977280
00000100:00100000:0.0:1789760755.580061:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727171879466 time 727204467498 state 0x0 ref 1
00000100:00100000:0.0:1789760755.580079:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727204727914 time 727204467498 state 0x1 ref 1
00000100:00100000:0.0:1789760755.580108:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727204727914 time 727266790997 state 0x0 ref 1
00000100:00100000:0.0:1789760755.580120:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520977280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760755.580163:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22953984, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:0.0:1789760755.580172:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.580188:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:0.0:1789760755.580192:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760755.580198:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.580211:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760755.636501:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972924 is committed
00002000:00010000:0.0:1789760755.636622:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22953984 -> 22958080
00010000:00010000:0.0:1789760755.636648:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.636661:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.636671:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.636683:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760755.636688:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.636698:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.636718:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.636725:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22953984->22958079] (req 22953984->22958079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760755.636810:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520977280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56687us (56907us total) trans 4294972924 rc 0/0
00000100:00100000:0.0:1789760755.636820:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5637
00000100:00100000:0.0:1789760755.636832:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727204727914 time 727266790997 state 0x2 ref 0
00000100:00100000:0.0:1789760755.641764:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760755.641966:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520977408
00000100:00100000:3.0:1789760755.641974:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520977408
00000100:00100000:3.0:1789760755.642022:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727204727914 time 727266790997 state 0x0 ref 1
00000100:00100000:3.0:1789760755.642036:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727267051413 time 727266790997 state 0x1 ref 1
00000100:00100000:3.0:1789760755.642154:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727267051413 time 727328835275 state 0x0 ref 1
00000100:00100000:3.0:1789760755.642178:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520977408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760755.642226:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22958080, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:3.0:1789760755.642235:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.642250:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:3.0:1789760755.642254:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760755.642260:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.642282:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760755.675397:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972925 is committed
00002000:00010000:0.0:1789760755.675773:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22958080 -> 22962176
00010000:00010000:0.0:1789760755.675789:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.675802:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.675817:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.675825:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760755.675831:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.675840:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.675860:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.675868:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cc24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22958080->22962175] (req 22958080->22962175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760755.675958:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520977408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33789us (34198us total) trans 4294972925 rc 0/0
00000100:00100000:0.0:1789760755.675968:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5638
00000100:00100000:0.0:1789760755.675976:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727267051413 time 727328835275 state 0x2 ref 0
00000100:00100000:2.0:1789760755.680577:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760755.680722:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520977536
00000100:00100000:3.0:1789760755.680731:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520977536
00000100:00100000:3.0:1789760755.680783:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727267051413 time 727328835275 state 0x0 ref 1
00000100:00100000:3.0:1789760755.680798:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727329095691 time 727328835275 state 0x1 ref 1
00000100:00100000:3.0:1789760755.680829:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727329095691 time 727367511400 state 0x0 ref 1
00000100:00100000:3.0:1789760755.680841:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520977536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760755.680887:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22962176, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:3.0:1789760755.680896:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.680912:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:3.0:1789760755.680917:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760755.680923:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760755.680937:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760755.709768:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972926 is committed
00002000:00010000:2.0:1789760755.709894:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22962176 -> 22966272
00010000:00010000:2.0:1789760755.709910:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.709924:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.709933:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.709941:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760755.709946:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.709955:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.709974:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.709982:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22962176->22966271] (req 22962176->22966271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760755.710078:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520977536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29235us (29507us total) trans 4294972926 rc 0/0
00000100:00100000:2.0:1789760755.710090:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5639
00000100:00100000:2.0:1789760755.710099:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727329095691 time 727367511400 state 0x2 ref 0
00000100:00100000:1.0:1789760755.713838:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760755.713943:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520977664
00000100:00100000:2.0:1789760755.713953:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520977664
00000100:00100000:2.0:1789760755.714007:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727329095691 time 727367511400 state 0x0 ref 1
00000100:00100000:2.0:1789760755.714023:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727367771816 time 727367511400 state 0x1 ref 1
00000100:00100000:2.0:1789760755.714098:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727367771816 time 727400780033 state 0x0 ref 1
00000100:00100000:2.0:1789760755.714110:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520977664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760755.714156:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22966272, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:2.0:1789760755.714176:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.714191:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:2.0:1789760755.714196:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760755.714205:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.714219:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760755.742438:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972927 is committed
00002000:00010000:1.0:1789760755.742573:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22966272 -> 22970368
00010000:00010000:1.0:1789760755.742588:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.742600:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.742608:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.742616:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760755.742621:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.742644:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.742663:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.742671:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cc32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22966272->22970367] (req 22966272->22970367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760755.742799:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520977664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28686us (28965us total) trans 4294972927 rc 0/0
00000100:00100000:1.0:1789760755.742810:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5640
00000100:00100000:1.0:1789760755.742819:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727367771816 time 727400780033 state 0x2 ref 0
00000100:00100000:1.0:1789760755.747537:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760755.747653:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520977792
00000100:00100000:0.0:1789760755.747663:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520977792
00000100:00100000:0.0:1789760755.747719:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727367771816 time 727400780033 state 0x0 ref 1
00000100:00100000:0.0:1789760755.747734:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727401040449 time 727400780033 state 0x1 ref 1
00000100:00100000:0.0:1789760755.747769:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727401040449 time 727434451909 state 0x0 ref 1
00000100:00100000:0.0:1789760755.747782:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520977792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760755.747828:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22970368, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:0.0:1789760755.747838:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.747853:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:0.0:1789760755.747858:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760755.747864:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.747878:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760755.782920:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22970368 -> 22974464
00010000:00010000:0.0:1789760755.782940:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.782954:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.782963:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.782970:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760755.782975:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.782983:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.783003:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.783011:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60cc39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22970368->22974463] (req 22970368->22974463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760755.783108:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520977792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35322us (35574us total) trans 4294972928 rc 0/0
00000100:00100000:0.0:1789760755.783119:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5641
00000100:00100000:0.0:1789760755.783128:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727401040449 time 727434451909 state 0x2 ref 0
00000001:00080000:1.0:1789760755.783200:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972928 is committed
00000100:00100000:2.0:1789760755.786720:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760755.788250:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520977920
00000100:00100000:0.0:1789760755.788264:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520977920
00000100:00100000:0.0:1789760755.788339:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727401040449 time 727434451909 state 0x0 ref 1
00000100:00100000:0.0:1789760755.788354:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727434712325 time 727434451909 state 0x1 ref 1
00000100:00100000:0.0:1789760755.788387:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727434712325 time 727475069068 state 0x0 ref 1
00000100:00100000:0.0:1789760755.788400:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520977920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760755.788447:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22974464, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:0.0:1789760755.788456:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.788472:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:0.0:1789760755.788482:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760755.788489:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.788502:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760755.835750:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22974464 -> 22978560
00010000:00010000:0.0:1789760755.835770:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.835783:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.835793:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.835801:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760755.835805:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.835814:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.835839:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.835846:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22974464->22978559] (req 22974464->22978559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760755.835987:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520977920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47585us (49272us total) trans 4294972929 rc 0/0
00000100:00100000:0.0:1789760755.835998:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5642
00000100:00100000:0.0:1789760755.836008:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727434712325 time 727475069068 state 0x2 ref 0
00000001:00080000:1.0:1789760755.836060:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972929 is committed
00000100:00100000:2.0:1789760755.842682:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760755.842855:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520978048
00000100:00100000:0.0:1789760755.842865:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520978048
00000100:00100000:0.0:1789760755.843072:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727434712325 time 727475069068 state 0x0 ref 1
00000100:00100000:0.0:1789760755.843089:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727475329484 time 727475069068 state 0x1 ref 1
00000100:00100000:0.0:1789760755.843155:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727475329484 time 727529836366 state 0x0 ref 1
00000100:00100000:0.0:1789760755.843168:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520978048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760755.843218:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22978560, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:0.0:1789760755.843227:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.843243:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:0.0:1789760755.843248:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760755.843254:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.843269:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760755.888611:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22978560 -> 22982656
00010000:00010000:0.0:1789760755.888641:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.888655:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.888664:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.888671:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760755.888675:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.888684:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.888704:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.888711:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22978560->22982655] (req 22978560->22982655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760755.888872:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520978048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45702us (46194us total) trans 4294972930 rc 0/0
00000100:00100000:0.0:1789760755.888885:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5643
00000100:00100000:0.0:1789760755.888894:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727475329484 time 727529836366 state 0x2 ref 0
00000001:00080000:1.0:1789760755.889552:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972930 is committed
00000100:00100000:2.0:1789760755.893626:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760755.894653:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520978176
00000100:00100000:1.0:1789760755.894664:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520978176
00000100:00100000:1.0:1789760755.894719:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727475329484 time 727529836366 state 0x0 ref 1
00000100:00100000:1.0:1789760755.894734:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727530096782 time 727529836366 state 0x1 ref 1
00000100:00100000:1.0:1789760755.894772:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727530096782 time 727581455453 state 0x0 ref 1
00000100:00100000:1.0:1789760755.894788:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520978176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760755.894836:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22982656, mtime: 0x6aad94f4, atime: 0x0, ctime: 0x6aad94f4, blocks: 0xb007
00010000:00010000:1.0:1789760755.894846:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.894862:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:1.0:1789760755.894868:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760755.894874:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760755.894886:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760755.930904:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972931 is committed
00002000:00010000:0.0:1789760755.931096:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22982656 -> 22986752
00002000:00010000:0.0:1789760755.931101:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760756 -> 1789760757
00002000:00010000:0.0:1789760755.931104:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760756 -> 1789760757
00010000:00010000:0.0:1789760755.931117:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.931130:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.931139:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.931146:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760755.931151:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.931160:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.931178:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.931196:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cc4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22982656->22986751] (req 22982656->22986751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760755.931561:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520978176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36769us (37938us total) trans 4294972931 rc 0/0
00000100:00100000:0.0:1789760755.931571:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5644
00000100:00100000:0.0:1789760755.931581:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727530096782 time 727581455453 state 0x2 ref 0
00000100:00100000:2.0:1789760755.941217:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760755.941294:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520978304
00000100:00100000:0.0:1789760755.941303:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520978304
00000100:00100000:0.0:1789760755.941393:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727530096782 time 727581455453 state 0x0 ref 1
00000100:00100000:0.0:1789760755.941408:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727581715869 time 727581455453 state 0x1 ref 1
00000100:00100000:0.0:1789760755.941438:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727581715869 time 727628120419 state 0x0 ref 1
00000100:00100000:0.0:1789760755.941449:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520978304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760755.941497:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22986752, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760755.941506:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.941521:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:0.0:1789760755.941525:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760755.941530:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.941549:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760755.986131:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22986752 -> 22990848
00010000:00010000:2.0:1789760755.986149:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.986172:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.986182:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.986190:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760755.986195:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.986203:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.986222:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760755.986230:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cc55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22986752->22990847] (req 22986752->22990847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760755.986354:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520978304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44901us (45141us total) trans 4294972932 rc 0/0
00000100:00100000:2.0:1789760755.986365:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5645
00000100:00100000:2.0:1789760755.986375:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727581715869 time 727628120419 state 0x2 ref 0
00000001:00080000:1.0:1789760755.986948:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972932 is committed
00000100:00100000:3.0:1789760755.992095:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760755.992442:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520978432
00000100:00100000:0.0:1789760755.992453:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520978432
00000100:00100000:0.0:1789760755.992509:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727581715869 time 727628120419 state 0x0 ref 1
00000100:00100000:0.0:1789760755.992525:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727628380835 time 727628120419 state 0x1 ref 1
00000100:00100000:0.0:1789760755.992667:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727628380835 time 727679278805 state 0x0 ref 1
00000100:00100000:0.0:1789760755.992681:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520978432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760755.992728:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22990848, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760755.992737:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.992752:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:0.0:1789760755.992756:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760755.992762:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760755.992775:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760756.064641:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972933 is committed
00002000:00010000:2.0:1789760756.065512:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22990848 -> 22994944
00010000:00010000:2.0:1789760756.065530:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.065543:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.065552:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.065560:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760756.065565:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.065574:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.065673:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.065683:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cc5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22990848->22994943] (req 22990848->22994943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760756.065872:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520978432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73188us (73780us total) trans 4294972933 rc 0/0
00000100:00100000:2.0:1789760756.065887:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5646
00000100:00100000:2.0:1789760756.065896:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727628380835 time 727679278805 state 0x2 ref 0
00000100:00100000:2.0:1789760756.080713:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760756.080812:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520978560
00000100:00100000:0.0:1789760756.080821:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520978560
00000100:00100000:0.0:1789760756.080942:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727628380835 time 727679278805 state 0x0 ref 1
00000100:00100000:0.0:1789760756.080956:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727679539221 time 727679278805 state 0x1 ref 1
00000100:00100000:0.0:1789760756.080986:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727679539221 time 727767668987 state 0x0 ref 1
00000100:00100000:0.0:1789760756.080997:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520978560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760756.081043:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22994944, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760756.081052:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.081068:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:0.0:1789760756.081072:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760756.081079:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.081092:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760756.082028:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760756.125654:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972934 is committed
00002000:00010000:0.0:1789760756.125819:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22994944 -> 22999040
00010000:00010000:0.0:1789760756.125835:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.125849:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.125863:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.125870:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760756.125874:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.125883:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.125900:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.125908:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22994944->22999039] (req 22994944->22999039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.125998:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520978560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44998us (45290us total) trans 4294972934 rc 0/0
00000100:00100000:0.0:1789760756.126009:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5647
00000100:00100000:0.0:1789760756.126018:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727679539221 time 727767668987 state 0x2 ref 0
00000100:00100000:2.0:1789760756.135190:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760756.135291:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520978688
00000100:00100000:1.0:1789760756.135300:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520978688
00000100:00100000:1.0:1789760756.135366:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727679539221 time 727767668987 state 0x0 ref 1
00000100:00100000:1.0:1789760756.135380:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727767929403 time 727767668987 state 0x1 ref 1
00000100:00100000:1.0:1789760756.135439:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727767929403 time 727822121930 state 0x0 ref 1
00000100:00100000:1.0:1789760756.135451:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520978688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760756.135508:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 22999040, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:1.0:1789760756.135517:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.135533:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:1.0:1789760756.135538:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760756.135544:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.135558:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760756.157588:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 22999040 -> 23003136
00010000:00010000:1.0:1789760756.157605:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.157618:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.157637:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.157645:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760756.157650:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.157659:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.157676:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.157684:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cc6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [22999040->23003135] (req 22999040->23003135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760756.157765:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520978688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 22312us (22580us total) trans 4294972935 rc 0/0
00000100:00100000:1.0:1789760756.157775:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5648
00000100:00100000:1.0:1789760756.157784:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727767929403 time 727822121930 state 0x2 ref 0
00000001:00080000:3.0:1789760756.158129:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972935 is committed
00000100:00100000:3.0:1789760756.162964:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760756.163088:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520978816
00000100:00100000:2.0:1789760756.163098:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520978816
00000100:00100000:2.0:1789760756.163153:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727767929403 time 727822121930 state 0x0 ref 1
00000100:00100000:2.0:1789760756.163170:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727822382346 time 727822121930 state 0x1 ref 1
00000100:00100000:2.0:1789760756.163204:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727822382346 time 727849885989 state 0x0 ref 1
00000100:00100000:2.0:1789760756.163216:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520978816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760756.163261:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23003136, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:2.0:1789760756.163270:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.163285:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:2.0:1789760756.163290:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760756.163297:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.163339:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760756.206863:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972936 is committed
00002000:00010000:0.0:1789760756.206967:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23003136 -> 23007232
00010000:00010000:0.0:1789760756.206982:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.207001:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.207010:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.207017:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760756.207021:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.207030:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.207049:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.207056:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cc71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23003136->23007231] (req 23003136->23007231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.207203:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520978816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43984us (44244us total) trans 4294972936 rc 0/0
00000100:00100000:0.0:1789760756.207214:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5649
00000100:00100000:0.0:1789760756.207223:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727822382346 time 727849885989 state 0x2 ref 0
00000100:00100000:2.0:1789760756.213196:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760756.213904:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520978944
00000100:00100000:3.0:1789760756.213916:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520978944
00000100:00100000:2.0:1789760756.214045:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727822382346 time 727849885989 state 0x0 ref 1
00000100:00100000:2.0:1789760756.214059:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727850146405 time 727849885989 state 0x1 ref 1
00000100:00100000:2.0:1789760756.214084:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727850146405 time 727900768103 state 0x0 ref 1
00000100:00100000:2.0:1789760756.214096:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520978944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760756.214145:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23007232, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:2.0:1789760756.214154:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.214169:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:2.0:1789760756.214174:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760756.214180:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.214193:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760756.278614:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972937 is committed
00002000:00010000:0.0:1789760756.278781:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23007232 -> 23011328
00010000:00010000:0.0:1789760756.278798:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.278812:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.278822:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.278829:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760756.278835:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.278844:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.278863:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.278871:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cc78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23007232->23011327] (req 23007232->23011327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.279001:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520978944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64903us (65811us total) trans 4294972937 rc 0/0
00000100:00100000:0.0:1789760756.279011:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5650
00000100:00100000:0.0:1789760756.279021:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727850146405 time 727900768103 state 0x2 ref 0
00010000:00010000:0.0:1789760756.281543:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789760756.283435:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760756.283540:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520979072
00000100:00100000:0.0:1789760756.283550:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520979072
00000100:00100000:0.0:1789760756.283602:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727850146405 time 727900768103 state 0x0 ref 1
00000100:00100000:0.0:1789760756.283617:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727901028519 time 727900768103 state 0x1 ref 1
00000100:00100000:0.0:1789760756.283701:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727901028519 time 727970383556 state 0x0 ref 1
00000100:00100000:0.0:1789760756.283713:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520979072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760756.283756:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23011328, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760756.283765:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.283780:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=727s v=(0 0)
00010000:00010000:0.0:1789760756.283785:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760756.283791:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.283806:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.346332:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1789760756.346352:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548759680:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760756.346417:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760756.346483:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548759680
00000100:00100000:0.0:1789760756.346491:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548759680
00000100:00100000:0.0:1789760756.346537:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438
00000100:00100000:0.0:1789760756.346546:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548759680:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1789760756.346584:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:0.0:1789760756.346642:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548759680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (212us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760756.346650:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438
00000100:00100000:0.0:1789760756.346694:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548759680:0@lo:41:osp-pre-1-0.0
00000001:00080000:0.0:1789760756.375134:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972938 is committed
00002000:00010000:1.0:1789760756.375979:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23011328 -> 23015424
00010000:00010000:1.0:1789760756.375995:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.376008:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.376018:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.376024:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760756.376029:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.376038:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.376062:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.376069:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23011328->23015423] (req 23011328->23015423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760756.376357:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520979072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 92603us (92888us total) trans 4294972938 rc 0/0
00000100:00100000:1.0:1789760756.376369:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5651
00000100:00100000:1.0:1789760756.376379:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727901028519 time 727970383556 state 0x2 ref 0
00000100:00100000:0.0:1789760756.384431:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760756.384543:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520979200
00000100:00100000:1.0:1789760756.384554:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520979200
00000100:00100000:1.0:1789760756.384612:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727901028519 time 727970383556 state 0x0 ref 1
00000100:00100000:1.0:1789760756.384640:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727970643972 time 727970383556 state 0x1 ref 1
00000100:00100000:1.0:1789760756.384672:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727970643972 time 728071354697 state 0x0 ref 1
00000100:00100000:1.0:1789760756.384685:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520979200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760756.384732:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23015424, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:1.0:1789760756.384741:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.384756:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:1.0:1789760756.384761:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760756.384767:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.384782:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760756.437099:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972939 is committed
00002000:00010000:1.0:1789760756.437364:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23015424 -> 23019520
00010000:00010000:1.0:1789760756.437379:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.437391:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.437402:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.437409:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760756.437415:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.437425:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.437444:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.437453:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cc86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23015424->23019519] (req 23015424->23019519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760756.437548:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520979200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52860us (53121us total) trans 4294972939 rc 0/0
00000100:00100000:1.0:1789760756.437559:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5652
00000100:00100000:1.0:1789760756.437568:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727970643972 time 728071354697 state 0x2 ref 0
00000100:00100000:2.0:1789760756.447014:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760756.447261:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520979328
00000100:00100000:0.0:1789760756.447271:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520979328
00000100:00100000:0.0:1789760756.447362:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 727970643972 time 728071354697 state 0x0 ref 1
00000100:00100000:0.0:1789760756.447377:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728071615113 time 728071354697 state 0x1 ref 1
00000100:00100000:0.0:1789760756.447409:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728071615113 time 728134091088 state 0x0 ref 1
00000100:00100000:0.0:1789760756.447434:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520979328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760756.447481:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23019520, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760756.447491:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.447507:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760756.447512:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760756.447519:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.447540:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760756.502046:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972940 is committed
00002000:00010000:0.0:1789760756.504208:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23019520 -> 23023616
00010000:00010000:0.0:1789760756.504229:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.504243:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.504252:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.504259:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760756.504265:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.504274:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.504293:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.504301:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cc8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23019520->23023615] (req 23019520->23023615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.506846:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520979328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59415us (59832us total) trans 4294972940 rc 0/0
00000100:00100000:0.0:1789760756.506860:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5653
00000100:00100000:0.0:1789760756.506870:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728071615113 time 728134091088 state 0x2 ref 0
00000100:00100000:2.0:1789760756.515966:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760756.516020:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520979456
00000100:00100000:0.0:1789760756.516030:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520979456
00000100:00100000:0.0:1789760756.516080:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728071615113 time 728134091088 state 0x0 ref 1
00000100:00100000:0.0:1789760756.516096:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728134351504 time 728134091088 state 0x1 ref 1
00000100:00100000:0.0:1789760756.516178:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728134351504 time 728202860077 state 0x0 ref 1
00000100:00100000:0.0:1789760756.516191:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520979456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760756.516237:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23023616, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760756.516246:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.516262:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760756.516266:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760756.516273:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.516286:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760756.546447:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972941 is committed
00002000:00010000:0.0:1789760756.546734:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23023616 -> 23027712
00010000:00010000:0.0:1789760756.546750:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.546763:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.546771:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.546779:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760756.546784:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.546792:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.546812:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.546820:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60cc94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23023616->23027711] (req 23023616->23027711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.546915:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520979456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30721us (30952us total) trans 4294972941 rc 0/0
00000100:00100000:0.0:1789760756.546929:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5654
00000100:00100000:0.0:1789760756.546939:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728134351504 time 728202860077 state 0x2 ref 0
00000100:00100000:1.0:1789760756.552260:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760756.552387:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520979584
00000100:00100000:3.0:1789760756.552396:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520979584
00000100:00100000:3.0:1789760756.552457:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728134351504 time 728202860077 state 0x0 ref 1
00000100:00100000:3.0:1789760756.552472:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728203120493 time 728202860077 state 0x1 ref 1
00000100:00100000:3.0:1789760756.552509:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728203120493 time 728239185508 state 0x0 ref 1
00000100:00100000:3.0:1789760756.552520:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520979584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760756.552562:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23027712, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:3.0:1789760756.552570:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760756.552585:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:3.0:1789760756.552590:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760756.552596:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760756.552609:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760756.578382:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760756.578417:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760756.578600:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760756.578624:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760756.578657:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760756.578683:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520979712
00000100:00100000:1.0:1789760756.578691:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520979712
00000100:00100000:1.0:1789760756.578735:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 476
00000100:00100000:1.0:1789760756.578744:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699520979712:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760756.578811:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699520979712:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 67us (210us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760756.578819:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 476
00000100:00100000:0.0:1789760756.578899:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520979840
00000100:00100000:0.0:1789760756.578904:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520979840
00000100:00100000:0.0:1789760756.578942:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520980096
00000100:00100000:0.0:1789760756.578945:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520980096
00000100:00100000:0.0:1789760756.578957:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520979968
00000100:00100000:0.0:1789760756.578959:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520979968
00000100:00100000:0.0:1789760756.578969:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520980224
00000100:00100000:0.0:1789760756.578971:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520980224
00000100:00100000:0.0:1789760756.578985:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 903
00000100:00100000:0.0:1789760756.578991:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520979840:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760756.579024:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520979840:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (652us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760756.579031:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 903
00000100:00100000:0.0:1789760756.579044:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 904
00000100:00100000:0.0:1789760756.579050:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520980096:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760756.579071:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520980096:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (654us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760756.579077:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 904
00000100:00100000:0.0:1789760756.579088:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 905
00000100:00100000:0.0:1789760756.579094:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520979968:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760756.579117:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520979968:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760756.579126:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 905
00000100:00100000:0.0:1789760756.579138:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 906
00000100:00100000:0.0:1789760756.579145:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520980224:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760756.579593:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699520980224:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 446us (932us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760756.579600:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 906
00000100:00080000:1.0:1789760756.580707:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1789760756.580715:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00002000:00010000:0.0:1789760756.596730:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23027712 -> 23031808
00010000:00010000:0.0:1789760756.596753:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.596767:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.596776:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.596783:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760756.596787:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.596795:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.596813:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.596825:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cc9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23027712->23031807] (req 23027712->23031807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.596930:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520979584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44406us (44674us total) trans 4294972942 rc 0/0
00000100:00100000:0.0:1789760756.596941:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5655
00000100:00100000:0.0:1789760756.596950:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728203120493 time 728239185508 state 0x2 ref 0
00000001:00080000:1.0:1789760756.597024:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972942 is committed
00000100:00100000:1.0:1789760756.601065:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760756.601160:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520980352
00000100:00100000:2.0:1789760756.601180:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520980352
00000100:00100000:2.0:1789760756.601234:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728203120493 time 728239185508 state 0x0 ref 1
00000100:00100000:2.0:1789760756.601251:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728239445924 time 728239185508 state 0x1 ref 1
00000100:00100000:2.0:1789760756.601281:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728239445924 time 728287963644 state 0x0 ref 1
00000100:00100000:2.0:1789760756.601302:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520980352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760756.601382:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23031808, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:2.0:1789760756.601392:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.601407:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:2.0:1789760756.601412:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760756.601418:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.601443:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760756.639842:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23031808 -> 23035904
00010000:00010000:3.0:1789760756.639866:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760756.639881:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760756.639890:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760756.639898:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760756.639902:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760756.639912:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760756.639931:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760756.639938:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60cca2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23031808->23035903] (req 23031808->23035903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760756.640062:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520980352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38758us (39001us total) trans 4294972943 rc 0/0
00000100:00100000:3.0:1789760756.640079:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5656
00000100:00100000:3.0:1789760756.640090:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728239445924 time 728287963644 state 0x2 ref 0
00000001:00080000:0.0:1789760756.640538:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972943 is committed
00000100:00100000:3.0:1789760756.646443:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760756.646621:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520980480
00000100:00100000:1.0:1789760756.646642:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520980480
00000100:00100000:1.0:1789760756.646695:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728239445924 time 728287963644 state 0x0 ref 1
00000100:00100000:1.0:1789760756.646710:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728288224060 time 728287963644 state 0x1 ref 1
00000100:00100000:1.0:1789760756.646741:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728288224060 time 728333424543 state 0x0 ref 1
00000100:00100000:1.0:1789760756.646753:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520980480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760756.646801:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23035904, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:1.0:1789760756.646811:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.646827:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:1.0:1789760756.646831:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760756.646838:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.646851:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760756.691720:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972944 is committed
00002000:00010000:1.0:1789760756.691810:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23035904 -> 23040000
00010000:00010000:1.0:1789760756.691825:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.691839:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.691848:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.691862:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760756.691867:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.691877:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.691898:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760756.691906:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cca9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23035904->23039999] (req 23035904->23039999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760756.692038:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520980480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45281us (45599us total) trans 4294972944 rc 0/0
00000100:00100000:1.0:1789760756.692050:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5657
00000100:00100000:1.0:1789760756.692059:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728288224060 time 728333424543 state 0x2 ref 0
00000100:00100000:1.0:1789760756.695869:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760756.695964:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520980608
00000100:00100000:0.0:1789760756.695973:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520980608
00000100:00100000:0.0:1789760756.696026:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728288224060 time 728333424543 state 0x0 ref 1
00000100:00100000:0.0:1789760756.696042:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728333684959 time 728333424543 state 0x1 ref 1
00000100:00100000:0.0:1789760756.696109:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728333684959 time 728382791414 state 0x0 ref 1
00000100:00100000:0.0:1789760756.696121:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520980608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760756.696175:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23040000, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760756.696184:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.696199:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760756.696204:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760756.696210:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.696225:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760756.762758:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972945 is committed
00002000:00010000:2.0:1789760756.762942:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23040000 -> 23044096
00010000:00010000:2.0:1789760756.762958:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.762970:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.762980:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.762988:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760756.762993:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.763002:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.763020:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.763027:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ccb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23040000->23044095] (req 23040000->23044095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760756.763202:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520980608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67077us (67337us total) trans 4294972945 rc 0/0
00000100:00100000:2.0:1789760756.763213:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5658
00000100:00100000:2.0:1789760756.763222:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728333684959 time 728382791414 state 0x2 ref 0
00000100:00100000:2.0:1789760756.767372:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760756.767446:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520980736
00000100:00100000:0.0:1789760756.767457:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520980736
00000100:00100000:0.0:1789760756.767507:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728333684959 time 728382791414 state 0x0 ref 1
00000100:00100000:0.0:1789760756.767522:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728383051830 time 728382791414 state 0x1 ref 1
00000100:00100000:0.0:1789760756.767553:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728383051830 time 728454235646 state 0x0 ref 1
00000100:00100000:0.0:1789760756.767565:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520980736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760756.767611:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23044096, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760756.767619:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.767646:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760756.767651:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760756.767656:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.767671:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760756.844869:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972946 is committed
00002000:00010000:2.0:1789760756.848374:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23044096 -> 23048192
00010000:00010000:2.0:1789760756.848395:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.848407:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.848422:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.848429:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760756.848434:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.848442:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.848463:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.848470:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ccb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23044096->23048191] (req 23044096->23048191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760756.848573:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520980736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 81006us (81207us total) trans 4294972946 rc 0/0
00000100:00100000:2.0:1789760756.848584:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5659
00000100:00100000:2.0:1789760756.848593:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728383051830 time 728454235646 state 0x2 ref 0
00000100:00100000:3.0:1789760756.851931:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760756.852035:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520980864
00000100:00100000:0.0:1789760756.852045:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520980864
00000100:00100000:0.0:1789760756.852094:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728383051830 time 728454235646 state 0x0 ref 1
00000100:00100000:0.0:1789760756.852110:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728454496062 time 728454235646 state 0x1 ref 1
00000100:00100000:0.0:1789760756.852133:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728454496062 time 728538816006 state 0x0 ref 1
00000100:00100000:0.0:1789760756.852145:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520980864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760756.852190:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23048192, mtime: 0x6aad94f5, atime: 0x0, ctime: 0x6aad94f5, blocks: 0xb007
00010000:00010000:0.0:1789760756.852199:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.852215:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760756.852220:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760756.852226:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.852240:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.858046:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548759808:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1789760756.858106:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760756.858174:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548759808
00000100:00100000:0.0:1789760756.858182:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548759808
00000100:00100000:0.0:1789760756.858236:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370
00000100:00100000:0.0:1789760756.858246:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548759808:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1789760756.858267:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528154624 pending 1703936 free 3835691008 avail 3803185152
00000100:00100000:0.0:1789760756.858333:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548759808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (226us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760756.858340:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370
00000100:00100000:0.0:1789760756.858390:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548759808:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1789760756.858458:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789760756.860606:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548759936:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760756.860741:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760756.860869:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548759936
00000100:00100000:0.0:1789760756.860877:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548759936
00000100:00100000:0.0:1789760756.860943:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371
00000100:00100000:0.0:1789760756.860951:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548759936:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1789760756.860971:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528154624 pending 1703936 free 3835691008 avail 3803185152
00000100:00100000:0.0:1789760756.861013:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548759936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (273us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760756.861021:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371
00000100:00080000:2.0:1789760756.861073:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760756.861188:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548759936:0@lo:13:osp-pre-0-0.0
00002000:00010000:0.0:1789760756.883474:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23048192 -> 23052288
00002000:00010000:0.0:1789760756.883485:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760757 -> 1789760758
00002000:00010000:0.0:1789760756.883488:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760757 -> 1789760758
00010000:00010000:0.0:1789760756.883501:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.883513:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.883523:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.883530:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760756.883535:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.883544:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.883564:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.883573:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23048192->23052287] (req 23048192->23052287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760756.883680:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520980864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31532us (31752us total) trans 4294972947 rc 0/0
00000100:00100000:0.0:1789760756.883690:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5660
00000100:00100000:0.0:1789760756.883699:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728454496062 time 728538816006 state 0x2 ref 0
00000001:00080000:2.0:1789760756.885595:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972947 is committed
00000100:00100000:1.0:1789760756.889578:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760756.890060:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520980992
00000100:00100000:2.0:1789760756.890071:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520980992
00000100:00100000:2.0:1789760756.890128:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728454496062 time 728538816006 state 0x0 ref 1
00000100:00100000:2.0:1789760756.890144:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728539076422 time 728538816006 state 0x1 ref 1
00000100:00100000:2.0:1789760756.890189:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728539076422 time 728576871022 state 0x0 ref 1
00000100:00100000:2.0:1789760756.890202:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520980992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760756.890250:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23052288, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb007
00010000:00010000:2.0:1789760756.890269:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.890285:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:2.0:1789760756.890289:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760756.890295:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.890308:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760756.932845:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972948 is committed
00002000:00010000:2.0:1789760756.932995:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23052288 -> 23056384
00010000:00010000:2.0:1789760756.933010:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.933024:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.933039:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.933047:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760756.933052:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.933060:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.933078:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.933087:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ccc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23052288->23056383] (req 23052288->23056383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760756.933235:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520980992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43031us (43662us total) trans 4294972948 rc 0/0
00000100:00100000:2.0:1789760756.933246:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5661
00000100:00100000:2.0:1789760756.933255:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728539076422 time 728576871022 state 0x2 ref 0
00000100:00100000:3.0:1789760756.943054:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760756.944810:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520981120
00000100:00100000:2.0:1789760756.944823:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520981120
00000100:00100000:2.0:1789760756.944882:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728539076422 time 728576871022 state 0x0 ref 1
00000100:00100000:2.0:1789760756.944898:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728577131438 time 728576871022 state 0x1 ref 1
00000100:00100000:2.0:1789760756.944934:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728577131438 time 728631616363 state 0x0 ref 1
00000100:00100000:2.0:1789760756.944948:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520981120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760756.944995:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23056384, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb007
00010000:00010000:2.0:1789760756.945004:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.945020:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:2.0:1789760756.945023:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760756.945028:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.945038:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760756.994246:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23056384 -> 23060480
00010000:00010000:2.0:1789760756.994266:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.994278:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.994287:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.994294:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760756.994299:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.994308:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.994357:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760756.994366:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cccc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23056384->23060479] (req 23056384->23060479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760756.994595:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520981120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49646us (51545us total) trans 4294972949 rc 0/0
00000100:00100000:2.0:1789760756.994605:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5662
00000100:00100000:2.0:1789760756.994615:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728577131438 time 728631616363 state 0x2 ref 0
00000001:00080000:2.0:1789760756.994781:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972949 is committed
00000100:00100000:3.0:1789760756.997826:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760756.997902:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520981248
00000100:00100000:0.0:1789760756.997910:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520981248
00000100:00100000:0.0:1789760756.997960:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728577131438 time 728631616363 state 0x0 ref 1
00000100:00100000:0.0:1789760756.997976:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728631876779 time 728631616363 state 0x1 ref 1
00000100:00100000:0.0:1789760756.998005:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728631876779 time 728684687740 state 0x0 ref 1
00000100:00100000:0.0:1789760756.998018:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520981248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760756.998065:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23060480, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb007
00010000:00010000:0.0:1789760756.998075:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.998090:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760756.998094:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760756.998101:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760756.998115:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760757.033784:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972950 is committed
00002000:00010000:0.0:1789760757.033875:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23060480 -> 23064576
00010000:00010000:0.0:1789760757.033889:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.033903:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.033914:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.033922:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.033927:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.033938:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.033957:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.033965:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23060480->23064575] (req 23060480->23064575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.034051:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520981248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36029us (36229us total) trans 4294972950 rc 0/0
00000100:00100000:0.0:1789760757.034061:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5663
00000100:00100000:0.0:1789760757.034071:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728631876779 time 728684687740 state 0x2 ref 0
00000100:00100000:2.0:1789760757.037734:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760757.037802:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520981376
00000100:00100000:0.0:1789760757.037811:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520981376
00000100:00100000:0.0:1789760757.037856:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728631876779 time 728684687740 state 0x0 ref 1
00000100:00100000:0.0:1789760757.037869:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728684948156 time 728684687740 state 0x1 ref 1
00000100:00100000:0.0:1789760757.037897:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728684948156 time 728724579966 state 0x0 ref 1
00000100:00100000:0.0:1789760757.037907:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520981376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.037951:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23064576, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb007
00010000:00010000:0.0:1789760757.037959:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.037975:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760757.037979:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.037985:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.037999:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760757.069536:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972951 is committed
00002000:00010000:0.0:1789760757.069670:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23064576 -> 23068672
00010000:00010000:0.0:1789760757.069686:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.069699:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.069708:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.069715:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.069721:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.069730:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.069749:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.069757:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23064576->23068671] (req 23064576->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.069891:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520981376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31980us (32161us total) trans 4294972951 rc 0/0
00000100:00100000:0.0:1789760757.069903:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5664
00000100:00100000:0.0:1789760757.069914:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728684948156 time 728724579966 state 0x2 ref 0
00000100:00100000:3.0:1789760757.072844:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760757.073074:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520981504
00000100:00100000:2.0:1789760757.073083:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520981504
00000100:00100000:2.0:1789760757.073132:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728684948156 time 728724579966 state 0x0 ref 1
00000100:00100000:2.0:1789760757.073146:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728724840382 time 728724579966 state 0x1 ref 1
00000100:00100000:2.0:1789760757.073277:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728724840382 time 728759958299 state 0x0 ref 1
00000100:00100000:2.0:1789760757.073292:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520981504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760757.073432:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23068672, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb007
00010000:00010000:3.0:1789760757.073442:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.073458:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:3.0:1789760757.073463:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760757.073469:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.073483:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760757.108561:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972952 is committed
00002000:00010000:3.0:1789760757.108653:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23068672 -> 23072768
00002000:00010000:3.0:1789760757.108658:0:8103:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 45063 -> 47111
00010000:00010000:3.0:1789760757.108672:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.108692:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.108702:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.108711:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760757.108716:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.108725:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.108745:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.108752:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60cce1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23068672->23072767] (req 23068672->23072767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760757.108888:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520981504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35592us (36045us total) trans 4294972952 rc 0/0
00000100:00100000:3.0:1789760757.108898:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5665
00000100:00100000:3.0:1789760757.108908:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728724840382 time 728759958299 state 0x2 ref 0
00000100:00100000:1.0:1789760757.112581:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760757.112673:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520981632
00000100:00100000:2.0:1789760757.112681:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520981632
00000100:00100000:2.0:1789760757.112727:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728724840382 time 728759958299 state 0x0 ref 1
00000100:00100000:2.0:1789760757.112741:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728760218715 time 728759958299 state 0x1 ref 1
00000100:00100000:2.0:1789760757.112800:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728760218715 time 728799482910 state 0x0 ref 1
00000100:00100000:2.0:1789760757.112812:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520981632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760757.112855:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23072768, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:2.0:1789760757.112863:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.112878:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:2.0:1789760757.112882:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760757.112888:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.112901:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760757.136139:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972953 is committed
00002000:00010000:2.0:1789760757.136388:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23072768 -> 23076864
00010000:00010000:2.0:1789760757.136404:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.136417:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.136428:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.136435:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.136440:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.136450:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.136471:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.136478:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cce8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23072768->23076863] (req 23072768->23076863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.136608:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520981632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23792us (24031us total) trans 4294972953 rc 0/0
00000100:00100000:2.0:1789760757.136618:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5666
00000100:00100000:2.0:1789760757.136638:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728760218715 time 728799482910 state 0x2 ref 0
00000100:00100000:2.0:1789760757.139985:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760757.140210:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520981760
00000100:00100000:0.0:1789760757.140219:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520981760
00000100:00100000:0.0:1789760757.140380:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728760218715 time 728799482910 state 0x0 ref 1
00000100:00100000:0.0:1789760757.140396:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728799743326 time 728799482910 state 0x1 ref 1
00000100:00100000:0.0:1789760757.140459:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728799743326 time 728827141799 state 0x0 ref 1
00000100:00100000:0.0:1789760757.140472:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520981760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.140519:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23076864, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:0.0:1789760757.140529:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.140544:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760757.140548:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.140555:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.140573:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760757.167492:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972954 is committed
00002000:00010000:2.0:1789760757.167591:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23076864 -> 23080960
00010000:00010000:2.0:1789760757.167606:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.167629:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.167638:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.167645:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.167650:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.167659:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.167678:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.167686:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ccef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23076864->23080959] (req 23076864->23080959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.167812:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520981760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27337us (27831us total) trans 4294972954 rc 0/0
00000100:00100000:2.0:1789760757.167823:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5667
00000100:00100000:2.0:1789760757.167833:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728799743326 time 728827141799 state 0x2 ref 0
00000100:00100000:2.0:1789760757.170760:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760757.170848:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520981888
00000100:00100000:0.0:1789760757.170856:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520981888
00000100:00100000:0.0:1789760757.170905:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728799743326 time 728827141799 state 0x0 ref 1
00000100:00100000:0.0:1789760757.170920:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728827402215 time 728827141799 state 0x1 ref 1
00000100:00100000:0.0:1789760757.170974:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728827402215 time 728857656319 state 0x0 ref 1
00000100:00100000:0.0:1789760757.170987:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520981888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.171035:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23080960, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:0.0:1789760757.171044:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.171059:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760757.171063:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.171069:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.171082:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760757.195956:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972955 is committed
00002000:00010000:0.0:1789760757.196038:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23080960 -> 23085056
00010000:00010000:0.0:1789760757.196055:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.196067:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.196076:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.196083:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.196088:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.196097:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.196116:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.196124:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ccf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23080960->23085055] (req 23080960->23085055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.196310:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520981888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25320us (25554us total) trans 4294972955 rc 0/0
00000100:00100000:0.0:1789760757.196420:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5668
00000100:00100000:0.0:1789760757.196431:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728827402215 time 728857656319 state 0x2 ref 0
00000100:00100000:1.0:1789760757.201097:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760757.201240:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520982016
00000100:00100000:3.0:1789760757.201250:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520982016
00000100:00100000:3.0:1789760757.201303:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728827402215 time 728857656319 state 0x0 ref 1
00000100:00100000:3.0:1789760757.201450:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728857916735 time 728857656319 state 0x1 ref 1
00000100:00100000:3.0:1789760757.201523:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728857916735 time 728888205949 state 0x0 ref 1
00000100:00100000:3.0:1789760757.201536:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520982016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760757.201586:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23085056, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:3.0:1789760757.201596:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.201610:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:3.0:1789760757.201613:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760757.201632:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.201646:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760757.229217:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972956 is committed
00002000:00010000:2.0:1789760757.229407:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23085056 -> 23089152
00010000:00010000:2.0:1789760757.229424:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.229438:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.229447:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.229456:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.229461:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.229470:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.229491:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.229499:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ccfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23085056->23089151] (req 23085056->23089151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.229678:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520982016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28139us (28593us total) trans 4294972956 rc 0/0
00000100:00100000:2.0:1789760757.229692:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5669
00000100:00100000:2.0:1789760757.229702:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728857916735 time 728888205949 state 0x2 ref 0
00000100:00100000:1.0:1789760757.239508:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760757.243770:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520982144
00000100:00100000:2.0:1789760757.243785:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520982144
00000100:00100000:0.0:1789760757.244019:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728857916735 time 728888205949 state 0x0 ref 1
00000100:00100000:0.0:1789760757.244033:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728888466365 time 728888205949 state 0x1 ref 1
00000100:00100000:0.0:1789760757.244099:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728888466365 time 728930781737 state 0x0 ref 1
00000100:00100000:0.0:1789760757.244113:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520982144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.244168:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23089152, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:0.0:1789760757.244177:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.244192:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:0.0:1789760757.244196:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.244202:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.244216:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760757.298037:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972957 is committed
00002000:00010000:2.0:1789760757.298105:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23089152 -> 23093248
00010000:00010000:2.0:1789760757.298123:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.298138:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.298147:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.298154:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.298159:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.298169:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.298186:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.298193:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60cd04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23089152->23093247] (req 23089152->23093247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.298292:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520982144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54177us (58788us total) trans 4294972957 rc 0/0
00000100:00100000:2.0:1789760757.298305:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5670
00000100:00100000:2.0:1789760757.298355:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728888466365 time 728930781737 state 0x2 ref 0
00000100:00100000:0.0:1789760757.302932:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760757.303222:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520982272
00000100:00100000:2.0:1789760757.303232:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520982272
00000100:00100000:2.0:1789760757.303293:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728888466365 time 728930781737 state 0x0 ref 1
00000100:00100000:2.0:1789760757.303309:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728931042153 time 728930781737 state 0x1 ref 1
00000100:00100000:2.0:1789760757.303383:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728931042153 time 728990065041 state 0x0 ref 1
00000100:00100000:2.0:1789760757.303402:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520982272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760757.303452:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23093248, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:2.0:1789760757.303461:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.303477:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=728s v=(0 0)
00010000:00010000:2.0:1789760757.303481:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760757.303488:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.303502:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.305465:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760757.353192:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972958 is committed
00002000:00010000:2.0:1789760757.353370:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23093248 -> 23097344
00010000:00010000:2.0:1789760757.353386:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.353400:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.353410:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.353417:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.353422:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.353432:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.353453:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.353460:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23093248->23097343] (req 23093248->23097343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.353740:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520982272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50342us (50812us total) trans 4294972958 rc 0/0
00000100:00100000:2.0:1789760757.353753:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5671
00000100:00100000:2.0:1789760757.353763:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728931042153 time 728990065041 state 0x2 ref 0
00000100:00100000:3.0:1789760757.360924:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760757.361032:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520982400
00000100:00100000:0.0:1789760757.361042:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520982400
00000100:00100000:0.0:1789760757.361096:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728931042153 time 728990065041 state 0x0 ref 1
00000100:00100000:0.0:1789760757.361112:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728990325457 time 728990065041 state 0x1 ref 1
00000100:00100000:0.0:1789760757.361147:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728990325457 time 729047829286 state 0x0 ref 1
00000100:00100000:0.0:1789760757.361159:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520982400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.361807:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23097344, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:0.0:1789760757.361819:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.361835:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:0.0:1789760757.361839:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.361846:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.361861:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760757.397198:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972959 is committed
00002000:00010000:1.0:1789760757.397399:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23097344 -> 23101440
00010000:00010000:1.0:1789760757.397415:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760757.397430:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760757.397440:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760757.397448:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760757.397453:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760757.397464:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760757.397482:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760757.397488:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cd12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23097344->23101439] (req 23097344->23101439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760757.397756:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520982400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36594us (36836us total) trans 4294972959 rc 0/0
00000100:00100000:1.0:1789760757.397769:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5672
00000100:00100000:1.0:1789760757.397779:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728990325457 time 729047829286 state 0x2 ref 0
00000100:00100000:3.0:1789760757.405996:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760757.406829:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520982528
00000100:00100000:2.0:1789760757.406841:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520982528
00000100:00100000:2.0:1789760757.406894:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 728990325457 time 729047829286 state 0x0 ref 1
00000100:00100000:2.0:1789760757.406909:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729048089702 time 729047829286 state 0x1 ref 1
00000100:00100000:2.0:1789760757.406949:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729048089702 time 729093631565 state 0x0 ref 1
00000100:00100000:2.0:1789760757.406962:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520982528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760757.407007:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23101440, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:2.0:1789760757.407015:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.407031:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:2.0:1789760757.407036:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760757.407042:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.407055:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760757.462742:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972960 is committed
00002000:00010000:2.0:1789760757.462851:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23101440 -> 23105536
00010000:00010000:2.0:1789760757.462866:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.462880:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.462889:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.462897:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.462902:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.462912:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.462932:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.462940:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23101440->23105535] (req 23101440->23105535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.463031:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520982528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56067us (57040us total) trans 4294972960 rc 0/0
00000100:00100000:2.0:1789760757.463042:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5673
00000100:00100000:2.0:1789760757.463051:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729048089702 time 729093631565 state 0x2 ref 0
00000100:00100000:0.0:1789760757.471901:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760757.472092:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520982656
00000100:00100000:2.0:1789760757.472105:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520982656
00000100:00100000:2.0:1789760757.472189:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729048089702 time 729093631565 state 0x0 ref 1
00000100:00100000:2.0:1789760757.472209:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729093891981 time 729093631565 state 0x1 ref 1
00000100:00100000:2.0:1789760757.472241:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729093891981 time 729158922897 state 0x0 ref 1
00000100:00100000:2.0:1789760757.472255:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520982656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760757.472371:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23105536, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:2.0:1789760757.472382:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.472400:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:2.0:1789760757.472405:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760757.472413:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.472429:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760757.514378:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972961 is committed
00002000:00010000:2.0:1789760757.514903:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23105536 -> 23109632
00010000:00010000:2.0:1789760757.514935:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.514952:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.514969:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.514978:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.514985:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.514997:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.515030:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.515039:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23105536->23109631] (req 23105536->23109631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.515207:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520982656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42947us (43313us total) trans 4294972961 rc 0/0
00000100:00100000:2.0:1789760757.515221:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5674
00000100:00100000:2.0:1789760757.515233:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729093891981 time 729158922897 state 0x2 ref 0
00000100:00100000:0.0:1789760757.520760:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760757.520926:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520982784
00000100:00100000:2.0:1789760757.520939:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520982784
00000100:00100000:2.0:1789760757.521011:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729093891981 time 729158922897 state 0x0 ref 1
00000100:00100000:2.0:1789760757.521029:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729159183313 time 729158922897 state 0x1 ref 1
00000100:00100000:2.0:1789760757.521065:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729159183313 time 729207746947 state 0x0 ref 1
00000100:00100000:2.0:1789760757.521079:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520982784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760757.521140:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23109632, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:2.0:1789760757.521159:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.521179:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:2.0:1789760757.521184:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760757.521192:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.521208:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760757.559986:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23109632 -> 23113728
00010000:00010000:2.0:1789760757.560012:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.560027:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.560038:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760757.560039:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972962 is committed
00010000:00010000:2.0:1789760757.560050:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.560057:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.560068:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.560090:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.560097:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cd27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23109632->23113727] (req 23109632->23113727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.560871:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520982784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39786us (40119us total) trans 4294972962 rc 0/0
00000100:00100000:2.0:1789760757.560885:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5675
00000100:00100000:2.0:1789760757.560897:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729159183313 time 729207746947 state 0x2 ref 0
00000100:00100000:2.0:1789760757.573584:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760757.573741:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520982912
00000100:00100000:1.0:1789760757.573755:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520982912
00000100:00100000:1.0:1789760757.573832:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729159183313 time 729207746947 state 0x0 ref 1
00000100:00100000:1.0:1789760757.573853:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729208007363 time 729207746947 state 0x1 ref 1
00000100:00100000:1.0:1789760757.573930:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729208007363 time 729260611670 state 0x0 ref 1
00000100:00100000:1.0:1789760757.573946:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520982912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760757.574010:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23113728, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:1.0:1789760757.574021:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760757.574040:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:1.0:1789760757.574045:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760757.574054:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760757.574072:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760757.645698:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23113728 -> 23117824
00010000:00010000:0.0:1789760757.645724:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.645739:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.645756:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.645765:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.645771:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.645782:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.645805:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.645815:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cd2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23113728->23117823] (req 23113728->23117823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.645942:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520982912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 71990us (72364us total) trans 4294972963 rc 0/0
00000100:00100000:0.0:1789760757.645956:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5676
00000100:00100000:0.0:1789760757.645968:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729208007363 time 729260611670 state 0x2 ref 0
00000001:00080000:0.0:1789760757.647381:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972963 is committed
00000100:00100000:0.0:1789760757.650214:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760757.650348:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520983040
00000100:00100000:3.0:1789760757.650359:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520983040
00000100:00100000:3.0:1789760757.650420:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729208007363 time 729260611670 state 0x0 ref 1
00000100:00100000:3.0:1789760757.650435:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729260872086 time 729260611670 state 0x1 ref 1
00000100:00100000:3.0:1789760757.650480:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729260872086 time 729337162306 state 0x0 ref 1
00000100:00100000:3.0:1789760757.650492:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520983040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760757.650549:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23117824, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:3.0:1789760757.650558:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.650573:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:3.0:1789760757.650577:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760757.650584:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.650596:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760757.706817:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23117824 -> 23121920
00010000:00010000:0.0:1789760757.706844:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.706859:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.706869:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.706877:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.706883:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.706894:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.706918:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.706926:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cd35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23117824->23121919] (req 23117824->23121919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.707043:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520983040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56542us (56827us total) trans 4294972964 rc 0/0
00000100:00100000:0.0:1789760757.707055:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5677
00000100:00100000:0.0:1789760757.707065:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729260872086 time 729337162306 state 0x2 ref 0
00000001:00080000:2.0:1789760757.707126:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972964 is committed
00000100:00100000:2.0:1789760757.711040:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760757.711172:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520983168
00000100:00100000:0.0:1789760757.711186:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520983168
00000100:00100000:0.0:1789760757.711259:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729260872086 time 729337162306 state 0x0 ref 1
00000100:00100000:0.0:1789760757.711276:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729337422722 time 729337162306 state 0x1 ref 1
00000100:00100000:0.0:1789760757.711364:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729337422722 time 729397995012 state 0x0 ref 1
00000100:00100000:0.0:1789760757.711379:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520983168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.711453:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23121920, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:0.0:1789760757.711464:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.711484:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:0.0:1789760757.711489:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.711497:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.711513:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760757.748535:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972965 is committed
00002000:00010000:0.0:1789760757.748739:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23121920 -> 23126016
00010000:00010000:0.0:1789760757.748760:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.748775:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.748789:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.748798:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.748803:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.748814:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.748840:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.748849:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cd3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23121920->23126015] (req 23121920->23126015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.748986:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520983168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37600us (37951us total) trans 4294972965 rc 0/0
00000100:00100000:0.0:1789760757.748998:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5678
00000100:00100000:0.0:1789760757.749011:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729337422722 time 729397995012 state 0x2 ref 0
00000100:00100000:2.0:1789760757.753753:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760757.753881:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520983296
00000100:00100000:0.0:1789760757.753894:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520983296
00000100:00100000:0.0:1789760757.754037:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729337422722 time 729397995012 state 0x0 ref 1
00000100:00100000:0.0:1789760757.754056:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729398255428 time 729397995012 state 0x1 ref 1
00000100:00100000:0.0:1789760757.754145:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729398255428 time 729440826054 state 0x0 ref 1
00000100:00100000:0.0:1789760757.754161:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520983296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.754227:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23126016, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:0.0:1789760757.754238:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.754257:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:0.0:1789760757.754262:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.754270:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.754287:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760757.785113:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972966 is committed
00002000:00010000:0.0:1789760757.785309:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23126016 -> 23130112
00010000:00010000:0.0:1789760757.785352:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.785369:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.785379:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.785387:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.785394:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.785404:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.785428:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.785437:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23126016->23130111] (req 23126016->23130111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.785561:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520983296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31396us (31816us total) trans 4294972966 rc 0/0
00000100:00100000:0.0:1789760757.785573:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5679
00000100:00100000:0.0:1789760757.785584:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729398255428 time 729440826054 state 0x2 ref 0
00000100:00100000:1.0:1789760757.796720:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760757.796900:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520983424
00000100:00100000:0.0:1789760757.796913:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520983424
00000100:00100000:0.0:1789760757.796995:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729398255428 time 729440826054 state 0x0 ref 1
00000100:00100000:0.0:1789760757.797015:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729441086470 time 729440826054 state 0x1 ref 1
00000100:00100000:0.0:1789760757.797053:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729441086470 time 729483734688 state 0x0 ref 1
00000100:00100000:0.0:1789760757.797067:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520983424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.797131:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23130112, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:0.0:1789760757.797143:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.797163:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:0.0:1789760757.797168:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.797176:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.797192:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760757.836039:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972967 is committed
00002000:00010000:2.0:1789760757.836051:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23130112 -> 23134208
00010000:00010000:2.0:1789760757.836358:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.836375:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.836390:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.836399:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760757.836405:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.836415:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.836438:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760757.836542:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cd4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23130112->23134207] (req 23130112->23134207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760757.836678:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520983424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39606us (39965us total) trans 4294972967 rc 0/0
00000100:00100000:2.0:1789760757.836691:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5680
00000100:00100000:2.0:1789760757.836702:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729441086470 time 729483734688 state 0x2 ref 0
00000100:00100000:2.0:1789760757.842808:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760757.843012:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520983552
00000100:00100000:3.0:1789760757.843025:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520983552
00000100:00100000:3.0:1789760757.843098:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729441086470 time 729483734688 state 0x0 ref 1
00000100:00100000:3.0:1789760757.843260:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729483995104 time 729483734688 state 0x1 ref 1
00000100:00100000:3.0:1789760757.843380:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729483995104 time 729530060761 state 0x0 ref 1
00000100:00100000:3.0:1789760757.843397:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520983552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760757.843462:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23134208, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:3.0:1789760757.843473:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.843493:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:3.0:1789760757.843499:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760757.843507:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760757.843525:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.881595:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e2f0499-cafa-479a-9c13-a508b560cb61:3456:1876699548760064:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.881700:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.881761:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548760576:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.881787:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548760192:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.881805:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.881830:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548761088:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.881838:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760757.881888:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548760704:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.881924:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.881937:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.881976:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8d9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548761600:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882136:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548760576
00000100:00100000:2.0:1789760757.882147:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548760576
00000100:00100000:2.0:1789760757.882267:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439
00000100:00100000:2.0:1789760757.882279:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548760576:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882379:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548760576:12345-0@lo:400:kworker.0 Request processed in 101us (572us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760757.882387:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439
00000100:00100000:2.0:1789760757.882424:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548760192
00000100:00100000:2.0:1789760757.882428:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548760192
00000100:00100000:2.0:1789760757.882469:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548760704
00000100:00100000:2.0:1789760757.882472:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548760704
00000100:00100000:2.0:1789760757.882510:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907
00000100:00100000:2.0:1789760757.882520:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548760192:12345-0@lo:400:kworker.0
00000100:00080000:3.0:1789760757.882532:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:2.0:1789760757.882564:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548760192:12345-0@lo:400:kworker.0 Request processed in 44us (725us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760757.882571:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907
00000100:00100000:2.0:1789760757.882582:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908
00000100:00100000:2.0:1789760757.882587:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548760704:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882610:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548760704:12345-0@lo:400:kworker.0 Request processed in 23us (686us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760757.882627:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908
00000100:00100000:2.0:1789760757.882710:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548760704:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882719:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548761216:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882744:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760757.882794:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548760192:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882803:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:2.0:1789760757.882809:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548760320:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882831:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760757.882850:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3453:1876699548760832:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882874:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760757.882886:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3453:1876699548761344:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882904:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760757.882925:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548760320
00000100:00100000:2.0:1789760757.882929:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548760320
00000100:00100000:2.0:1789760757.882952:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440
00000100:00100000:2.0:1789760757.882958:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548760320:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.882996:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548760320:12345-0@lo:400:kworker.0 Request processed in 37us (163us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760757.883002:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440
00000100:00100000:2.0:1789760757.883019:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548761216
00000100:00100000:2.0:1789760757.883022:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548761216
00000100:00100000:2.0:1789760757.883045:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548760832
00000100:00100000:2.0:1789760757.883047:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548760832
00000100:00100000:2.0:1789760757.883059:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548761344
00000100:00100000:2.0:1789760757.883062:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548761344
00000100:00100000:2.0:1789760757.883074:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909
00000100:00100000:2.0:1789760757.883079:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548761216:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.883108:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548761216:12345-0@lo:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760757.883114:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909
00000100:00100000:2.0:1789760757.883124:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910
00000100:00100000:2.0:1789760757.883129:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876699548760832:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.883157:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876699548760832:12345-0@lo:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760757.883163:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910
00000100:00100000:2.0:1789760757.883173:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911
00000100:00100000:2.0:1789760757.883178:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876699548761344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.883206:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876699548761344:12345-0@lo:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760757.883212:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911
00000100:00080000:2.0:1789760757.883231:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1789760757.883234:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:2.0:1789760757.883520:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548760320:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.883531:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3453:1876699548760832:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.883539:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3453:1876699548761344:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.883549:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548761216:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.884023:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548760448:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.884084:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.884113:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548760960:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.884141:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.884168:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548761472:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.884191:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.884238:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548760064
00000100:00100000:0.0:1789760757.884245:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548760064
00000100:00100000:0.0:1789760757.884294:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477
00000100:00100000:0.0:1789760757.884306:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3456:x1876699548760064:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760757.884332:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548761856:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760757.884380:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.884390:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3456:x1876699548760064:12345-0@lo:400:kworker.0 Request processed in 86us (2689us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760757.884399:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477
00000100:00100000:1.0:1789760757.884413:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789760757.884424:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda7458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548761728:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760757.884449:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548761088
00000100:00100000:0.0:1789760757.884457:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548761088
00000100:00100000:1.0:1789760757.884460:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.884509:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548760960
00000100:00100000:0.0:1789760757.884514:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548760960
00000100:00100000:1.0:1789760757.884518:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548761856
00000100:00100000:1.0:1789760757.884524:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548761856
00000100:00100000:0.0:1789760757.884545:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548761472
00000100:00100000:0.0:1789760757.884551:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548761472
00000100:00100000:1.0:1789760757.884584:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548761728
00000100:00080000:3.0:1789760757.884584:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:0.0:1789760757.884589:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295
00000100:00100000:1.0:1789760757.884589:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548761728
00000100:00100000:0.0:1789760757.884604:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548761088:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760757.884627:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372
00000100:00100000:1.0:1789760757.884637:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548761856:12345-0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760757.884658:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548761088:12345-0@lo:400:kworker.0 Request processed in 57us (2723us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760757.884666:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295
00002000:00000024:1.0:1789760757.884673:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760757.884684:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296
00000100:00100000:0.0:1789760757.884693:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548760960:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.884735:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548760960:12345-0@lo:400:kworker.0 Request processed in 44us (592us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760757.884741:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296
00000100:00100000:0.0:1789760757.884762:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297
00000100:00100000:0.0:1789760757.884769:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548761472:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.884808:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548761472:12345-0@lo:400:kworker.0 Request processed in 40us (617us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760757.884833:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297
00000100:00100000:1.0:1789760757.884834:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548761856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (440us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760757.884834:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548761856:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760757.884860:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372
00000100:00100000:1.0:1789760757.884888:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373
00000100:00100000:1.0:1789760757.884896:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548761728:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1789760757.884909:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760757.884939:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548761728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (482us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760757.884945:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373
00000100:00100000:3.0:1789760757.885009:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda7458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548761728:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760757.885033:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548760960:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.885051:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548761472:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.885132:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760757.885166:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e2f0499-cafa-479a-9c13-a508b560cb61:3456:1876699548760064:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.885178:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548760576:0@lo:400:kworker.0
00000100:00100000:0.0:1789760757.885189:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548761088:0@lo:400:kworker.0
00000100:00100000:3.0:1789760757.885217:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548761600
00000100:00100000:3.0:1789760757.885227:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548761600
00000100:00100000:3.0:1789760757.885428:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298
00000100:00100000:3.0:1789760757.885442:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548761600:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760757.885531:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548761600:12345-0@lo:400:kworker.0 Request processed in 95us (399us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760757.885542:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298
00000100:00100000:1.0:1789760757.885661:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8d9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548761600:0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.886026:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548760448
00000100:00100000:2.0:1789760757.886033:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548760448
00000100:00100000:2.0:1789760757.886086:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912
00000100:00100000:2.0:1789760757.886094:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548760448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760757.886175:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548760448:12345-0@lo:400:kworker.0 Request processed in 81us (2104us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760757.886182:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912
00000100:00100000:2.0:1789760757.886229:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548760448:0@lo:400:kworker.0
00002000:00010000:0.0:1789760757.901065:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23134208 -> 23138304
00010000:00010000:0.0:1789760757.901107:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.901124:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.901134:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.901143:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.901149:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.901160:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.901189:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.901198:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cd51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23134208->23138303] (req 23134208->23138303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.901424:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520983552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58023us (58623us total) trans 4294972968 rc 0/0
00000100:00100000:0.0:1789760757.901438:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5681
00000100:00100000:0.0:1789760757.901450:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729483995104 time 729530060761 state 0x2 ref 0
00000001:00080000:2.0:1789760757.901654:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972968 is committed
00000100:00100000:0.0:1789760757.910526:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760757.912158:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520983680
00000100:00100000:2.0:1789760757.912177:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520983680
00000100:00100000:2.0:1789760757.912263:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729483995104 time 729530060761 state 0x0 ref 1
00000100:00100000:2.0:1789760757.912284:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729530321177 time 729530060761 state 0x1 ref 1
00000100:00100000:0.0:1789760757.912643:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729530321177 time 729599322566 state 0x0 ref 1
00000100:00100000:0.0:1789760757.914485:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520983680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.914574:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23138304, mtime: 0x6aad94f6, atime: 0x0, ctime: 0x6aad94f6, blocks: 0xb807
00010000:00010000:0.0:1789760757.914585:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.914605:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:0.0:1789760757.914609:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.914626:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.914644:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760757.954254:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972969 is committed
00002000:00010000:0.0:1789760757.954473:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23138304 -> 23142400
00002000:00010000:0.0:1789760757.954478:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760758 -> 1789760759
00002000:00010000:0.0:1789760757.954481:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760758 -> 1789760759
00010000:00010000:0.0:1789760757.954500:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.954514:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.954524:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.954544:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760757.954549:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.954559:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.954584:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.954593:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23138304->23142399] (req 23138304->23142399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760757.954729:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520983680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42066us (44211us total) trans 4294972969 rc 0/0
00000100:00100000:0.0:1789760757.954741:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5682
00000100:00100000:0.0:1789760757.954752:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729530321177 time 729599322566 state 0x2 ref 0
00000100:00100000:1.0:1789760757.963308:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760757.963646:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520983808
00000100:00100000:0.0:1789760757.963659:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520983808
00000100:00100000:0.0:1789760757.963735:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729530321177 time 729599322566 state 0x0 ref 1
00000100:00100000:0.0:1789760757.963757:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729599582982 time 729599322566 state 0x1 ref 1
00000100:00100000:0.0:1789760757.963844:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729599582982 time 729650525225 state 0x0 ref 1
00000100:00100000:0.0:1789760757.963860:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520983808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760757.963927:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23142400, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:0.0:1789760757.963940:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.963961:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:0.0:1789760757.963967:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760757.963975:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760757.963992:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760758.009488:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23142400 -> 23146496
00010000:00010000:0.0:1789760758.009512:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.009528:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.009538:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.009546:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760758.009559:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.009568:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.009591:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.009598:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cd5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23142400->23146495] (req 23142400->23146495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760758.009725:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520983808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45862us (46425us total) trans 4294972970 rc 0/0
00000100:00100000:0.0:1789760758.009740:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5683
00000100:00100000:0.0:1789760758.009752:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729599582982 time 729650525225 state 0x2 ref 0
00000001:00080000:1.0:1789760758.010461:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972970 is committed
00000100:00100000:3.0:1789760758.019626:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760758.022143:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520983936
00000100:00100000:1.0:1789760758.022230:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520983936
00000100:00100000:1.0:1789760758.023237:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729599582982 time 729650525225 state 0x0 ref 1
00000100:00100000:1.0:1789760758.023259:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729650785641 time 729650525225 state 0x1 ref 1
00000100:00100000:1.0:1789760758.023300:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729650785641 time 729709981873 state 0x0 ref 1
00000100:00100000:1.0:1789760758.023338:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520983936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760758.023406:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23146496, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:1.0:1789760758.023418:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.023438:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:1.0:1789760758.023442:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760758.023450:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.023467:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760758.024292:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760758.089751:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972971 is committed
00002000:00010000:2.0:1789760758.089877:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23146496 -> 23150592
00010000:00010000:2.0:1789760758.089898:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.089914:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.089924:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.089933:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760758.089939:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.089950:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.089975:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.089984:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cd66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23146496->23150591] (req 23146496->23150591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760758.090108:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520983936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66789us (70499us total) trans 4294972971 rc 0/0
00000100:00100000:2.0:1789760758.090121:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5684
00000100:00100000:2.0:1789760758.090134:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729650785641 time 729709981873 state 0x2 ref 0
00000100:00100000:3.0:1789760758.093479:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760758.093592:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520984064
00000100:00100000:0.0:1789760758.093605:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520984064
00000100:00100000:0.0:1789760758.093687:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729650785641 time 729709981873 state 0x0 ref 1
00000100:00100000:0.0:1789760758.093706:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729710242289 time 729709981873 state 0x1 ref 1
00000100:00100000:0.0:1789760758.093736:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729710242289 time 729780419106 state 0x0 ref 1
00000100:00100000:0.0:1789760758.093749:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520984064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760758.093809:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23150592, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:0.0:1789760758.093819:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.093838:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:0.0:1789760758.093843:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760758.093850:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.093867:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760758.122744:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972972 is committed
00002000:00010000:0.0:1789760758.122845:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23150592 -> 23154688
00010000:00010000:0.0:1789760758.122868:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.122882:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.122893:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.122902:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760758.122908:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.122919:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.122945:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.122954:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cd6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23150592->23154687] (req 23150592->23154687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760758.123082:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520984064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29326us (29609us total) trans 4294972972 rc 0/0
00000100:00100000:0.0:1789760758.123096:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5685
00000100:00100000:0.0:1789760758.123108:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729710242289 time 729780419106 state 0x2 ref 0
00000100:00100000:0.0:1789760758.127440:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760758.127559:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520984192
00000100:00100000:2.0:1789760758.127574:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520984192
00000100:00100000:2.0:1789760758.127784:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729710242289 time 729780419106 state 0x0 ref 1
00000100:00100000:2.0:1789760758.127804:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729780679522 time 729780419106 state 0x1 ref 1
00000100:00100000:2.0:1789760758.127887:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729780679522 time 729814568080 state 0x0 ref 1
00000100:00100000:2.0:1789760758.127904:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520984192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760758.127973:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23154688, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:2.0:1789760758.127984:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.128005:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:2.0:1789760758.128010:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760758.128018:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.128035:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760758.172818:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23154688 -> 23158784
00010000:00010000:2.0:1789760758.172846:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.172862:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.172872:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.172881:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760758.172887:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.172898:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.172922:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.172931:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23154688->23158783] (req 23154688->23158783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760758.173045:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520984192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45137us (45611us total) trans 4294972973 rc 0/0
00000100:00100000:2.0:1789760758.173062:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5686
00000100:00100000:2.0:1789760758.173074:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729780679522 time 729814568080 state 0x2 ref 0
00000001:00080000:0.0:1789760758.174008:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972973 is committed
00000100:00100000:0.0:1789760758.178305:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760758.178464:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520984320
00000100:00100000:2.0:1789760758.178477:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520984320
00000100:00100000:2.0:1789760758.178550:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729780679522 time 729814568080 state 0x0 ref 1
00000100:00100000:2.0:1789760758.178570:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729814828496 time 729814568080 state 0x1 ref 1
00000100:00100000:2.0:1789760758.178594:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729814828496 time 729865277096 state 0x0 ref 1
00000100:00100000:2.0:1789760758.178608:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520984320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760758.178678:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23158784, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:2.0:1789760758.178689:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.178708:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:2.0:1789760758.178713:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760758.178721:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.178739:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760758.257566:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23158784 -> 23162880
00010000:00010000:2.0:1789760758.257595:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.257611:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.257631:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.257640:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760758.257646:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.257656:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.257679:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.257686:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23158784->23162879] (req 23158784->23162879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760758.257801:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520984320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 79189us (79504us total) trans 4294972974 rc 0/0
00000100:00100000:2.0:1789760758.257813:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5687
00000100:00100000:2.0:1789760758.257825:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729814828496 time 729865277096 state 0x2 ref 0
00000001:00080000:0.0:1789760758.258143:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972974 is committed
00000100:00100000:3.0:1789760758.272633:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760758.277309:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520984448
00000100:00100000:1.0:1789760758.277339:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520984448
00000100:00100000:1.0:1789760758.277424:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729814828496 time 729865277096 state 0x0 ref 1
00000100:00100000:1.0:1789760758.277444:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729865537512 time 729865277096 state 0x1 ref 1
00000100:00100000:3.0:1789760758.278371:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729865537512 time 729965045662 state 0x0 ref 1
00000100:00100000:3.0:1789760758.278401:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520984448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760758.278468:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23162880, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:3.0:1789760758.278480:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.278499:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=729s v=(0 0)
00010000:00010000:3.0:1789760758.278504:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760758.278511:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.278528:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.330650:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760758.339727:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972975 is committed
00002000:00010000:2.0:1789760758.339881:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23162880 -> 23166976
00010000:00010000:2.0:1789760758.339902:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.339917:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.339928:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.339937:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760758.339943:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.339954:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.339979:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.339987:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cd82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23162880->23166975] (req 23162880->23166975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760758.340115:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520984448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61719us (67502us total) trans 4294972975 rc 0/0
00000100:00100000:2.0:1789760758.340128:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5688
00000100:00100000:2.0:1789760758.340140:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729865537512 time 729965045662 state 0x2 ref 0
00000100:00100000:1.0:1789760758.347198:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760758.347434:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520984576
00000100:00100000:0.0:1789760758.347447:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520984576
00000100:00100000:0.0:1789760758.347521:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729865537512 time 729965045662 state 0x0 ref 1
00000100:00100000:0.0:1789760758.347541:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729965306078 time 729965045662 state 0x1 ref 1
00000100:00100000:0.0:1789760758.347633:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729965306078 time 730034314096 state 0x0 ref 1
00000100:00100000:0.0:1789760758.347649:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520984576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760758.347726:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23166976, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:0.0:1789760758.347737:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.347758:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:0.0:1789760758.347763:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760758.347771:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.347789:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760758.401903:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972976 is committed
00002000:00010000:0.0:1789760758.402039:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23166976 -> 23171072
00010000:00010000:0.0:1789760758.402059:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.402074:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.402084:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.402092:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760758.402098:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.402108:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.402134:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.402253:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cd89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23166976->23171071] (req 23166976->23171071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760758.402426:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520984576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54772us (55236us total) trans 4294972976 rc 0/0
00000100:00100000:0.0:1789760758.402438:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5689
00000100:00100000:0.0:1789760758.402451:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729965306078 time 730034314096 state 0x2 ref 0
00000100:00100000:0.0:1789760758.409526:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760758.409770:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520984704
00000100:00100000:2.0:1789760758.409783:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520984704
00000100:00100000:2.0:1789760758.409858:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 729965306078 time 730034314096 state 0x0 ref 1
00000100:00100000:2.0:1789760758.409878:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730034574512 time 730034314096 state 0x1 ref 1
00000100:00100000:2.0:1789760758.409918:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730034574512 time 730096600078 state 0x0 ref 1
00000100:00100000:2.0:1789760758.409934:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520984704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760758.410002:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23171072, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:2.0:1789760758.410014:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.410035:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:2.0:1789760758.410042:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760758.410050:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.410080:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760758.461054:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972977 is committed
00002000:00010000:3.0:1789760758.461429:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23171072 -> 23175168
00010000:00010000:3.0:1789760758.461450:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.461472:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.461483:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.461493:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760758.461499:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.461511:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.461535:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.461545:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cd90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23171072->23175167] (req 23171072->23175167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760758.461682:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520984704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51744us (52165us total) trans 4294972977 rc 0/0
00000100:00100000:3.0:1789760758.461694:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5690
00000100:00100000:3.0:1789760758.461707:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730034574512 time 730096600078 state 0x2 ref 0
00000100:00100000:3.0:1789760758.465705:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760758.465816:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520984832
00000100:00100000:2.0:1789760758.465830:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520984832
00000100:00100000:2.0:1789760758.465900:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730034574512 time 730096600078 state 0x0 ref 1
00000100:00100000:2.0:1789760758.465919:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730096860494 time 730096600078 state 0x1 ref 1
00000100:00100000:2.0:1789760758.465958:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730096860494 time 730152640890 state 0x0 ref 1
00000100:00100000:2.0:1789760758.465973:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520984832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760758.466040:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23175168, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:2.0:1789760758.466051:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.466071:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:2.0:1789760758.466076:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760758.466084:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.466100:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760758.552507:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23175168 -> 23179264
00010000:00010000:3.0:1789760758.552537:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.552554:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.552564:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.552573:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760758.552579:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.552590:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.552623:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.552632:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60cd97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23175168->23179263] (req 23175168->23179263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760758.552756:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520984832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 86777us (87057us total) trans 4294972978 rc 0/0
00000100:00100000:3.0:1789760758.552769:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5691
00000100:00100000:3.0:1789760758.552781:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730096860494 time 730152640890 state 0x2 ref 0
00000001:00080000:1.0:1789760758.553503:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972978 is committed
00000100:00100000:1.0:1789760758.557945:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760758.558030:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520984960
00000100:00100000:3.0:1789760758.558042:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520984960
00000100:00100000:3.0:1789760758.558116:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730096860494 time 730152640890 state 0x0 ref 1
00000100:00100000:3.0:1789760758.558135:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730152901306 time 730152640890 state 0x1 ref 1
00000100:00100000:3.0:1789760758.558177:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730152901306 time 730244858759 state 0x0 ref 1
00000100:00100000:3.0:1789760758.558191:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520984960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760758.558255:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23179264, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:3.0:1789760758.558265:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.558285:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:3.0:1789760758.558290:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760758.558297:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.558363:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760758.589120:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972979 is committed
00002000:00010000:3.0:1789760758.589722:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23179264 -> 23183360
00010000:00010000:3.0:1789760758.589744:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.589760:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.589771:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.589780:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760758.589786:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.589798:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.589825:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.589834:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cd9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23179264->23183359] (req 23179264->23183359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760758.590015:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520984960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31818us (32076us total) trans 4294972979 rc 0/0
00000100:00100000:3.0:1789760758.590029:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5692
00000100:00100000:3.0:1789760758.590040:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730152901306 time 730244858759 state 0x2 ref 0
00000100:00100000:0.0:1789760758.593295:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760758.593487:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520985088
00000100:00100000:2.0:1789760758.593500:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520985088
00000100:00100000:2.0:1789760758.593573:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730152901306 time 730244858759 state 0x0 ref 1
00000100:00100000:2.0:1789760758.593591:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730245119175 time 730244858759 state 0x1 ref 1
00000100:00100000:2.0:1789760758.593635:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730245119175 time 730280316692 state 0x0 ref 1
00000100:00100000:2.0:1789760758.593650:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520985088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760758.593710:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23183360, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:2.0:1789760758.593722:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.593740:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:2.0:1789760758.593745:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760758.593751:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.593766:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760758.660077:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23183360 -> 23187456
00010000:00010000:2.0:1789760758.660103:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.660118:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.660128:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.660136:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760758.660194:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.660205:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.660235:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760758.660243:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cda5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23183360->23187455] (req 23183360->23187455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760758.661105:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520985088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67447us (67813us total) trans 4294972980 rc 0/0
00000100:00100000:2.0:1789760758.661119:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5693
00000100:00100000:2.0:1789760758.661131:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730245119175 time 730280316692 state 0x2 ref 0
00000001:00080000:2.0:1789760758.664641:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972980 is committed
00000100:00100000:1.0:1789760758.664951:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760758.665031:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520985216
00000100:00100000:2.0:1789760758.665043:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520985216
00000100:00100000:2.0:1789760758.665112:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730245119175 time 730280316692 state 0x0 ref 1
00000100:00100000:2.0:1789760758.665131:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730280577108 time 730280316692 state 0x1 ref 1
00000100:00100000:0.0:1789760758.666368:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730280577108 time 730353038650 state 0x0 ref 1
00000100:00100000:0.0:1789760758.666401:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520985216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760758.666473:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23187456, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:0.0:1789760758.666484:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.666505:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:0.0:1789760758.666510:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760758.666518:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.666536:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760758.725969:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972981 is committed
00002000:00010000:1.0:1789760758.726087:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23187456 -> 23191552
00010000:00010000:1.0:1789760758.726107:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.726121:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.726132:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.726140:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760758.726146:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.726155:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.726179:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.726188:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cdac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23187456->23191551] (req 23187456->23191551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760758.726348:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520985216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59922us (61427us total) trans 4294972981 rc 0/0
00000100:00100000:1.0:1789760758.726361:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5694
00000100:00100000:1.0:1789760758.726374:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730280577108 time 730353038650 state 0x2 ref 0
00000100:00100000:3.0:1789760758.729092:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760758.729155:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520985344
00000100:00100000:3.0:1789760758.729169:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520985344
00000100:00100000:3.0:1789760758.729241:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730280577108 time 730353038650 state 0x0 ref 1
00000100:00100000:3.0:1789760758.729458:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730353299066 time 730353038650 state 0x1 ref 1
00000100:00100000:3.0:1789760758.729501:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730353299066 time 730416183436 state 0x0 ref 1
00000100:00100000:3.0:1789760758.729518:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520985344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760758.729588:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23191552, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:3.0:1789760758.729599:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.729632:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:3.0:1789760758.729639:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760758.729646:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.729664:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760758.777805:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972982 is committed
00002000:00010000:0.0:1789760758.777937:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23191552 -> 23195648
00010000:00010000:0.0:1789760758.777961:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.777977:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.777987:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.777996:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760758.778002:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.778013:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.778036:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.778043:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23191552->23195647] (req 23191552->23195647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760758.778170:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520985344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48649us (49084us total) trans 4294972982 rc 0/0
00000100:00100000:0.0:1789760758.778182:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5695
00000100:00100000:0.0:1789760758.778194:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730353299066 time 730416183436 state 0x2 ref 0
00000100:00100000:0.0:1789760758.786099:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760758.786268:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520985472
00000100:00100000:3.0:1789760758.786281:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520985472
00000100:00100000:3.0:1789760758.786394:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730353299066 time 730416183436 state 0x0 ref 1
00000100:00100000:3.0:1789760758.786415:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730416443852 time 730416183436 state 0x1 ref 1
00000100:00100000:3.0:1789760758.786448:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730416443852 time 730473130441 state 0x0 ref 1
00000100:00100000:3.0:1789760758.786462:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520985472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760758.786530:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23195648, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:3.0:1789760758.786541:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.786561:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:3.0:1789760758.786567:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760758.786574:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.786591:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760758.835153:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972983 is committed
00002000:00010000:0.0:1789760758.835714:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23195648 -> 23199744
00010000:00010000:0.0:1789760758.835735:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.835749:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.835765:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.835774:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760758.835859:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.835871:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.835897:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.835905:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cdba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23195648->23199743] (req 23195648->23199743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760758.836042:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520985472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49575us (49951us total) trans 4294972983 rc 0/0
00000100:00100000:0.0:1789760758.836055:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5696
00000100:00100000:0.0:1789760758.836067:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730416443852 time 730473130441 state 0x2 ref 0
00000100:00100000:1.0:1789760758.838731:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760758.838911:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520985600
00000100:00100000:0.0:1789760758.838924:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520985600
00000100:00100000:0.0:1789760758.839016:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730416443852 time 730473130441 state 0x0 ref 1
00000100:00100000:0.0:1789760758.839035:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730473390857 time 730473130441 state 0x1 ref 1
00000100:00100000:0.0:1789760758.839069:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730473390857 time 730525751763 state 0x0 ref 1
00000100:00100000:0.0:1789760758.839082:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520985600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760758.839221:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23199744, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:0.0:1789760758.839233:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.839253:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:0.0:1789760758.839258:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760758.839266:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.839283:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760758.890512:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23199744 -> 23203840
00010000:00010000:0.0:1789760758.890543:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.890559:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.890570:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.890579:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760758.890586:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.890677:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.890704:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.890712:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cdc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23199744->23203839] (req 23199744->23203839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760758.890880:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520985600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51791us (52154us total) trans 4294972984 rc 0/0
00000100:00100000:0.0:1789760758.890902:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5697
00000100:00100000:0.0:1789760758.890915:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730473390857 time 730525751763 state 0x2 ref 0
00000001:00080000:3.0:1789760758.891083:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972984 is committed
00000100:00100000:3.0:1789760758.894743:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760758.894845:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520985728
00000100:00100000:1.0:1789760758.894858:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520985728
00000100:00100000:1.0:1789760758.894986:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730473390857 time 730525751763 state 0x0 ref 1
00000100:00100000:1.0:1789760758.895004:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730526012179 time 730525751763 state 0x1 ref 1
00000100:00100000:1.0:1789760758.895069:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730526012179 time 730581750564 state 0x0 ref 1
00000100:00100000:1.0:1789760758.895083:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520985728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760758.895158:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23203840, mtime: 0x6aad94f7, atime: 0x0, ctime: 0x6aad94f7, blocks: 0xb807
00010000:00010000:1.0:1789760758.895168:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.895188:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:1.0:1789760758.895193:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760758.895201:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.895217:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760758.941496:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972985 is committed
00002000:00010000:1.0:1789760758.941647:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23203840 -> 23207936
00002000:00010000:1.0:1789760758.941653:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760759 -> 1789760760
00002000:00010000:1.0:1789760758.941656:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760759 -> 1789760760
00010000:00010000:1.0:1789760758.941674:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.941689:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.941699:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.941707:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760758.941713:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.941722:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.941745:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760758.941754:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cdc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23203840->23207935] (req 23203840->23207935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760758.941882:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520985728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46795us (47145us total) trans 4294972985 rc 0/0
00000100:00100000:1.0:1789760758.941894:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5698
00000100:00100000:1.0:1789760758.941906:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730526012179 time 730581750564 state 0x2 ref 0
00000100:00100000:1.0:1789760758.944724:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760758.944841:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520985856
00000100:00100000:3.0:1789760758.944855:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520985856
00000100:00100000:3.0:1789760758.944928:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730526012179 time 730581750564 state 0x0 ref 1
00000100:00100000:3.0:1789760758.944947:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730582010980 time 730581750564 state 0x1 ref 1
00000100:00100000:3.0:1789760758.945032:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730582010980 time 730631713418 state 0x0 ref 1
00000100:00100000:3.0:1789760758.945047:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520985856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760758.945120:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23207936, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:3.0:1789760758.945131:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.945154:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:3.0:1789760758.945159:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760758.945168:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760758.945185:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760758.970039:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972986 is committed
00002000:00010000:0.0:1789760758.970183:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23207936 -> 23212032
00010000:00010000:0.0:1789760758.970205:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.970221:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.970232:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.970247:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760758.970253:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.970263:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.970293:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.970301:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cdcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23207936->23212031] (req 23207936->23212031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760758.970979:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520985856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25925us (26259us total) trans 4294972986 rc 0/0
00000100:00100000:0.0:1789760758.970993:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5699
00000100:00100000:0.0:1789760758.971005:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730582010980 time 730631713418 state 0x2 ref 0
00000100:00100000:1.0:1789760758.975631:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760758.975716:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520985984
00000100:00100000:0.0:1789760758.975730:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520985984
00000100:00100000:0.0:1789760758.975807:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730582010980 time 730631713418 state 0x0 ref 1
00000100:00100000:0.0:1789760758.975827:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730631973834 time 730631713418 state 0x1 ref 1
00000100:00100000:0.0:1789760758.975862:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730631973834 time 730662544304 state 0x0 ref 1
00000100:00100000:0.0:1789760758.975881:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520985984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760758.975949:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23212032, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760758.975961:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.975982:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:0.0:1789760758.975987:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760758.975996:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760758.976013:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760759.028423:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972987 is committed
00002000:00010000:0.0:1789760759.028529:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23212032 -> 23216128
00010000:00010000:0.0:1789760759.028544:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.028556:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.028565:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.028572:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760759.028577:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.028586:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.028604:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.028622:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cdd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23212032->23216127] (req 23212032->23216127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760759.028720:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520985984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52838us (53107us total) trans 4294972987 rc 0/0
00000100:00100000:0.0:1789760759.028731:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5700
00000100:00100000:0.0:1789760759.028740:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730631973834 time 730662544304 state 0x2 ref 0
00000100:00100000:3.0:1789760759.031198:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.031464:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520986112
00000100:00100000:0.0:1789760759.031475:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520986112
00000100:00100000:0.0:1789760759.031534:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730631973834 time 730662544304 state 0x0 ref 1
00000100:00100000:0.0:1789760759.031549:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730662804720 time 730662544304 state 0x1 ref 1
00000100:00100000:0.0:1789760759.031627:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730662804720 time 730718309354 state 0x0 ref 1
00000100:00100000:0.0:1789760759.031640:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520986112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.031687:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23216128, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.031706:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.031722:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:0.0:1789760759.031727:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.031733:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.031748:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760759.069022:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23216128 -> 23220224
00010000:00010000:2.0:1789760759.069041:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.069054:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.069070:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.069078:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760759.069082:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.069092:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.069109:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.069118:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cddd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23216128->23220223] (req 23216128->23220223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760759.069215:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520986112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37574us (38022us total) trans 4294972988 rc 0/0
00000100:00100000:2.0:1789760759.069226:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5701
00000100:00100000:2.0:1789760759.069235:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730662804720 time 730718309354 state 0x2 ref 0
00000001:00080000:3.0:1789760759.069376:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972988 is committed
00000100:00100000:3.0:1789760759.076175:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760759.076437:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520986240
00000100:00100000:1.0:1789760759.076448:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520986240
00000100:00100000:1.0:1789760759.076511:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730662804720 time 730718309354 state 0x0 ref 1
00000100:00100000:1.0:1789760759.076526:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730718569770 time 730718309354 state 0x1 ref 1
00000100:00100000:1.0:1789760759.076559:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730718569770 time 730763241195 state 0x0 ref 1
00000100:00100000:1.0:1789760759.076573:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520986240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760759.076635:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23220224, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:1.0:1789760759.076645:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.076660:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:1.0:1789760759.076665:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760759.076671:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.076798:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760759.102807:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972989 is committed
00002000:00010000:0.0:1789760759.102938:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23220224 -> 23224320
00010000:00010000:0.0:1789760759.102954:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.102967:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.102976:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.103092:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760759.103099:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.103108:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.103127:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.103144:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60cde4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23220224->23224319] (req 23220224->23224319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760759.103407:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520986240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26832us (27237us total) trans 4294972989 rc 0/0
00000100:00100000:0.0:1789760759.103418:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5702
00000100:00100000:0.0:1789760759.103428:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730718569770 time 730763241195 state 0x2 ref 0
00000100:00100000:3.0:1789760759.106861:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.107013:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520986368
00000100:00100000:0.0:1789760759.107024:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520986368
00000100:00100000:0.0:1789760759.107078:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730718569770 time 730763241195 state 0x0 ref 1
00000100:00100000:0.0:1789760759.107093:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730763501611 time 730763241195 state 0x1 ref 1
00000100:00100000:0.0:1789760759.107119:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730763501611 time 730793802025 state 0x0 ref 1
00000100:00100000:0.0:1789760759.107132:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520986368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.107308:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23224320, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.107346:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.107359:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:0.0:1789760759.107362:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.107366:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.107382:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760759.135096:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972990 is committed
00002000:00010000:0.0:1789760759.135203:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23224320 -> 23228416
00010000:00010000:0.0:1789760759.135218:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.135230:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.135239:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.135246:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760759.135252:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.135260:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.135279:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.135288:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60cdeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23224320->23228415] (req 23224320->23228415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760759.135474:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520986368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28338us (28618us total) trans 4294972990 rc 0/0
00000100:00100000:0.0:1789760759.135485:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5703
00000100:00100000:0.0:1789760759.135499:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730763501611 time 730793802025 state 0x2 ref 0
00000100:00100000:2.0:1789760759.139001:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.139077:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520986496
00000100:00100000:0.0:1789760759.139085:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520986496
00000100:00100000:0.0:1789760759.139149:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730763501611 time 730793802025 state 0x0 ref 1
00000100:00100000:0.0:1789760759.139163:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730794062441 time 730793802025 state 0x1 ref 1
00000100:00100000:0.0:1789760759.139196:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730794062441 time 730825878512 state 0x0 ref 1
00000100:00100000:0.0:1789760759.139210:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520986496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.139258:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23228416, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.139268:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.139283:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:0.0:1789760759.139287:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.139293:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.139303:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760759.175358:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972991 is committed
00002000:00010000:3.0:1789760759.176544:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23228416 -> 23232512
00010000:00010000:3.0:1789760759.176560:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.176572:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.176580:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.176587:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760759.176591:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.176601:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.176632:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.176640:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cdf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23228416->23232511] (req 23228416->23232511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760759.176735:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520986496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37524us (37738us total) trans 4294972991 rc 0/0
00000100:00100000:3.0:1789760759.176746:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5704
00000100:00100000:3.0:1789760759.176756:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730794062441 time 730825878512 state 0x2 ref 0
00000100:00100000:3.0:1789760759.179453:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760759.179960:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520986624
00000100:00100000:2.0:1789760759.179970:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520986624
00000100:00100000:2.0:1789760759.180026:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730794062441 time 730825878512 state 0x0 ref 1
00000100:00100000:2.0:1789760759.180041:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730826138928 time 730825878512 state 0x1 ref 1
00000100:00100000:2.0:1789760759.180074:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730826138928 time 730866756559 state 0x0 ref 1
00000100:00100000:2.0:1789760759.180087:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520986624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760759.180133:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23232512, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:2.0:1789760759.180142:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.180157:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:2.0:1789760759.180162:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760759.180169:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.180182:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760759.227184:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972992 is committed
00002000:00010000:2.0:1789760759.227340:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23232512 -> 23236608
00010000:00010000:2.0:1789760759.227356:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.227369:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.227383:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.227391:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760759.227396:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.227405:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.227425:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.227433:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cdf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23232512->23236607] (req 23232512->23236607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760759.227512:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520986624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47424us (48063us total) trans 4294972992 rc 0/0
00000100:00100000:2.0:1789760759.227523:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5705
00000100:00100000:2.0:1789760759.227532:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730826138928 time 730866756559 state 0x2 ref 0
00000100:00100000:1.0:1789760759.238893:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.239100:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520986752
00000100:00100000:0.0:1789760759.239110:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520986752
00000100:00100000:0.0:1789760759.239155:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730826138928 time 730866756559 state 0x0 ref 1
00000100:00100000:0.0:1789760759.239170:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730867016975 time 730866756559 state 0x1 ref 1
00000100:00100000:0.0:1789760759.239199:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730867016975 time 730925882021 state 0x0 ref 1
00000100:00100000:0.0:1789760759.239220:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520986752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.239269:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23236608, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.239278:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.239292:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:0.0:1789760759.239296:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.239302:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.239505:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760759.286421:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972993 is committed
00002000:00010000:3.0:1789760759.286575:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23236608 -> 23240704
00010000:00010000:3.0:1789760759.286590:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.286603:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.286626:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.286640:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760759.286645:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.286654:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.286674:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.286682:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60ce00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23236608->23240703] (req 23236608->23240703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760759.286776:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520986752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47553us (47886us total) trans 4294972993 rc 0/0
00000100:00100000:3.0:1789760759.286786:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5706
00000100:00100000:3.0:1789760759.286794:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730867016975 time 730925882021 state 0x2 ref 0
00000100:00100000:0.0:1789760759.290540:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760759.290622:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520986880
00000100:00100000:3.0:1789760759.290633:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520986880
00000100:00100000:3.0:1789760759.290684:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730867016975 time 730925882021 state 0x0 ref 1
00000100:00100000:3.0:1789760759.290699:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730926142437 time 730925882021 state 0x1 ref 1
00000100:00100000:3.0:1789760759.290733:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730926142437 time 730977415400 state 0x0 ref 1
00000100:00100000:3.0:1789760759.290748:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520986880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760759.290805:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23240704, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:3.0:1789760759.290815:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.290832:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=730s v=(0 0)
00010000:00010000:3.0:1789760759.290836:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760759.290842:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.290856:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760759.348432:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972994 is committed
00002000:00010000:3.0:1789760759.348582:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23240704 -> 23244800
00010000:00010000:3.0:1789760759.348598:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.348623:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.348632:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.348638:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760759.348643:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.348653:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.348673:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.348681:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23240704->23244799] (req 23240704->23244799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760759.348803:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520986880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58051us (58266us total) trans 4294972994 rc 0/0
00000100:00100000:3.0:1789760759.348813:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5707
00000100:00100000:3.0:1789760759.348822:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730926142437 time 730977415400 state 0x2 ref 0
00000100:00100000:1.0:1789760759.353031:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760759.353112:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520987008
00000100:00100000:3.0:1789760759.353121:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520987008
00000100:00100000:3.0:1789760759.353175:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730926142437 time 730977415400 state 0x0 ref 1
00000100:00100000:3.0:1789760759.353191:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730977675816 time 730977415400 state 0x1 ref 1
00000100:00100000:3.0:1789760759.353225:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730977675816 time 731039907450 state 0x0 ref 1
00000100:00100000:3.0:1789760759.353236:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520987008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760759.353285:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23244800, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:3.0:1789760759.353295:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.353310:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:3.0:1789760759.353355:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760759.353362:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.353377:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.360932:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760759.389597:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972995 is committed
00002000:00010000:0.0:1789760759.389718:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23244800 -> 23248896
00010000:00010000:0.0:1789760759.389733:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.389746:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.389755:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.389763:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760759.389769:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.389778:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.389812:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.389820:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ce0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23244800->23248895] (req 23244800->23248895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760759.389924:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520987008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36683us (36896us total) trans 4294972995 rc 0/0
00000100:00100000:0.0:1789760759.389936:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5708
00000100:00100000:0.0:1789760759.389947:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730977675816 time 731039907450 state 0x2 ref 0
00000100:00100000:1.0:1789760759.394260:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760759.396247:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520987136
00000100:00100000:2.0:1789760759.396261:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520987136
00000100:00100000:2.0:1789760759.397289:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 730977675816 time 731039907450 state 0x0 ref 1
00000100:00100000:2.0:1789760759.397308:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731040167866 time 731039907450 state 0x1 ref 1
00000100:00100000:0.0:1789760759.398389:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731040167866 time 731085066299 state 0x0 ref 1
00000100:00100000:0.0:1789760759.398413:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520987136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.398469:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23248896, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.398479:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.398495:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760759.398499:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.398506:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.398519:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760759.451435:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972996 is committed
00002000:00010000:0.0:1789760759.451537:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23248896 -> 23252992
00010000:00010000:0.0:1789760759.451552:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.451567:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.451577:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.451585:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760759.451590:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.451598:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.451626:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.451634:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23248896->23252991] (req 23248896->23252991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760759.451724:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520987136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53318us (57468us total) trans 4294972996 rc 0/0
00000100:00100000:0.0:1789760759.451735:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5709
00000100:00100000:0.0:1789760759.451744:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731040167866 time 731085066299 state 0x2 ref 0
00000100:00100000:2.0:1789760759.454720:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760759.454960:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520987264
00000100:00100000:1.0:1789760759.454970:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520987264
00000100:00100000:1.0:1789760759.455022:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731040167866 time 731085066299 state 0x0 ref 1
00000100:00100000:1.0:1789760759.455038:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731085326715 time 731085066299 state 0x1 ref 1
00000100:00100000:1.0:1789760759.455069:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731085326715 time 731141751697 state 0x0 ref 1
00000100:00100000:1.0:1789760759.455082:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520987264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760759.455130:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23252992, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:1.0:1789760759.455140:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.455155:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:1.0:1789760759.455160:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760759.455167:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.455180:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760759.500905:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972997 is committed
00002000:00010000:2.0:1789760759.501303:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23252992 -> 23257088
00010000:00010000:2.0:1789760759.501348:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.501362:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.501371:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.501378:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760759.501383:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.501391:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.501410:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.501417:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60ce1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23252992->23257087] (req 23252992->23257087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760759.501593:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520987264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46507us (46876us total) trans 4294972997 rc 0/0
00000100:00100000:2.0:1789760759.501611:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5710
00000100:00100000:2.0:1789760759.501621:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731085326715 time 731141751697 state 0x2 ref 0
00000100:00100000:1.0:1789760759.505866:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760759.506045:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520987392
00000100:00100000:3.0:1789760759.506056:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520987392
00000100:00100000:0.0:1789760759.506225:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731085326715 time 731141751697 state 0x0 ref 1
00000100:00100000:0.0:1789760759.506242:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731142012113 time 731141751697 state 0x1 ref 1
00000100:00100000:0.0:1789760759.506274:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731142012113 time 731192956471 state 0x0 ref 1
00000100:00100000:0.0:1789760759.506285:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520987392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.506357:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23257088, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.506367:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.506382:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760759.506386:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.506393:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.506407:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760759.550765:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972998 is committed
00002000:00010000:0.0:1789760759.550857:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23257088 -> 23261184
00010000:00010000:0.0:1789760759.550872:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.550884:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.550893:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.550899:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760759.550903:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.550912:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.550930:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.550937:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23257088->23261183] (req 23257088->23261183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760759.551046:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520987392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44757us (45184us total) trans 4294972998 rc 0/0
00000100:00100000:0.0:1789760759.551056:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5711
00000100:00100000:0.0:1789760759.551065:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731142012113 time 731192956471 state 0x2 ref 0
00000100:00100000:1.0:1789760759.556021:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.556174:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520987520
00000100:00100000:0.0:1789760759.556188:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520987520
00000100:00100000:0.0:1789760759.556243:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731142012113 time 731192956471 state 0x0 ref 1
00000100:00100000:0.0:1789760759.556259:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731193216887 time 731192956471 state 0x1 ref 1
00000100:00100000:0.0:1789760759.556290:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731193216887 time 731242972240 state 0x0 ref 1
00000100:00100000:0.0:1789760759.556303:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520987520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.556466:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23261184, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.556475:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.556492:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760759.556497:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.556503:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.556522:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760759.617451:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23261184 -> 23265280
00010000:00010000:0.0:1789760759.617470:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.617484:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.617494:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.617501:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760759.617506:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.617515:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.617533:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.617540:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23261184->23265279] (req 23261184->23265279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760759.617703:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520987520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61396us (61686us total) trans 4294972999 rc 0/0
00000100:00100000:0.0:1789760759.617714:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5712
00000100:00100000:0.0:1789760759.617724:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731193216887 time 731242972240 state 0x2 ref 0
00000001:00080000:0.0:1789760759.618396:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294972999 is committed
00000100:00100000:3.0:1789760759.621141:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760759.621240:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520987648
00000100:00100000:2.0:1789760759.621250:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520987648
00000100:00100000:2.0:1789760759.621301:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731193216887 time 731242972240 state 0x0 ref 1
00000100:00100000:2.0:1789760759.621336:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731243232656 time 731242972240 state 0x1 ref 1
00000100:00100000:2.0:1789760759.621361:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731243232656 time 731308044382 state 0x0 ref 1
00000100:00100000:2.0:1789760759.621374:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520987648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760759.621420:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23265280, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:2.0:1789760759.621428:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.621444:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:2.0:1789760759.621448:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760759.621454:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.621467:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760759.667771:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973000 is committed
00002000:00010000:0.0:1789760759.667926:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23265280 -> 23269376
00010000:00010000:0.0:1789760759.667942:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.667954:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.667962:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.667969:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760759.667974:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.667991:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.668011:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.668027:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60ce31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23265280->23269375] (req 23265280->23269375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760759.668119:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520987648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46743us (46981us total) trans 4294973000 rc 0/0
00000100:00100000:0.0:1789760759.668130:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5713
00000100:00100000:0.0:1789760759.668698:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731243232656 time 731308044382 state 0x2 ref 0
00000100:00100000:1.0:1789760759.681133:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760759.681221:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520987776
00000100:00100000:3.0:1789760759.681231:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520987776
00000100:00100000:3.0:1789760759.681501:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731243232656 time 731308044382 state 0x0 ref 1
00000100:00100000:3.0:1789760759.681518:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731308304798 time 731308044382 state 0x1 ref 1
00000100:00100000:3.0:1789760759.681538:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731308304798 time 731368221887 state 0x0 ref 1
00000100:00100000:3.0:1789760759.681550:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520987776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760759.681613:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23269376, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:3.0:1789760759.681623:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.681643:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:3.0:1789760759.681648:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760759.681654:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760759.681667:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760759.722982:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973001 is committed
00002000:00010000:2.0:1789760759.723334:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23269376 -> 23273472
00010000:00010000:2.0:1789760759.723350:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.723363:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.723372:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.723379:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760759.723384:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.723392:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.723412:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.723419:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60ce38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23269376->23273471] (req 23269376->23273471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760759.723510:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520987776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41958us (42383us total) trans 4294973001 rc 0/0
00000100:00100000:2.0:1789760759.723524:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5714
00000100:00100000:2.0:1789760759.723534:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731308304798 time 731368221887 state 0x2 ref 0
00000100:00100000:1.0:1789760759.732570:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.734675:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520987904
00000100:00100000:0.0:1789760759.734691:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520987904
00000100:00100000:0.0:1789760759.734754:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731308304798 time 731368221887 state 0x0 ref 1
00000100:00100000:0.0:1789760759.734770:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731368482303 time 731368221887 state 0x1 ref 1
00000100:00100000:0.0:1789760759.734807:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731368482303 time 731421488912 state 0x0 ref 1
00000100:00100000:0.0:1789760759.734820:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520987904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.734870:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23273472, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.734879:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.734894:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760759.734899:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.734906:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.734924:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760759.780527:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973002 is committed
00002000:00010000:1.0:1789760759.780644:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23273472 -> 23277568
00010000:00010000:1.0:1789760759.780660:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.780673:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.780682:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.780763:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760759.780770:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.780781:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.780801:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.780808:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60ce3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23273472->23277567] (req 23273472->23277567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760759.781055:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520987904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46231us (48489us total) trans 4294973002 rc 0/0
00000100:00100000:1.0:1789760759.781066:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5715
00000100:00100000:1.0:1789760759.781076:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731368482303 time 731421488912 state 0x2 ref 0
00000100:00100000:3.0:1789760759.784538:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.784883:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520988032
00000100:00100000:0.0:1789760759.784892:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520988032
00000100:00100000:0.0:1789760759.784947:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731368482303 time 731421488912 state 0x0 ref 1
00000100:00100000:0.0:1789760759.784963:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731421749328 time 731421488912 state 0x1 ref 1
00000100:00100000:0.0:1789760759.785055:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731421749328 time 731471735617 state 0x0 ref 1
00000100:00100000:0.0:1789760759.785069:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520988032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.785121:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23277568, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:0.0:1789760759.785131:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.785146:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760759.785150:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.785157:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.785170:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760759.833148:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23277568 -> 23281664
00010000:00010000:2.0:1789760759.833168:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.833181:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.833191:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.833200:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760759.833204:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.833213:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.833231:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.833239:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60ce46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23277568->23281663] (req 23277568->23281663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760759.833376:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520988032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48305us (48842us total) trans 4294973003 rc 0/0
00000100:00100000:2.0:1789760759.833386:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5716
00000100:00100000:2.0:1789760759.833395:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731421749328 time 731471735617 state 0x2 ref 0
00000001:00080000:3.0:1789760759.833522:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973003 is committed
00000100:00100000:3.0:1789760759.836069:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760759.836372:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520988160
00000100:00100000:1.0:1789760759.836382:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520988160
00000100:00100000:1.0:1789760759.836437:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731421749328 time 731471735617 state 0x0 ref 1
00000100:00100000:1.0:1789760759.836452:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731471996033 time 731471735617 state 0x1 ref 1
00000100:00100000:1.0:1789760759.836485:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731471996033 time 731523167517 state 0x0 ref 1
00000100:00100000:1.0:1789760759.836497:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760759.836543:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23281664, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:1.0:1789760759.836552:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.836566:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:1.0:1789760759.836570:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760759.836576:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.836588:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760759.871408:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973004 is committed
00002000:00010000:1.0:1789760759.871502:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23281664 -> 23285760
00010000:00010000:1.0:1789760759.871517:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.871529:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.871540:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.871546:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760759.871551:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.871561:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.871581:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760759.871589:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23281664->23285759] (req 23281664->23285759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760759.871847:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35345us (35780us total) trans 4294973004 rc 0/0
00000100:00100000:1.0:1789760759.871859:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5717
00000100:00100000:1.0:1789760759.871868:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731471996033 time 731523167517 state 0x2 ref 0
00000100:00100000:0.0:1789760759.877057:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760759.877419:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520988288
00000100:00100000:2.0:1789760759.877428:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520988288
00000100:00100000:2.0:1789760759.877492:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731471996033 time 731523167517 state 0x0 ref 1
00000100:00100000:2.0:1789760759.877508:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731523427933 time 731523167517 state 0x1 ref 1
00000100:00100000:2.0:1789760759.877568:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731523427933 time 731564250299 state 0x0 ref 1
00000100:00100000:2.0:1789760759.877581:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520988288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760759.877649:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23285760, mtime: 0x6aad94f8, atime: 0x0, ctime: 0x6aad94f8, blocks: 0xb807
00010000:00010000:2.0:1789760759.877658:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.877674:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:2.0:1789760759.877678:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760759.877684:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.877698:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760759.915390:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973005 is committed
00002000:00010000:2.0:1789760759.915569:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23285760 -> 23289856
00002000:00010000:2.0:1789760759.915574:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760760 -> 1789760761
00002000:00010000:2.0:1789760759.915576:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760760 -> 1789760761
00010000:00010000:2.0:1789760759.915669:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.915683:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.915692:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.915700:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760759.915704:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.915714:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.915732:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.915741:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60ce54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23285760->23289855] (req 23285760->23289855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760759.915871:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520988288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38287us (38819us total) trans 4294973005 rc 0/0
00000100:00100000:2.0:1789760759.915882:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5718
00000100:00100000:2.0:1789760759.915891:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731523427933 time 731564250299 state 0x2 ref 0
00000100:00100000:3.0:1789760759.921046:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.921267:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520988416
00000100:00100000:0.0:1789760759.921277:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520988416
00000100:00100000:0.0:1789760759.921369:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731523427933 time 731564250299 state 0x0 ref 1
00000100:00100000:0.0:1789760759.921383:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731564510715 time 731564250299 state 0x1 ref 1
00000100:00100000:0.0:1789760759.921403:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731564510715 time 731608086312 state 0x0 ref 1
00000100:00100000:0.0:1789760759.921415:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.921462:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23289856, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760759.921471:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.921485:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760759.921490:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.921496:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.921508:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760759.978073:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973006 is committed
00002000:00010000:2.0:1789760759.978251:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23289856 -> 23293952
00010000:00010000:2.0:1789760759.978267:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.978279:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.978288:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.978295:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760759.978300:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.978308:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.978348:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760759.978360:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ce5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23289856->23293951] (req 23289856->23293951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760759.978564:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57029us (57405us total) trans 4294973006 rc 0/0
00000100:00100000:2.0:1789760759.978574:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5719
00000100:00100000:2.0:1789760759.978584:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731564510715 time 731608086312 state 0x2 ref 0
00000100:00100000:3.0:1789760759.982643:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760759.982791:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520988544
00000100:00100000:0.0:1789760759.982800:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520988544
00000100:00100000:0.0:1789760759.982855:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731564510715 time 731608086312 state 0x0 ref 1
00000100:00100000:0.0:1789760759.982870:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731608346728 time 731608086312 state 0x1 ref 1
00000100:00100000:0.0:1789760759.982904:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731608346728 time 731669586353 state 0x0 ref 1
00000100:00100000:0.0:1789760759.982916:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520988544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760759.982971:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23293952, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760759.982981:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.982996:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760759.983000:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760759.983006:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760759.983019:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760760.034633:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973007 is committed
00002000:00010000:2.0:1789760760.035208:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23293952 -> 23298048
00010000:00010000:2.0:1789760760.035225:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.035239:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.035407:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.035414:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760760.035419:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.035428:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.035451:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.035460:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60ce62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23293952->23298047] (req 23293952->23298047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760760.035627:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520988544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52706us (52987us total) trans 4294973007 rc 0/0
00000100:00100000:2.0:1789760760.035639:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5720
00000100:00100000:2.0:1789760760.035648:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731608346728 time 731669586353 state 0x2 ref 0
00000100:00100000:0.0:1789760760.045986:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760760.046053:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520988672
00000100:00100000:1.0:1789760760.046063:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520988672
00000100:00100000:1.0:1789760760.046150:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731608346728 time 731669586353 state 0x0 ref 1
00000100:00100000:1.0:1789760760.046167:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731669846769 time 731669586353 state 0x1 ref 1
00000100:00100000:1.0:1789760760.046198:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731669846769 time 731732880589 state 0x0 ref 1
00000100:00100000:1.0:1789760760.046211:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760760.046258:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23298048, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:1.0:1789760760.046268:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.046283:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:1.0:1789760760.046287:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760760.046294:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.046308:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760760.046852:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:1.0:1789760760.097051:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23298048 -> 23302144
00010000:00010000:1.0:1789760760.097073:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.097087:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.097103:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.097111:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760760.097117:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.097126:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.097208:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.097217:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60ce69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23298048->23302143] (req 23298048->23302143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.097225:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973008 is committed
00000100:00100000:1.0:1789760760.097309:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51096us (51329us total) trans 4294973008 rc 0/0
00000100:00100000:1.0:1789760760.097362:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5721
00000100:00100000:1.0:1789760760.097371:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731669846769 time 731732880589 state 0x2 ref 0
00000100:00100000:2.0:1789760760.100838:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.100930:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520988800
00000100:00100000:0.0:1789760760.100940:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520988800
00000100:00100000:0.0:1789760760.100988:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731669846769 time 731732880589 state 0x0 ref 1
00000100:00100000:0.0:1789760760.101004:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731733141005 time 731732880589 state 0x1 ref 1
00000100:00100000:0.0:1789760760.101034:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731733141005 time 731787716376 state 0x0 ref 1
00000100:00100000:0.0:1789760760.101046:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760760.101094:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23302144, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760760.101103:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.101119:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760760.101124:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760760.101141:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.101156:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.134780:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973009 is committed
00002000:00010000:0.0:1789760760.134858:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23302144 -> 23306240
00010000:00010000:0.0:1789760760.134939:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.134952:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.134960:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.134968:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760760.134972:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.134981:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.134999:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.135007:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23302144->23306239] (req 23302144->23306239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760760.135148:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34100us (34314us total) trans 4294973009 rc 0/0
00000100:00100000:0.0:1789760760.135158:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5722
00000100:00100000:0.0:1789760760.135168:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731733141005 time 731787716376 state 0x2 ref 0
00000100:00100000:2.0:1789760760.141095:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.141278:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520988928
00000100:00100000:0.0:1789760760.141288:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520988928
00000100:00100000:0.0:1789760760.141409:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731733141005 time 731787716376 state 0x0 ref 1
00000100:00100000:0.0:1789760760.141424:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731787976792 time 731787716376 state 0x1 ref 1
00000100:00100000:0.0:1789760760.141449:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731787976792 time 731828132506 state 0x0 ref 1
00000100:00100000:0.0:1789760760.141462:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760760.141575:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23306240, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760760.141584:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.141608:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760760.141614:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760760.141621:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.141634:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.173595:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973010 is committed
00002000:00010000:3.0:1789760760.173731:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23306240 -> 23310336
00010000:00010000:3.0:1789760760.173747:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.173760:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.173770:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.173778:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760760.173782:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.173791:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.173811:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.173819:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60ce77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23306240->23310335] (req 23306240->23310335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760760.173918:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520988928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32453us (32825us total) trans 4294973010 rc 0/0
00000100:00100000:3.0:1789760760.173929:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5723
00000100:00100000:3.0:1789760760.173940:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731787976792 time 731828132506 state 0x2 ref 0
00000100:00100000:1.0:1789760760.177704:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760760.177787:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520989056
00000100:00100000:2.0:1789760760.177798:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520989056
00000100:00100000:2.0:1789760760.177854:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731787976792 time 731828132506 state 0x0 ref 1
00000100:00100000:2.0:1789760760.177870:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731828392922 time 731828132506 state 0x1 ref 1
00000100:00100000:2.0:1789760760.177905:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731828392922 time 731864587588 state 0x0 ref 1
00000100:00100000:2.0:1789760760.177916:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760760.177961:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23310336, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:2.0:1789760760.177970:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.177986:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:2.0:1789760760.177990:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760760.177996:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.178010:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.204723:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973011 is committed
00002000:00010000:3.0:1789760760.205067:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23310336 -> 23314432
00010000:00010000:3.0:1789760760.205085:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.205099:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.205113:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.205121:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760760.205126:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.205544:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.205566:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.205575:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60ce7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23310336->23314431] (req 23310336->23314431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760760.205727:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27808us (28028us total) trans 4294973011 rc 0/0
00000100:00100000:3.0:1789760760.205737:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5724
00000100:00100000:3.0:1789760760.205747:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731828392922 time 731864587588 state 0x2 ref 0
00000100:00100000:2.0:1789760760.210488:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760760.210567:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520989184
00000100:00100000:1.0:1789760760.210577:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520989184
00000100:00100000:1.0:1789760760.210637:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731828392922 time 731864587588 state 0x0 ref 1
00000100:00100000:1.0:1789760760.210651:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731864848004 time 731864587588 state 0x1 ref 1
00000100:00100000:1.0:1789760760.210703:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731864848004 time 731897385412 state 0x0 ref 1
00000100:00100000:1.0:1789760760.210715:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760760.210761:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23314432, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:1.0:1789760760.210769:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.210785:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:1.0:1789760760.210789:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760760.210795:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.210808:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760760.238752:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23314432 -> 23318528
00010000:00010000:0.0:1789760760.238770:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.238784:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.238793:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.238800:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760760.238805:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.238814:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.238833:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.238841:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60ce85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23314432->23318527] (req 23314432->23318527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760760.238930:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520989184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28212us (28446us total) trans 4294973012 rc 0/0
00000100:00100000:0.0:1789760760.238941:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5725
00000100:00100000:0.0:1789760760.238950:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731864848004 time 731897385412 state 0x2 ref 0
00000001:00080000:2.0:1789760760.241690:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973012 is committed
00000100:00100000:2.0:1789760760.242453:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.242535:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520989312
00000100:00100000:0.0:1789760760.242543:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520989312
00000100:00100000:0.0:1789760760.242590:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731864848004 time 731897385412 state 0x0 ref 1
00000100:00100000:0.0:1789760760.242615:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731897645828 time 731897385412 state 0x1 ref 1
00000100:00100000:0.0:1789760760.242677:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731897645828 time 731929359994 state 0x0 ref 1
00000100:00100000:0.0:1789760760.242688:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760760.242731:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23318528, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760760.242740:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.242754:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:0.0:1789760760.242757:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760760.242763:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.242775:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.270412:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973013 is committed
00002000:00010000:2.0:1789760760.270486:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23318528 -> 23322624
00010000:00010000:2.0:1789760760.270504:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.270517:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.270527:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.270540:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760760.270544:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.270554:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.270572:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.270579:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60ce8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23318528->23322623] (req 23318528->23322623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760760.270673:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27982us (28219us total) trans 4294973013 rc 0/0
00000100:00100000:2.0:1789760760.270682:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5726
00000100:00100000:2.0:1789760760.270692:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731897645828 time 731929359994 state 0x2 ref 0
00000100:00100000:1.0:1789760760.274684:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760760.274759:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520989440
00000100:00100000:3.0:1789760760.274770:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520989440
00000100:00100000:3.0:1789760760.274823:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731897645828 time 731929359994 state 0x0 ref 1
00000100:00100000:3.0:1789760760.275059:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731929620410 time 731929359994 state 0x1 ref 1
00000100:00100000:3.0:1789760760.275122:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731929620410 time 731961803895 state 0x0 ref 1
00000100:00100000:3.0:1789760760.275296:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760760.275494:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23322624, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:3.0:1789760760.275504:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.275520:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:3.0:1789760760.275525:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760760.275531:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.275546:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.304699:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973014 is committed
00002000:00010000:3.0:1789760760.304785:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23322624 -> 23326720
00010000:00010000:3.0:1789760760.304803:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.304818:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.304827:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.304836:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760760.304840:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.304850:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.304871:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.304879:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ce93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23322624->23326719] (req 23322624->23326719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760760.305008:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29871us (30328us total) trans 4294973014 rc 0/0
00000100:00100000:3.0:1789760760.305018:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5727
00000100:00100000:3.0:1789760760.305028:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731929620410 time 731961803895 state 0x2 ref 0
00000100:00100000:2.0:1789760760.312406:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760760.312492:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520989568
00000100:00100000:3.0:1789760760.312502:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520989568
00000100:00100000:3.0:1789760760.312557:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731929620410 time 731961803895 state 0x0 ref 1
00000100:00100000:3.0:1789760760.312572:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731962064311 time 731961803895 state 0x1 ref 1
00000100:00100000:3.0:1789760760.312608:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731962064311 time 731999281654 state 0x0 ref 1
00000100:00100000:3.0:1789760760.312620:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760760.312666:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23326720, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:3.0:1789760760.312676:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.312692:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=731s v=(0 0)
00010000:00010000:3.0:1789760760.312697:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760760.312703:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.312716:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760760.357385:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23326720 -> 23330816
00010000:00010000:2.0:1789760760.357405:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.357419:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.357428:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.357435:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760760.357439:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.357447:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.357469:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.357476:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ce9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23326720->23330815] (req 23326720->23330815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760760.357572:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520989568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44949us (45171us total) trans 4294973015 rc 0/0
00000100:00100000:2.0:1789760760.357582:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5728
00000100:00100000:2.0:1789760760.357591:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731962064311 time 731999281654 state 0x2 ref 0
00000001:00080000:1.0:1789760760.360639:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973015 is committed
00000100:00100000:2.0:1789760760.360732:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.360813:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520989696
00000100:00100000:0.0:1789760760.360823:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520989696
00000100:00100000:0.0:1789760760.360872:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731962064311 time 731999281654 state 0x0 ref 1
00000100:00100000:0.0:1789760760.360887:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731999542070 time 731999281654 state 0x1 ref 1
00000100:00100000:0.0:1789760760.360946:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731999542070 time 732047628330 state 0x0 ref 1
00000100:00100000:0.0:1789760760.360959:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760760.361006:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23330816, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760760.361016:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.361031:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:0.0:1789760760.361035:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760760.361041:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.361054:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.378697:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760760.392703:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973016 is committed
00002000:00010000:1.0:1789760760.392785:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23330816 -> 23334912
00010000:00010000:1.0:1789760760.392801:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.392815:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.392824:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.392832:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760760.392837:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.392851:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.392870:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.392879:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60cea1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23330816->23334911] (req 23330816->23334911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760760.393000:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32038us (32266us total) trans 4294973016 rc 0/0
00000100:00100000:1.0:1789760760.393012:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5729
00000100:00100000:1.0:1789760760.393020:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731999542070 time 732047628330 state 0x2 ref 0
00000100:00100000:0.0:1789760760.398957:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760760.399058:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520989824
00000100:00100000:2.0:1789760760.399067:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520989824
00000100:00100000:2.0:1789760760.399120:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 731999542070 time 732047628330 state 0x0 ref 1
00000100:00100000:2.0:1789760760.399194:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732047888746 time 732047628330 state 0x1 ref 1
00000100:00100000:2.0:1789760760.399353:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732047888746 time 732086033796 state 0x0 ref 1
00000100:00100000:2.0:1789760760.399367:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760760.399421:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23334912, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:2.0:1789760760.399431:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.399447:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:2.0:1789760760.399452:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760760.399459:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.399473:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760760.435824:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23334912 -> 23339008
00010000:00010000:3.0:1789760760.435846:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.435861:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.435870:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.435878:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760760.435882:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.435892:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.435911:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.435919:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60cea8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23334912->23339007] (req 23334912->23339007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760760.436013:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520989824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36643us (37061us total) trans 4294973017 rc 0/0
00000100:00100000:3.0:1789760760.436025:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5730
00000100:00100000:3.0:1789760760.436039:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732047888746 time 732086033796 state 0x2 ref 0
00000001:00080000:1.0:1789760760.436607:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973017 is committed
00000100:00100000:2.0:1789760760.438606:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760760.438682:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520989952
00000100:00100000:3.0:1789760760.438691:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520989952
00000100:00100000:3.0:1789760760.438737:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732047888746 time 732086033796 state 0x0 ref 1
00000100:00100000:3.0:1789760760.438752:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732086294212 time 732086033796 state 0x1 ref 1
00000100:00100000:3.0:1789760760.438782:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732086294212 time 732125464163 state 0x0 ref 1
00000100:00100000:3.0:1789760760.438794:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760760.438838:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23339008, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:3.0:1789760760.438847:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.438862:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:3.0:1789760760.438868:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760760.438875:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.438888:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760760.443280:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548761984:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1789760760.449032:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760760.449117:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548761984
00000100:00100000:0.0:1789760760.449125:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548761984
00000100:00100000:0.0:1789760760.449168:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441
00000100:00100000:0.0:1789760760.449178:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548761984:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1789760760.449219:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:0.0:1789760760.449268:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548761984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (242us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760760.449274:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441
00000100:00100000:0.0:1789760760.449340:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548761984:0@lo:41:osp-pre-0-1.0
00000001:00080000:1.0:1789760760.492631:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973018 is committed
00002000:00010000:0.0:1789760760.492731:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23339008 -> 23343104
00010000:00010000:0.0:1789760760.492747:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.492758:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.492767:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.492774:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760760.492779:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.492788:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.492804:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.492812:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60ceaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23339008->23343103] (req 23339008->23343103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760760.493016:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520989952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54219us (54430us total) trans 4294973018 rc 0/0
00000100:00100000:0.0:1789760760.493027:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5731
00000100:00100000:0.0:1789760760.493036:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732086294212 time 732125464163 state 0x2 ref 0
00000100:00100000:2.0:1789760760.501571:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.503454:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520990080
00000100:00100000:0.0:1789760760.504065:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520990080
00000100:00100000:2.0:1789760760.504397:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732086294212 time 732125464163 state 0x0 ref 1
00000100:00100000:2.0:1789760760.504413:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732125724579 time 732125464163 state 0x1 ref 1
00000100:00100000:2.0:1789760760.504440:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732125724579 time 732191123369 state 0x0 ref 1
00000100:00100000:2.0:1789760760.504454:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520990080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760760.504503:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23343104, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:2.0:1789760760.504513:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.504528:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:2.0:1789760760.504533:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760760.504538:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.504552:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.583744:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973019 is committed
00002000:00010000:0.0:1789760760.584128:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23343104 -> 23347200
00010000:00010000:0.0:1789760760.584145:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.584156:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.584163:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.584170:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760760.584175:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.584183:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.584209:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.584216:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ceb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23343104->23347199] (req 23343104->23347199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760760.584881:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520990080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 79857us (82746us total) trans 4294973019 rc 0/0
00000100:00100000:0.0:1789760760.584896:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5732
00000100:00100000:0.0:1789760760.584906:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732125724579 time 732191123369 state 0x2 ref 0
00000100:00100000:1.0:1789760760.589182:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.589271:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520990208
00000100:00100000:0.0:1789760760.589283:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520990208
00000100:00100000:0.0:1789760760.589390:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732125724579 time 732191123369 state 0x0 ref 1
00000100:00100000:0.0:1789760760.589405:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732191383785 time 732191123369 state 0x1 ref 1
00000100:00100000:0.0:1789760760.589432:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732191383785 time 732276114776 state 0x0 ref 1
00000100:00100000:0.0:1789760760.589445:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520990208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760760.589496:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23347200, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760760.589506:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.589521:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:0.0:1789760760.589527:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760760.589533:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.589548:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760760.638246:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973020 is committed
00002000:00010000:0.0:1789760760.638431:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23347200 -> 23351296
00010000:00010000:0.0:1789760760.638447:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.638459:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.638538:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.638548:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760760.638553:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.638562:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.638582:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.638589:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60cebd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23347200->23351295] (req 23347200->23351295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760760.638727:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520990208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49281us (49549us total) trans 4294973020 rc 0/0
00000100:00100000:0.0:1789760760.638737:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5733
00000100:00100000:0.0:1789760760.638746:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732191383785 time 732276114776 state 0x2 ref 0
00000100:00100000:2.0:1789760760.642807:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760760.643186:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520990336
00000100:00100000:3.0:1789760760.643197:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520990336
00000100:00100000:3.0:1789760760.643456:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732191383785 time 732276114776 state 0x0 ref 1
00000100:00100000:3.0:1789760760.643644:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732276375192 time 732276114776 state 0x1 ref 1
00000100:00100000:2.0:1789760760.643774:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732276375192 time 732330454746 state 0x0 ref 1
00000100:00100000:2.0:1789760760.643789:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520990336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760760.643838:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23351296, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:2.0:1789760760.643848:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.643863:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:2.0:1789760760.643867:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760760.643874:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760760.643892:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760760.687505:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973021 is committed
00002000:00010000:3.0:1789760760.689438:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23351296 -> 23355392
00010000:00010000:3.0:1789760760.689459:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.689681:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.689692:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.689699:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760760.689704:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.689717:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.689738:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.689745:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60cec4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23351296->23355391] (req 23351296->23355391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760760.691818:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520990336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48023us (49010us total) trans 4294973021 rc 0/0
00000100:00100000:2.0:1789760760.691833:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5734
00000100:00100000:2.0:1789760760.691843:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732276375192 time 732330454746 state 0x2 ref 0
00000100:00100000:2.0:1789760760.697452:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760760.697769:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520990464
00000100:00100000:3.0:1789760760.697779:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520990464
00000100:00100000:3.0:1789760760.697832:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732276375192 time 732330454746 state 0x0 ref 1
00000100:00100000:3.0:1789760760.697846:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732330715162 time 732330454746 state 0x1 ref 1
00000100:00100000:3.0:1789760760.697879:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732330715162 time 732384560737 state 0x0 ref 1
00000100:00100000:3.0:1789760760.697891:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520990464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760760.697937:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23355392, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:3.0:1789760760.697947:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.697963:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:3.0:1789760760.697967:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760760.697974:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.697989:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760760.738104:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973022 is committed
00002000:00010000:3.0:1789760760.738458:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23355392 -> 23359488
00010000:00010000:3.0:1789760760.738480:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.738492:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.738501:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.738509:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760760.738514:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.738524:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.738543:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.738551:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cecb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23355392->23359487] (req 23355392->23359487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760760.738693:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520990464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40798us (41245us total) trans 4294973022 rc 0/0
00000100:00100000:3.0:1789760760.738704:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5735
00000100:00100000:3.0:1789760760.738713:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732330715162 time 732384560737 state 0x2 ref 0
00000100:00100000:1.0:1789760760.742409:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.742660:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520990592
00000100:00100000:0.0:1789760760.742670:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520990592
00000100:00100000:0.0:1789760760.742722:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732330715162 time 732384560737 state 0x0 ref 1
00000100:00100000:0.0:1789760760.742737:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732384821153 time 732384560737 state 0x1 ref 1
00000100:00100000:0.0:1789760760.742770:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732384821153 time 732429452809 state 0x0 ref 1
00000100:00100000:0.0:1789760760.742783:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520990592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760760.742830:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23359488, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760760.742839:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.742854:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:0.0:1789760760.742858:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760760.742865:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.742878:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760760.778385:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973023 is committed
00002000:00010000:1.0:1789760760.778448:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23359488 -> 23363584
00010000:00010000:1.0:1789760760.778475:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.778488:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.778502:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.778510:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760760.778515:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.778525:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.778543:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.778550:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60ced2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23359488->23363583] (req 23359488->23363583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760760.778771:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520990592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35985us (36364us total) trans 4294973023 rc 0/0
00000100:00100000:1.0:1789760760.778781:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5736
00000100:00100000:1.0:1789760760.778790:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732384821153 time 732429452809 state 0x2 ref 0
00000100:00100000:2.0:1789760760.784768:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.785090:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520990720
00000100:00100000:0.0:1789760760.785099:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520990720
00000100:00100000:0.0:1789760760.785212:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732384821153 time 732429452809 state 0x0 ref 1
00000100:00100000:0.0:1789760760.785296:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732429713225 time 732429452809 state 0x1 ref 1
00000100:00100000:0.0:1789760760.785399:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732429713225 time 732472080626 state 0x0 ref 1
00000100:00100000:0.0:1789760760.785412:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520990720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760760.785460:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23363584, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760760.785480:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.785495:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:0.0:1789760760.785500:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760760.785506:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.785520:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.820056:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973024 is committed
00002000:00010000:0.0:1789760760.820192:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23363584 -> 23367680
00010000:00010000:0.0:1789760760.820207:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.820360:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.820373:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.820380:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760760.820385:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.820395:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.820414:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.820422:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60ced9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23363584->23367679] (req 23363584->23367679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760760.820515:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520990720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35101us (35752us total) trans 4294973024 rc 0/0
00000100:00100000:0.0:1789760760.820525:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5737
00000100:00100000:0.0:1789760760.820535:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732429713225 time 732472080626 state 0x2 ref 0
00000100:00100000:2.0:1789760760.826064:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760760.826218:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520990848
00000100:00100000:0.0:1789760760.826306:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520990848
00000100:00100000:0.0:1789760760.826482:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732429713225 time 732472080626 state 0x0 ref 1
00000100:00100000:0.0:1789760760.826497:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732472341042 time 732472080626 state 0x1 ref 1
00000100:00100000:0.0:1789760760.826566:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732472341042 time 732513248227 state 0x0 ref 1
00000100:00100000:0.0:1789760760.826580:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520990848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760760.826758:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23367680, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:0.0:1789760760.826767:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.826782:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:0.0:1789760760.826787:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760760.826794:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760760.826808:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760760.873858:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973025 is committed
00002000:00010000:1.0:1789760760.873949:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23367680 -> 23371776
00010000:00010000:1.0:1789760760.873965:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.873983:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.873992:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.874000:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760760.874005:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.874014:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.874033:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.874040:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60cee0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23367680->23371775] (req 23367680->23371775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760760.874128:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520990848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47545us (48069us total) trans 4294973025 rc 0/0
00000100:00100000:1.0:1789760760.874146:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5738
00000100:00100000:1.0:1789760760.874156:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732472341042 time 732513248227 state 0x2 ref 0
00000100:00100000:1.0:1789760760.879692:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760760.879748:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520990976
00000100:00100000:3.0:1789760760.879759:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520990976
00000100:00100000:3.0:1789760760.879811:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732472341042 time 732513248227 state 0x0 ref 1
00000100:00100000:3.0:1789760760.879826:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732513508643 time 732513248227 state 0x1 ref 1
00000100:00100000:3.0:1789760760.879857:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732513508643 time 732566540191 state 0x0 ref 1
00000100:00100000:3.0:1789760760.879869:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520990976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760760.879915:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23371776, mtime: 0x6aad94f9, atime: 0x0, ctime: 0x6aad94f9, blocks: 0xb807
00010000:00010000:3.0:1789760760.879924:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.879939:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:3.0:1789760760.879944:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760760.879950:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.879964:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760760.956386:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973026 is committed
00002000:00010000:3.0:1789760760.956510:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23371776 -> 23375872
00002000:00010000:3.0:1789760760.956515:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760761 -> 1789760762
00002000:00010000:3.0:1789760760.956517:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760761 -> 1789760762
00010000:00010000:3.0:1789760760.956531:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.956544:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.956555:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.956563:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760760.956567:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.956576:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.956673:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760760.956683:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cee7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23371776->23375871] (req 23371776->23375871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760760.956780:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520990976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76907us (77093us total) trans 4294973026 rc 0/0
00000100:00100000:3.0:1789760760.957011:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5739
00000100:00100000:3.0:1789760760.957020:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732513508643 time 732566540191 state 0x2 ref 0
00000100:00100000:2.0:1789760760.962168:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760760.962226:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520991104
00000100:00100000:1.0:1789760760.962236:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520991104
00000100:00100000:1.0:1789760760.962290:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732513508643 time 732566540191 state 0x0 ref 1
00000100:00100000:1.0:1789760760.962306:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732566800607 time 732566540191 state 0x1 ref 1
00000100:00100000:1.0:1789760760.962365:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732566800607 time 732649047351 state 0x0 ref 1
00000100:00100000:1.0:1789760760.962379:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520991104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760760.962425:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23375872, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:1.0:1789760760.962435:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.962451:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:1.0:1789760760.962455:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760760.962461:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760760.962474:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760761.022486:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23375872 -> 23379968
00010000:00010000:1.0:1789760761.022505:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.022519:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.022533:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.022541:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760761.022546:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.022556:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.022576:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.022584:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ceee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23375872->23379967] (req 23375872->23379967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760761.022695:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520991104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60314us (60532us total) trans 4294973027 rc 0/0
00000100:00100000:1.0:1789760761.022705:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5740
00000100:00100000:1.0:1789760761.022714:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732566800607 time 732649047351 state 0x2 ref 0
00000001:00080000:3.0:1789760761.022799:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973027 is committed
00000100:00100000:2.0:1789760761.025977:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.026083:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520991232
00000100:00100000:0.0:1789760761.026094:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520991232
00000100:00100000:0.0:1789760761.026258:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732566800607 time 732649047351 state 0x0 ref 1
00000100:00100000:0.0:1789760761.026273:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732649307767 time 732649047351 state 0x1 ref 1
00000100:00100000:0.0:1789760761.026360:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732649307767 time 732713042498 state 0x0 ref 1
00000100:00100000:0.0:1789760761.026377:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520991232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760761.026425:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23379968, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:0.0:1789760761.026433:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.026449:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:0.0:1789760761.026453:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760761.026459:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.026472:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760761.065622:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973028 is committed
00002000:00010000:0.0:1789760761.065701:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23379968 -> 23384064
00010000:00010000:0.0:1789760761.065716:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.065729:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.065738:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.065746:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760761.065751:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.065761:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.065781:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.065789:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cef5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23379968->23384063] (req 23379968->23384063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760761.065963:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520991232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39583us (39988us total) trans 4294973028 rc 0/0
00000100:00100000:0.0:1789760761.065973:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5741
00000100:00100000:0.0:1789760761.065983:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732649307767 time 732713042498 state 0x2 ref 0
00000100:00100000:0.0:1789760761.070152:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760761.070702:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520991360
00000100:00100000:1.0:1789760761.070712:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520991360
00000100:00100000:1.0:1789760761.070768:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732649307767 time 732713042498 state 0x0 ref 1
00000100:00100000:1.0:1789760761.070783:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732713302914 time 732713042498 state 0x1 ref 1
00000100:00100000:1.0:1789760761.070959:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732713302914 time 732757639779 state 0x0 ref 1
00000100:00100000:1.0:1789760761.070972:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520991360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760761.071024:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23384064, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:1.0:1789760761.071032:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.071047:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:1.0:1789760761.071052:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760761.071059:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.071073:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760761.112551:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973029 is committed
00002000:00010000:3.0:1789760761.112753:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23384064 -> 23388160
00010000:00010000:3.0:1789760761.112770:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.112782:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.112792:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.112800:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760761.112805:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.112936:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.112955:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.112963:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60cefc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23384064->23388159] (req 23384064->23388159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760761.113091:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520991360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42116us (42945us total) trans 4294973029 rc 0/0
00000100:00100000:3.0:1789760761.113102:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5742
00000100:00100000:3.0:1789760761.113111:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732713302914 time 732757639779 state 0x2 ref 0
00000100:00100000:2.0:1789760761.117874:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760761.117953:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520991488
00000100:00100000:3.0:1789760761.117963:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520991488
00000100:00100000:3.0:1789760761.118019:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732713302914 time 732757639779 state 0x0 ref 1
00000100:00100000:3.0:1789760761.118034:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732757900195 time 732757639779 state 0x1 ref 1
00000100:00100000:3.0:1789760761.118064:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732757900195 time 732804746962 state 0x0 ref 1
00000100:00100000:3.0:1789760761.118077:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520991488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760761.118122:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23388160, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:3.0:1789760761.118132:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.118147:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:3.0:1789760761.118152:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760761.118159:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.118178:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760761.151007:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23388160 -> 23392256
00010000:00010000:3.0:1789760761.151025:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.151037:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.151046:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.151052:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760761.151057:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.151066:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.151084:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.151092:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23388160->23392255] (req 23388160->23392255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760761.151201:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520991488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33121us (33341us total) trans 4294973030 rc 0/0
00000100:00100000:3.0:1789760761.151211:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5743
00000100:00100000:3.0:1789760761.151220:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732757900195 time 732804746962 state 0x2 ref 0
00000001:00080000:2.0:1789760761.151686:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973030 is committed
00000100:00100000:3.0:1789760761.168730:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.168843:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520991616
00000100:00100000:0.0:1789760761.168855:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520991616
00000100:00100000:0.0:1789760761.168986:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732757900195 time 732804746962 state 0x0 ref 1
00000100:00100000:0.0:1789760761.169002:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732805007378 time 732804746962 state 0x1 ref 1
00000100:00100000:0.0:1789760761.169071:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732805007378 time 732855752552 state 0x0 ref 1
00000100:00100000:0.0:1789760761.169083:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520991616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760761.169130:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23392256, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:0.0:1789760761.169139:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.169154:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:0.0:1789760761.169159:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760761.169165:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.169179:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760761.201935:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973031 is committed
00002000:00010000:0.0:1789760761.202166:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23392256 -> 23396352
00010000:00010000:0.0:1789760761.202181:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.202193:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.202201:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.202208:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760761.202213:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.202221:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.202245:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.202253:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23392256->23396351] (req 23392256->23396351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760761.202375:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520991616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33289us (33650us total) trans 4294973031 rc 0/0
00000100:00100000:0.0:1789760761.202386:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5744
00000100:00100000:0.0:1789760761.202399:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732805007378 time 732855752552 state 0x2 ref 0
00000100:00100000:1.0:1789760761.208700:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.208800:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520991744
00000100:00100000:0.0:1789760761.208810:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520991744
00000100:00100000:0.0:1789760761.208935:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732805007378 time 732855752552 state 0x0 ref 1
00000100:00100000:0.0:1789760761.208953:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732856012968 time 732855752552 state 0x1 ref 1
00000100:00100000:0.0:1789760761.208982:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732856012968 time 732895665209 state 0x0 ref 1
00000100:00100000:0.0:1789760761.208995:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520991744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760761.209040:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23396352, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:0.0:1789760761.209050:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.209065:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:0.0:1789760761.209070:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760761.209076:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.209090:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760761.254641:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973032 is committed
00002000:00010000:0.0:1789760761.254749:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23396352 -> 23400448
00010000:00010000:0.0:1789760761.254769:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.254781:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.254790:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.254798:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760761.254802:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.254810:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.254829:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.254838:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23396352->23400447] (req 23396352->23400447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760761.255000:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520991744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46002us (46304us total) trans 4294973032 rc 0/0
00000100:00100000:0.0:1789760761.255012:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5745
00000100:00100000:0.0:1789760761.255022:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732856012968 time 732895665209 state 0x2 ref 0
00000100:00100000:3.0:1789760761.258659:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760761.258702:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520991872
00000100:00100000:1.0:1789760761.258712:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520991872
00000100:00100000:1.0:1789760761.258763:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732856012968 time 732895665209 state 0x0 ref 1
00000100:00100000:1.0:1789760761.258778:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732895925625 time 732895665209 state 0x1 ref 1
00000100:00100000:1.0:1789760761.258842:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732895925625 time 732945522933 state 0x0 ref 1
00000100:00100000:1.0:1789760761.258855:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520991872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760761.258919:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23400448, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:1.0:1789760761.258928:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.258944:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=732s v=(0 0)
00010000:00010000:1.0:1789760761.258948:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760761.258954:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.258968:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760761.346768:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973033 is committed
00002000:00010000:0.0:1789760761.347003:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23400448 -> 23404544
00010000:00010000:0.0:1789760761.347019:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.347032:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.347041:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.347048:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760761.347053:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.347061:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.347081:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.347092:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60cf18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23400448->23404543] (req 23400448->23404543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760761.347194:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520991872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 88337us (88537us total) trans 4294973033 rc 0/0
00000100:00100000:0.0:1789760761.347204:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5746
00000100:00100000:0.0:1789760761.347213:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732895925625 time 732945522933 state 0x2 ref 0
00000100:00100000:1.0:1789760761.356164:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760761.356305:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520992000
00000100:00100000:3.0:1789760761.356357:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520992000
00000100:00100000:3.0:1789760761.356408:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732895925625 time 732945522933 state 0x0 ref 1
00000100:00100000:3.0:1789760761.356424:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732945783349 time 732945522933 state 0x1 ref 1
00000100:00100000:3.0:1789760761.356445:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732945783349 time 733043128320 state 0x0 ref 1
00000100:00100000:3.0:1789760761.356457:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520992000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760761.356503:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23404544, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:3.0:1789760761.356512:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.356528:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:3.0:1789760761.356532:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760761.356538:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.356556:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760761.395039:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973034 is committed
00002000:00010000:2.0:1789760761.395182:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23404544 -> 23408640
00010000:00010000:2.0:1789760761.395198:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.395214:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.395228:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.395237:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760761.395242:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.395251:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.395270:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.395278:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60cf1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23404544->23408639] (req 23404544->23408639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760761.395413:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520992000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38953us (39253us total) trans 4294973034 rc 0/0
00000100:00100000:2.0:1789760761.395424:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5747
00000100:00100000:2.0:1789760761.395433:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732945783349 time 733043128320 state 0x2 ref 0
00010000:00010000:3.0:1789760761.401837:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789760761.401883:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.402168:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520992128
00000100:00100000:0.0:1789760761.402179:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520992128
00000100:00100000:0.0:1789760761.402231:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 732945783349 time 733043128320 state 0x0 ref 1
00000100:00100000:0.0:1789760761.402246:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733043388736 time 733043128320 state 0x1 ref 1
00000100:00100000:0.0:1789760761.402281:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733043388736 time 733088962494 state 0x0 ref 1
00000100:00100000:0.0:1789760761.402293:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760761.402382:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23408640, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:0.0:1789760761.402391:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.402407:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:0.0:1789760761.402411:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760761.402417:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.402435:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760761.463928:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23408640 -> 23412736
00010000:00010000:1.0:1789760761.463946:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.463956:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.463964:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.463971:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760761.463975:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.463990:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.464009:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.464018:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60cf26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23408640->23412735] (req 23408640->23412735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760761.464146:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520992128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61849us (62262us total) trans 4294973035 rc 0/0
00000100:00100000:1.0:1789760761.464158:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5748
00000100:00100000:1.0:1789760761.464168:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733043388736 time 733088962494 state 0x2 ref 0
00000100:00100000:0.0:1789760761.466522:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548762112:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760761.466601:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000001:00080000:2.0:1789760761.467029:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973035 is committed
00000100:00100000:1.0:1789760761.467491:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548762112
00000100:00100000:1.0:1789760761.467500:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548762112
00000100:00100000:1.0:1789760761.467599:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442
00000100:00100000:1.0:1789760761.467610:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548762112:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1789760761.467650:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:1.0:1789760761.467712:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548762112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (1123us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760761.467719:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442
00000100:00100000:3.0:1789760761.467804:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548762112:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1789760761.470652:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.474260:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520992256
00000100:00100000:0.0:1789760761.474276:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520992256
00000100:00100000:0.0:1789760761.474868:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733043388736 time 733088962494 state 0x0 ref 1
00000100:00100000:0.0:1789760761.474884:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733089222910 time 733088962494 state 0x1 ref 1
00000100:00100000:0.0:1789760761.474920:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733089222910 time 733161603153 state 0x0 ref 1
00000100:00100000:0.0:1789760761.474934:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760761.474982:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23412736, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:0.0:1789760761.474991:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.475006:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:0.0:1789760761.475010:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760761.475017:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.475031:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760761.521223:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973036 is committed
00002000:00010000:0.0:1789760761.521300:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23412736 -> 23416832
00010000:00010000:0.0:1789760761.521509:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.521524:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.521534:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.521541:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760761.521546:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.521555:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.521572:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.521580:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60cf2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23412736->23416831] (req 23412736->23416831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760761.521779:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46843us (51130us total) trans 4294973036 rc 0/0
00000100:00100000:2.0:1789760761.521793:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5749
00000100:00100000:2.0:1789760761.521803:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733089222910 time 733161603153 state 0x2 ref 0
00000100:00100000:0.0:1789760761.525969:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760761.527997:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520992384
00000100:00100000:1.0:1789760761.528017:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520992384
00000100:00100000:2.0:1789760761.528256:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733089222910 time 733161603153 state 0x0 ref 1
00000100:00100000:2.0:1789760761.528271:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733161863569 time 733161603153 state 0x1 ref 1
00000100:00100000:2.0:1789760761.528389:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733161863569 time 733215070283 state 0x0 ref 1
00000100:00100000:2.0:1789760761.528403:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760761.528453:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23416832, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:2.0:1789760761.528461:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.528477:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:2.0:1789760761.528482:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760761.528489:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.528502:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760761.573486:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973037 is committed
00002000:00010000:1.0:1789760761.573702:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23416832 -> 23420928
00010000:00010000:1.0:1789760761.573718:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.573731:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.573740:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.573746:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760761.573751:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.573759:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.573785:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.573793:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60cf34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23416832->23420927] (req 23416832->23420927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760761.573887:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45481us (47922us total) trans 4294973037 rc 0/0
00000100:00100000:1.0:1789760761.573898:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5750
00000100:00100000:1.0:1789760761.573907:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733161863569 time 733215070283 state 0x2 ref 0
00000100:00100000:2.0:1789760761.578612:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760761.578714:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520992512
00000100:00100000:3.0:1789760761.578723:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520992512
00000100:00100000:3.0:1789760761.578775:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733161863569 time 733215070283 state 0x0 ref 1
00000100:00100000:3.0:1789760761.578789:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733215330699 time 733215070283 state 0x1 ref 1
00000100:00100000:3.0:1789760761.578824:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733215330699 time 733265506475 state 0x0 ref 1
00000100:00100000:3.0:1789760761.578834:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520992512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760761.578879:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23420928, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:3.0:1789760761.578889:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.578904:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:3.0:1789760761.578909:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760761.578916:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.578931:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760761.616892:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23420928 -> 23425024
00010000:00010000:0.0:1789760761.616915:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.616929:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.616939:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.616947:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760761.616952:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.616961:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.616980:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.616988:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60cf3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23420928->23425023] (req 23420928->23425023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760761.617092:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520992512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38253us (38495us total) trans 4294973038 rc 0/0
00000100:00100000:0.0:1789760761.617103:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5751
00000100:00100000:0.0:1789760761.617114:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733215330699 time 733265506475 state 0x2 ref 0
00000001:00080000:1.0:1789760761.617716:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973038 is committed
00000100:00100000:3.0:1789760761.621515:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760761.621623:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520992640
00000100:00100000:1.0:1789760761.621633:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520992640
00000100:00100000:1.0:1789760761.621686:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733215330699 time 733265506475 state 0x0 ref 1
00000100:00100000:1.0:1789760761.621701:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733265766891 time 733265506475 state 0x1 ref 1
00000100:00100000:1.0:1789760761.621730:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733265766891 time 733308412738 state 0x0 ref 1
00000100:00100000:1.0:1789760761.621744:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760761.621794:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23425024, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:1.0:1789760761.621804:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.621820:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:1.0:1789760761.621825:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760761.621832:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.621847:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760761.667339:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973039 is committed
00002000:00010000:0.0:1789760761.667446:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23425024 -> 23429120
00010000:00010000:0.0:1789760761.667463:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.667487:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.667496:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.667503:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760761.667507:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.667516:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.667535:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.667541:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60cf42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23425024->23429119] (req 23425024->23429119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760761.667682:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45935us (46171us total) trans 4294973039 rc 0/0
00000100:00100000:0.0:1789760761.667693:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5752
00000100:00100000:0.0:1789760761.667704:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733265766891 time 733308412738 state 0x2 ref 0
00000100:00100000:2.0:1789760761.681847:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760761.682030:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520992768
00000100:00100000:1.0:1789760761.682041:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520992768
00000100:00100000:1.0:1789760761.682095:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733265766891 time 733308412738 state 0x0 ref 1
00000100:00100000:1.0:1789760761.682110:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733308673154 time 733308412738 state 0x1 ref 1
00000100:00100000:1.0:1789760761.682191:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733308673154 time 733368872511 state 0x0 ref 1
00000100:00100000:1.0:1789760761.682206:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760761.682255:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23429120, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:1.0:1789760761.682264:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.682280:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:1.0:1789760761.682285:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760761.682291:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.682304:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760761.692973:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.693011:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.693036:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.693056:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.693074:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.693100:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520993280
00000100:00100000:0.0:1789760761.693109:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520993280
00000100:00100000:0.0:1789760761.693162:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520993152
00000100:00100000:0.0:1789760761.693165:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520993152
00000100:00100000:0.0:1789760761.693179:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520993408
00000100:00100000:0.0:1789760761.693182:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520993408
00000100:00100000:0.0:1789760761.693195:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520993024
00000100:00100000:0.0:1789760761.693197:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520993024
00000100:00100000:0.0:1789760761.693213:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 913
00000100:00100000:0.0:1789760761.693223:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520993280:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760761.693294:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520993280:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 73us (282us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760761.693302:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 913
00000100:00100000:0.0:1789760761.693342:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 914
00000100:00100000:0.0:1789760761.693350:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520993152:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760761.693378:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520993152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760761.693384:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 914
00000100:00100000:0.0:1789760761.693395:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 915
00000100:00100000:0.0:1789760761.693401:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520993408:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760761.693427:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699520993408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760761.693433:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 915
00000100:00100000:0.0:1789760761.693444:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 916
00000100:00100000:0.0:1789760761.693450:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520993024:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760761.693473:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699520993024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (397us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760761.693479:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 916
00000100:00080000:0.0:1789760761.693503:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1789760761.693507:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:3.0:1789760761.693816:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520992896
00000100:00100000:3.0:1789760761.693821:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520992896
00000100:00100000:3.0:1789760761.693858:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 478
00000100:00100000:3.0:1789760761.693865:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699520992896:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760761.693900:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699520992896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 34us (936us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760761.693907:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 478
00000001:00080000:2.0:1789760761.712942:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973040 is committed
00002000:00010000:1.0:1789760761.713104:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23429120 -> 23433216
00010000:00010000:1.0:1789760761.713132:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.713146:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.713154:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.713161:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760761.713166:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.713175:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.713194:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.713201:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23429120->23433215] (req 23429120->23433215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760761.713291:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520992768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31082us (31450us total) trans 4294973040 rc 0/0
00000100:00100000:1.0:1789760761.713302:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5753
00000100:00100000:1.0:1789760761.713311:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733308673154 time 733368872511 state 0x2 ref 0
00000100:00100000:0.0:1789760761.720037:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760761.720160:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520993536
00000100:00100000:2.0:1789760761.720170:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520993536
00000100:00100000:2.0:1789760761.720234:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733308673154 time 733368872511 state 0x0 ref 1
00000100:00100000:2.0:1789760761.720251:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733369132927 time 733368872511 state 0x1 ref 1
00000100:00100000:2.0:1789760761.720278:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733369132927 time 733406961131 state 0x0 ref 1
00000100:00100000:2.0:1789760761.720291:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520993536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760761.720360:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23433216, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:2.0:1789760761.720369:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.720385:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:2.0:1789760761.720390:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760761.720396:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.720413:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760761.793234:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23433216 -> 23437312
00010000:00010000:3.0:1789760761.793254:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.793268:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.793277:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.793285:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760761.793290:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.793305:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.793347:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.793356:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60cf50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23433216->23437311] (req 23433216->23437311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760761.793454:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520993536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73160us (73421us total) trans 4294973041 rc 0/0
00000100:00100000:3.0:1789760761.793465:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5754
00000100:00100000:3.0:1789760761.793473:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733369132927 time 733406961131 state 0x2 ref 0
00000100:00100000:3.0:1789760761.798689:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:0.0:1789760761.798788:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973041 is committed
00000100:00100000:1.0:1789760761.798871:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520993664
00000100:00100000:1.0:1789760761.798880:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520993664
00000100:00100000:1.0:1789760761.799069:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733369132927 time 733406961131 state 0x0 ref 1
00000100:00100000:1.0:1789760761.799083:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733407221547 time 733406961131 state 0x1 ref 1
00000100:00100000:1.0:1789760761.799112:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733407221547 time 733485794456 state 0x0 ref 1
00000100:00100000:1.0:1789760761.799131:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520993664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760761.799175:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23437312, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:1.0:1789760761.799184:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.799199:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:1.0:1789760761.799204:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760761.799210:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.799452:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760761.845981:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973042 is committed
00002000:00010000:1.0:1789760761.846284:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23437312 -> 23441408
00010000:00010000:1.0:1789760761.846303:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.846383:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.846392:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.846400:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760761.846404:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.846412:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.846432:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.846440:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23437312->23441407] (req 23437312->23441407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760761.846568:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520993664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47433us (47882us total) trans 4294973042 rc 0/0
00000100:00100000:1.0:1789760761.846579:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5755
00000100:00100000:1.0:1789760761.846598:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733407221547 time 733485794456 state 0x2 ref 0
00000100:00100000:2.0:1789760761.850750:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.850897:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520993792
00000100:00100000:0.0:1789760761.850907:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520993792
00000100:00100000:0.0:1789760761.850958:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733407221547 time 733485794456 state 0x0 ref 1
00000100:00100000:0.0:1789760761.851041:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733486054872 time 733485794456 state 0x1 ref 1
00000100:00100000:0.0:1789760761.851100:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733486054872 time 733537781706 state 0x0 ref 1
00000100:00100000:0.0:1789760761.851112:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520993792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760761.851162:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23441408, mtime: 0x6aad94fa, atime: 0x0, ctime: 0x6aad94fa, blocks: 0xb807
00010000:00010000:0.0:1789760761.851172:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.851186:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:0.0:1789760761.851192:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760761.851198:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.851211:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760761.886759:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973043 is committed
00002000:00010000:0.0:1789760761.886838:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23441408 -> 23445504
00002000:00010000:0.0:1789760761.886843:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760762 -> 1789760763
00002000:00010000:0.0:1789760761.886845:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760762 -> 1789760763
00010000:00010000:0.0:1789760761.886860:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.886872:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.886881:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.886888:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760761.887025:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.887038:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.887061:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.887070:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60cf5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23441408->23445503] (req 23441408->23445503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760761.887391:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520993792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36275us (36644us total) trans 4294973043 rc 0/0
00000100:00100000:0.0:1789760761.887403:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5756
00000100:00100000:0.0:1789760761.887414:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733486054872 time 733537781706 state 0x2 ref 0
00000100:00100000:0.0:1789760761.891011:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760761.891167:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520993920
00000100:00100000:1.0:1789760761.891178:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520993920
00000100:00100000:1.0:1789760761.891236:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733486054872 time 733537781706 state 0x0 ref 1
00000100:00100000:1.0:1789760761.891252:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733538042122 time 733537781706 state 0x1 ref 1
00000100:00100000:1.0:1789760761.891274:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733538042122 time 733577957974 state 0x0 ref 1
00000100:00100000:1.0:1789760761.891283:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520993920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760761.891360:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23445504, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:1.0:1789760761.891369:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.891386:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:1.0:1789760761.891390:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760761.891396:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760761.891413:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760761.921168:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973044 is committed
00002000:00010000:2.0:1789760761.921377:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23445504 -> 23449600
00010000:00010000:2.0:1789760761.921393:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.921406:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.921415:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.921422:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760761.921426:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.921433:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.921451:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760761.921458:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23445504->23449599] (req 23445504->23449599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760761.921598:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520993920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30300us (30583us total) trans 4294973044 rc 0/0
00000100:00100000:2.0:1789760761.921609:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5757
00000100:00100000:2.0:1789760761.921619:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733538042122 time 733577957974 state 0x2 ref 0
00000100:00100000:2.0:1789760761.926407:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760761.926544:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520994048
00000100:00100000:3.0:1789760761.926669:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520994048
00000100:00100000:3.0:1789760761.926729:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733538042122 time 733577957974 state 0x0 ref 1
00000100:00100000:3.0:1789760761.926744:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733578218390 time 733577957974 state 0x1 ref 1
00000100:00100000:3.0:1789760761.926817:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733578218390 time 733613498632 state 0x0 ref 1
00000100:00100000:3.0:1789760761.926833:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520994048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760761.926883:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23449600, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:3.0:1789760761.926892:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.926907:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:3.0:1789760761.926912:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760761.926918:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.926930:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760761.967190:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973045 is committed
00002000:00010000:3.0:1789760761.970347:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23449600 -> 23453696
00010000:00010000:3.0:1789760761.970370:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.970381:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.970389:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.970396:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760761.970401:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.970410:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.970430:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760761.970437:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23449600->23453695] (req 23449600->23453695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760761.970762:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520994048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43926us (44360us total) trans 4294973045 rc 0/0
00000100:00100000:3.0:1789760761.970772:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5758
00000100:00100000:3.0:1789760761.970782:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733578218390 time 733613498632 state 0x2 ref 0
00000100:00100000:3.0:1789760761.973859:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760761.973949:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520994176
00000100:00100000:0.0:1789760761.973958:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520994176
00000100:00100000:0.0:1789760761.974009:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733578218390 time 733613498632 state 0x0 ref 1
00000100:00100000:0.0:1789760761.974024:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733613759048 time 733613498632 state 0x1 ref 1
00000100:00100000:0.0:1789760761.974055:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733613759048 time 733660738286 state 0x0 ref 1
00000100:00100000:0.0:1789760761.974066:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520994176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760761.974120:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23453696, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:0.0:1789760761.974129:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.974157:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:0.0:1789760761.974161:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760761.974168:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760761.974183:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760761.977841:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8126fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548762240:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1789760761.977918:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760761.977954:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548762240
00000100:00100000:2.0:1789760761.977963:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548762240
00000100:00100000:2.0:1789760761.978155:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374
00000100:00100000:2.0:1789760761.978168:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548762240:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1789760761.978193:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528285696 pending 1703936 free 3834642432 avail 3819962368
00000100:00100000:2.0:1789760761.978349:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548762240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (431us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760761.978357:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374
00000100:00100000:1.0:1789760761.978648:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8126fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548762240:0@lo:13:osp-pre-0-0.0
00000100:00080000:2.0:1789760761.979165:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760761.979784:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548762368:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1789760761.979843:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760761.979906:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548762368
00000100:00100000:0.0:1789760761.979913:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548762368
00000100:00100000:0.0:1789760761.979965:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375
00000100:00100000:0.0:1789760761.979976:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548762368:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:0.0:1789760761.979999:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528285696 pending 1703936 free 3834642432 avail 3819962368
00000100:00100000:0.0:1789760761.980045:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5846300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548762368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (202us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760761.980053:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375
00000100:00080000:0.0:1789760761.980075:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760761.980107:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5844380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548762368:0@lo:13:osp-pre-0-1.0
00000001:00080000:3.0:1789760762.004828:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973046 is committed
00002000:00010000:1.0:1789760762.004931:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23453696 -> 23457792
00010000:00010000:1.0:1789760762.004947:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.004960:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.004970:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.004977:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760762.004981:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.004990:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.005009:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.005017:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cf73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23453696->23457791] (req 23453696->23457791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760762.005112:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520994176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31041us (31255us total) trans 4294973046 rc 0/0
00000100:00100000:1.0:1789760762.005133:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5759
00000100:00100000:1.0:1789760762.005143:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733613759048 time 733660738286 state 0x2 ref 0
00000100:00100000:0.0:1789760762.009793:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760762.011860:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520994304
00000100:00100000:1.0:1789760762.011875:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520994304
00000100:00100000:1.0:1789760762.011992:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733613759048 time 733660738286 state 0x0 ref 1
00000100:00100000:1.0:1789760762.012010:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733660998702 time 733660738286 state 0x1 ref 1
00000100:00100000:1.0:1789760762.012039:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733660998702 time 733698722213 state 0x0 ref 1
00000100:00100000:1.0:1789760762.012052:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520994304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760762.012100:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23457792, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:1.0:1789760762.012110:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.012138:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:1.0:1789760762.012143:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760762.012149:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.012168:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760762.012853:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760762.045564:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973047 is committed
00002000:00010000:1.0:1789760762.045766:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23457792 -> 23461888
00010000:00010000:1.0:1789760762.045781:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.045795:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.045805:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.045813:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760762.045817:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.045826:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.045847:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.045855:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23457792->23461887] (req 23457792->23461887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760762.045953:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520994304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33899us (36165us total) trans 4294973047 rc 0/0
00000100:00100000:1.0:1789760762.045963:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5760
00000100:00100000:1.0:1789760762.045974:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733660998702 time 733698722213 state 0x2 ref 0
00000100:00100000:0.0:1789760762.050945:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760762.051041:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520994432
00000100:00100000:2.0:1789760762.051050:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520994432
00000100:00100000:2.0:1789760762.051104:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733660998702 time 733698722213 state 0x0 ref 1
00000100:00100000:2.0:1789760762.051177:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733698982629 time 733698722213 state 0x1 ref 1
00000100:00100000:2.0:1789760762.051249:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733698982629 time 733737930211 state 0x0 ref 1
00000100:00100000:2.0:1789760762.051262:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520994432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760762.051341:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23461888, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:2.0:1789760762.051352:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.051368:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:2.0:1789760762.051372:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760762.051379:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.051393:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760762.083856:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973048 is committed
00002000:00010000:3.0:1789760762.083966:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23461888 -> 23465984
00010000:00010000:3.0:1789760762.083983:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.083995:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.084004:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.084017:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760762.084023:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.084032:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.084053:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.084061:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60cf81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23461888->23465983] (req 23461888->23465983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760762.084264:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520994432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32997us (33323us total) trans 4294973048 rc 0/0
00000100:00100000:3.0:1789760762.084275:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5761
00000100:00100000:3.0:1789760762.084285:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733698982629 time 733737930211 state 0x2 ref 0
00000100:00100000:0.0:1789760762.090153:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.091822:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520994560
00000100:00100000:3.0:1789760762.091835:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520994560
00000100:00100000:0.0:1789760762.092001:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733698982629 time 733737930211 state 0x0 ref 1
00000100:00100000:0.0:1789760762.092017:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733738190627 time 733737930211 state 0x1 ref 1
00000100:00100000:0.0:1789760762.092102:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733738190627 time 733778782931 state 0x0 ref 1
00000100:00100000:0.0:1789760762.092129:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520994560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760762.092175:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23465984, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:0.0:1789760762.092186:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.092201:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:0.0:1789760762.092205:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760762.092211:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.092234:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760762.132595:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973049 is committed
00002000:00010000:3.0:1789760762.132803:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23465984 -> 23470080
00010000:00010000:3.0:1789760762.132821:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.132836:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.132855:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.132865:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760762.132871:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.132881:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.132904:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.132914:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60cf88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23465984->23470079] (req 23465984->23470079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760762.133381:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520994560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41262us (43231us total) trans 4294973049 rc 0/0
00000100:00100000:3.0:1789760762.133392:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5762
00000100:00100000:3.0:1789760762.133401:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733738190627 time 733778782931 state 0x2 ref 0
00000100:00100000:0.0:1789760762.137969:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760762.138064:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520994688
00000100:00100000:1.0:1789760762.138075:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520994688
00000100:00100000:1.0:1789760762.138198:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733738190627 time 733778782931 state 0x0 ref 1
00000100:00100000:1.0:1789760762.138214:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733779043347 time 733778782931 state 0x1 ref 1
00000100:00100000:1.0:1789760762.138441:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733779043347 time 733825122307 state 0x0 ref 1
00000100:00100000:1.0:1789760762.138455:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520994688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760762.138506:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23470080, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:1.0:1789760762.138516:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.138532:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:1.0:1789760762.138536:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760762.138542:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.138554:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760762.173015:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973050 is committed
00002000:00010000:3.0:1789760762.173132:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23470080 -> 23474176
00010000:00010000:3.0:1789760762.173149:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.173169:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.173179:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.173186:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760762.173190:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.173199:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.173229:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.173238:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60cf8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23470080->23474175] (req 23470080->23474175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760762.173597:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520994688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35129us (35622us total) trans 4294973050 rc 0/0
00000100:00100000:3.0:1789760762.173616:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5763
00000100:00100000:3.0:1789760762.173626:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733779043347 time 733825122307 state 0x2 ref 0
00000100:00100000:0.0:1789760762.178962:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760762.179056:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520994816
00000100:00100000:1.0:1789760762.179065:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520994816
00000100:00100000:1.0:1789760762.179122:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733779043347 time 733825122307 state 0x0 ref 1
00000100:00100000:1.0:1789760762.179137:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733825382723 time 733825122307 state 0x1 ref 1
00000100:00100000:1.0:1789760762.179167:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733825382723 time 733865849833 state 0x0 ref 1
00000100:00100000:1.0:1789760762.179180:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520994816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760762.179227:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23474176, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:1.0:1789760762.179236:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.179253:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:1.0:1789760762.179257:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760762.179264:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.179278:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760762.223740:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23474176 -> 23478272
00010000:00010000:0.0:1789760762.223764:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.223778:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.223788:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.223796:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760762.223801:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.223811:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.223830:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.223838:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60cf96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23474176->23478271] (req 23474176->23478271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760762.223939:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520994816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44756us (44981us total) trans 4294973051 rc 0/0
00000100:00100000:0.0:1789760762.223949:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5764
00000100:00100000:0.0:1789760762.223959:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733825382723 time 733865849833 state 0x2 ref 0
00000001:00080000:2.0:1789760762.224044:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973051 is committed
00000100:00100000:2.0:1789760762.227159:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.227262:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520994944
00000100:00100000:3.0:1789760762.227272:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520994944
00000100:00100000:3.0:1789760762.227533:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733825382723 time 733865849833 state 0x0 ref 1
00000100:00100000:3.0:1789760762.227548:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733866110249 time 733865849833 state 0x1 ref 1
00000100:00100000:3.0:1789760762.227631:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733866110249 time 733914312755 state 0x0 ref 1
00000100:00100000:3.0:1789760762.227645:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520994944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760762.227694:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23478272, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:3.0:1789760762.227703:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.227718:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:3.0:1789760762.227722:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760762.227728:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.227742:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760762.256263:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23478272 -> 23482368
00010000:00010000:2.0:1789760762.256281:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.256295:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.256305:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.256337:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760762.256343:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.256352:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.256372:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.256380:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60cf9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23478272->23482367] (req 23478272->23482367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760762.256475:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520994944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28829us (29320us total) trans 4294973052 rc 0/0
00000100:00100000:2.0:1789760762.256490:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5765
00000100:00100000:2.0:1789760762.256500:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733866110249 time 733914312755 state 0x2 ref 0
00000001:00080000:0.0:1789760762.256692:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973052 is committed
00000100:00100000:1.0:1789760762.261159:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.261253:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520995072
00000100:00100000:3.0:1789760762.261264:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520995072
00000100:00100000:3.0:1789760762.261525:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733866110249 time 733914312755 state 0x0 ref 1
00000100:00100000:3.0:1789760762.261544:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733914573171 time 733914312755 state 0x1 ref 1
00000100:00100000:3.0:1789760762.261577:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733914573171 time 733948259306 state 0x0 ref 1
00000100:00100000:3.0:1789760762.261604:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520995072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760762.261802:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23482368, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:3.0:1789760762.261812:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.261829:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:3.0:1789760762.261833:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760762.261840:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.261855:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760762.304871:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23482368 -> 23486464
00010000:00010000:3.0:1789760762.304891:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.304904:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.304912:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.304919:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760762.304924:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.304932:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.304952:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.304959:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23482368->23486463] (req 23482368->23486463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760762.305050:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520995072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43447us (43897us total) trans 4294973053 rc 0/0
00000100:00100000:3.0:1789760762.305061:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5766
00000100:00100000:3.0:1789760762.305070:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733914573171 time 733948259306 state 0x2 ref 0
00000001:00080000:0.0:1789760762.308137:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973053 is committed
00000100:00100000:1.0:1789760762.309078:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.309199:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520995200
00000100:00100000:3.0:1789760762.309209:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520995200
00000100:00100000:3.0:1789760762.309272:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733914573171 time 733948259306 state 0x0 ref 1
00000100:00100000:3.0:1789760762.309285:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733948519722 time 733948259306 state 0x1 ref 1
00000100:00100000:3.0:1789760762.309365:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733948519722 time 733996047059 state 0x0 ref 1
00000100:00100000:3.0:1789760762.309378:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520995200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760762.309424:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23486464, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:3.0:1789760762.309434:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.309449:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=733s v=(0 0)
00010000:00010000:3.0:1789760762.309454:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760762.309460:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.309479:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760762.348693:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973054 is committed
00002000:00010000:2.0:1789760762.353938:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23486464 -> 23490560
00010000:00010000:2.0:1789760762.353957:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.353971:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.353981:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.353988:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760762.353993:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.354003:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.354024:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.354032:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60cfab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23486464->23490559] (req 23486464->23490559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760762.354483:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520995200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45102us (45405us total) trans 4294973054 rc 0/0
00000100:00100000:2.0:1789760762.354494:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5767
00000100:00100000:2.0:1789760762.354504:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733948519722 time 733996047059 state 0x2 ref 0
00000100:00100000:2.0:1789760762.361850:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760762.361948:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520995328
00000100:00100000:1.0:1789760762.361958:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520995328
00000100:00100000:1.0:1789760762.362009:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733948519722 time 733996047059 state 0x0 ref 1
00000100:00100000:1.0:1789760762.362024:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733996307475 time 733996047059 state 0x1 ref 1
00000100:00100000:1.0:1789760762.362052:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733996307475 time 734048734916 state 0x0 ref 1
00000100:00100000:1.0:1789760762.362064:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520995328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760762.362109:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23490560, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:1.0:1789760762.362128:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.362144:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:1.0:1789760762.362148:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760762.362154:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.362175:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760762.408376:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973055 is committed
00002000:00010000:0.0:1789760762.408483:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23490560 -> 23494656
00010000:00010000:0.0:1789760762.408501:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.408514:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.408524:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.408532:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760762.408538:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.408548:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.408569:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.408576:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60cfb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23490560->23494655] (req 23490560->23494655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760762.408687:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520995328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46619us (46843us total) trans 4294973055 rc 0/0
00000100:00100000:0.0:1789760762.408698:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5768
00000100:00100000:0.0:1789760762.408707:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733996307475 time 734048734916 state 0x2 ref 0
00000100:00100000:1.0:1789760762.411533:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760762.411715:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520995456
00000100:00100000:2.0:1789760762.411724:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520995456
00000100:00100000:2.0:1789760762.411773:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 733996307475 time 734048734916 state 0x0 ref 1
00000100:00100000:2.0:1789760762.411788:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734048995332 time 734048734916 state 0x1 ref 1
00000100:00100000:2.0:1789760762.411856:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734048995332 time 734098537682 state 0x0 ref 1
00000100:00100000:2.0:1789760762.411869:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520995456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760762.411913:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23494656, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:2.0:1789760762.411922:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.411938:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:2.0:1789760762.411942:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760762.411948:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.411966:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.425733:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:2.0:1789760762.444425:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23494656 -> 23498752
00010000:00010000:2.0:1789760762.444447:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.444461:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.444471:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.444478:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760762.444483:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.444493:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.444512:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.444520:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60cfb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23494656->23498751] (req 23494656->23498751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760762.444705:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520995456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32832us (33177us total) trans 4294973056 rc 0/0
00000100:00100000:2.0:1789760762.444717:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5769
00000100:00100000:2.0:1789760762.444726:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734048995332 time 734098537682 state 0x2 ref 0
00000001:00080000:0.0:1789760762.445379:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973056 is committed
00000100:00100000:1.0:1789760762.449120:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.449276:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520995584
00000100:00100000:3.0:1789760762.449287:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520995584
00000100:00100000:3.0:1789760762.449375:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734048995332 time 734098537682 state 0x0 ref 1
00000100:00100000:3.0:1789760762.449390:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734098798098 time 734098537682 state 0x1 ref 1
00000100:00100000:3.0:1789760762.449417:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734098798098 time 734136099998 state 0x0 ref 1
00000100:00100000:3.0:1789760762.449431:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520995584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760762.449481:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23498752, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:3.0:1789760762.449490:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.449506:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:3.0:1789760762.449510:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760762.449516:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.449534:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760762.506349:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23498752 -> 23502848
00010000:00010000:3.0:1789760762.506371:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.506384:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.506394:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.506402:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760762.506406:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.506415:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.506433:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.506442:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23498752->23502847] (req 23498752->23502847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760762.506535:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8126e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520995584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57103us (57419us total) trans 4294973057 rc 0/0
00000100:00100000:3.0:1789760762.506545:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5770
00000100:00100000:3.0:1789760762.506554:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734098798098 time 734136099998 state 0x2 ref 0
00000001:00080000:0.0:1789760762.506933:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973057 is committed
00000100:00100000:3.0:1789760762.513523:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760762.513842:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520995712
00000100:00100000:2.0:1789760762.513851:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520995712
00000100:00100000:2.0:1789760762.513907:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734098798098 time 734136099998 state 0x0 ref 1
00000100:00100000:2.0:1789760762.513922:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734136360414 time 734136099998 state 0x1 ref 1
00000100:00100000:2.0:1789760762.514004:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734136360414 time 734200686266 state 0x0 ref 1
00000100:00100000:2.0:1789760762.514018:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520995712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760762.514070:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23502848, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:2.0:1789760762.514080:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.514095:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:2.0:1789760762.514099:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760762.514106:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760762.514120:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760762.547622:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973058 is committed
00002000:00010000:3.0:1789760762.547864:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23502848 -> 23506944
00010000:00010000:3.0:1789760762.547881:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.547894:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.547903:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.547910:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760762.547915:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.547924:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.547942:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.547955:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60cfc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23502848->23506943] (req 23502848->23506943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760762.548089:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520995712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34069us (34572us total) trans 4294973058 rc 0/0
00000100:00100000:3.0:1789760762.548101:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5771
00000100:00100000:3.0:1789760762.548121:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734136360414 time 734200686266 state 0x2 ref 0
00000100:00100000:2.0:1789760762.556851:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760762.556951:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520995840
00000100:00100000:0.0:1789760762.556961:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520995840
00000100:00100000:0.0:1789760762.557280:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734136360414 time 734200686266 state 0x0 ref 1
00000100:00100000:0.0:1789760762.557297:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734200946682 time 734200686266 state 0x1 ref 1
00000100:00100000:0.0:1789760762.557423:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734200946682 time 734244103978 state 0x0 ref 1
00000100:00100000:0.0:1789760762.557438:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520995840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760762.557488:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23506944, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:0.0:1789760762.557498:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.557514:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:0.0:1789760762.557518:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760762.557524:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.557538:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760762.592401:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973059 is committed
00002000:00010000:3.0:1789760762.592551:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23506944 -> 23511040
00010000:00010000:3.0:1789760762.592568:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.592591:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.592601:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.592676:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760762.592681:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.592691:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.592716:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.592725:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60cfce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23506944->23511039] (req 23506944->23511039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760762.592815:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520995840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35375us (35969us total) trans 4294973059 rc 0/0
00000100:00100000:3.0:1789760762.592827:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5772
00000100:00100000:3.0:1789760762.592837:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734200946682 time 734244103978 state 0x2 ref 0
00000100:00100000:1.0:1789760762.598367:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760762.598455:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520995968
00000100:00100000:0.0:1789760762.598464:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520995968
00000100:00100000:0.0:1789760762.598514:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734200946682 time 734244103978 state 0x0 ref 1
00000100:00100000:0.0:1789760762.598529:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734244364394 time 734244103978 state 0x1 ref 1
00000100:00100000:0.0:1789760762.598561:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734244364394 time 734285243401 state 0x0 ref 1
00000100:00100000:0.0:1789760762.598577:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520995968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760762.598935:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23511040, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:0.0:1789760762.598946:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.598963:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:0.0:1789760762.598967:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760762.598974:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.598988:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760762.637117:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23511040 -> 23515136
00010000:00010000:0.0:1789760762.637173:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.637189:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.637199:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.637207:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760762.637212:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.637222:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760762.637230:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973060 is committed
00010000:00010000:0.0:1789760762.637240:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.637248:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60cfd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23511040->23515135] (req 23511040->23515135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760762.637382:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520995968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38803us (39022us total) trans 4294973060 rc 0/0
00000100:00100000:0.0:1789760762.637393:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5773
00000100:00100000:0.0:1789760762.637401:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734244364394 time 734285243401 state 0x2 ref 0
00000100:00100000:2.0:1789760762.641948:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.642057:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520996096
00000100:00100000:3.0:1789760762.642066:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520996096
00000100:00100000:3.0:1789760762.642112:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734244364394 time 734285243401 state 0x0 ref 1
00000100:00100000:3.0:1789760762.642125:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734285503817 time 734285243401 state 0x1 ref 1
00000100:00100000:3.0:1789760762.642155:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734285503817 time 734328838663 state 0x0 ref 1
00000100:00100000:3.0:1789760762.642167:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520996096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760762.642214:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23515136, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:3.0:1789760762.642224:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.642239:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:3.0:1789760762.642244:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760762.642251:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.642264:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760762.679893:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23515136 -> 23519232
00010000:00010000:1.0:1789760762.679977:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.679996:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.680006:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.680013:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760762.680018:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.680027:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.680046:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.680054:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60cfdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23515136->23519231] (req 23515136->23519231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760762.680194:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520996096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38024us (38248us total) trans 4294973061 rc 0/0
00000100:00100000:1.0:1789760762.680204:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5774
00000100:00100000:1.0:1789760762.680213:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734285503817 time 734328838663 state 0x2 ref 0
00000001:00080000:2.0:1789760762.680286:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973061 is committed
00000100:00100000:2.0:1789760762.686595:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.686815:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520996224
00000100:00100000:3.0:1789760762.686824:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520996224
00000100:00100000:3.0:1789760762.686873:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734285503817 time 734328838663 state 0x0 ref 1
00000100:00100000:3.0:1789760762.686888:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734329099079 time 734328838663 state 0x1 ref 1
00000100:00100000:3.0:1789760762.686915:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734329099079 time 734373597633 state 0x0 ref 1
00000100:00100000:3.0:1789760762.686925:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520996224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760762.686968:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23519232, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:3.0:1789760762.686977:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.686992:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:3.0:1789760762.686996:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760762.687002:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.687016:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760762.736538:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973062 is committed
00002000:00010000:1.0:1789760762.736685:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23519232 -> 23523328
00010000:00010000:1.0:1789760762.736703:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.736716:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.736725:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.736732:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760762.736736:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.736745:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.736766:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.736773:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60cfe3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23519232->23523327] (req 23519232->23523327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760762.736911:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520996224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49973us (50324us total) trans 4294973062 rc 0/0
00000100:00100000:1.0:1789760762.736923:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5775
00000100:00100000:1.0:1789760762.736933:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734329099079 time 734373597633 state 0x2 ref 0
00000100:00100000:0.0:1789760762.742985:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.743074:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520996352
00000100:00100000:3.0:1789760762.743086:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520996352
00000100:00100000:3.0:1789760762.743150:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734329099079 time 734373597633 state 0x0 ref 1
00000100:00100000:3.0:1789760762.743165:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734373858049 time 734373597633 state 0x1 ref 1
00000100:00100000:3.0:1789760762.743231:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734373858049 time 734429912869 state 0x0 ref 1
00000100:00100000:3.0:1789760762.743244:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520996352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760762.743287:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23523328, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:3.0:1789760762.743296:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.743310:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:3.0:1789760762.743345:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760762.743351:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.743365:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760762.799933:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973063 is committed
00002000:00010000:1.0:1789760762.800046:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23523328 -> 23527424
00010000:00010000:1.0:1789760762.800062:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.800075:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.800083:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.800090:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760762.800094:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.800103:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.800133:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.800141:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60cfea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23523328->23527423] (req 23523328->23527423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760762.800244:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520996352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56997us (57264us total) trans 4294973063 rc 0/0
00000100:00100000:1.0:1789760762.800255:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5776
00000100:00100000:1.0:1789760762.800264:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734373858049 time 734429912869 state 0x2 ref 0
00000100:00100000:2.0:1789760762.813511:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760762.813721:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520996480
00000100:00100000:0.0:1789760762.813731:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520996480
00000100:00100000:0.0:1789760762.813786:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734373858049 time 734429912869 state 0x0 ref 1
00000100:00100000:0.0:1789760762.813801:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734430173285 time 734429912869 state 0x1 ref 1
00000100:00100000:0.0:1789760762.813834:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734430173285 time 734500516091 state 0x0 ref 1
00000100:00100000:0.0:1789760762.813847:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520996480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760762.813898:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23527424, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:0.0:1789760762.813907:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.813924:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:0.0:1789760762.813928:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760762.813935:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.813948:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760762.877306:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23527424 -> 23531520
00010000:00010000:0.0:1789760762.877365:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.877379:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.877388:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.877396:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760762.877401:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.877410:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.877430:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760762.877437:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60cff1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23527424->23531519] (req 23527424->23531519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760762.877534:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520996480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63684us (64027us total) trans 4294973064 rc 0/0
00000100:00100000:0.0:1789760762.877546:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5777
00000100:00100000:0.0:1789760762.877555:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734430173285 time 734500516091 state 0x2 ref 0
00000001:00080000:1.0:1789760762.877691:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973064 is committed
00000100:00100000:0.0:1789760762.889541:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760762.889720:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520996608
00000100:00100000:1.0:1789760762.889731:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520996608
00000100:00100000:1.0:1789760762.889789:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734430173285 time 734500516091 state 0x0 ref 1
00000100:00100000:1.0:1789760762.889804:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734500776507 time 734500516091 state 0x1 ref 1
00000100:00100000:1.0:1789760762.889836:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734500776507 time 734576518309 state 0x0 ref 1
00000100:00100000:1.0:1789760762.889849:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520996608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760762.889897:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23531520, mtime: 0x6aad94fb, atime: 0x0, ctime: 0x6aad94fb, blocks: 0xb807
00010000:00010000:1.0:1789760762.889907:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.889928:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:1.0:1789760762.889932:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760762.889939:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.889952:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760762.943268:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23531520 -> 23535616
00002000:00010000:1.0:1789760762.943277:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760763 -> 1789760764
00002000:00010000:1.0:1789760762.943280:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760763 -> 1789760764
00010000:00010000:1.0:1789760762.943294:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.943308:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.943346:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.943354:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760762.943359:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.943368:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.943386:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.943394:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60cff8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23531520->23535615] (req 23531520->23535615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760762.943478:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699520996608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53626us (53941us total) trans 4294973065 rc 0/0
00000100:00100000:1.0:1789760762.943488:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5778
00000100:00100000:1.0:1789760762.943498:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734500776507 time 734576518309 state 0x2 ref 0
00000001:00080000:0.0:1789760762.943593:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973065 is committed
00000100:00100000:0.0:1789760762.947885:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760762.947983:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520996736
00000100:00100000:1.0:1789760762.947993:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520996736
00000100:00100000:1.0:1789760762.948166:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734500776507 time 734576518309 state 0x0 ref 1
00000100:00100000:1.0:1789760762.948184:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734576778725 time 734576518309 state 0x1 ref 1
00000100:00100000:1.0:1789760762.948306:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734576778725 time 734634986992 state 0x0 ref 1
00000100:00100000:1.0:1789760762.948358:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520996736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760762.948410:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23535616, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:1.0:1789760762.948419:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.948434:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:1.0:1789760762.948438:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760762.948444:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.948458:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760762.982838:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23535616 -> 23539712
00000001:00080000:0.0:1789760762.982889:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973066 is committed
00010000:00010000:1.0:1789760762.982912:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.982925:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.982934:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.982941:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760762.982946:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.982956:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.983293:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760762.983304:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60cfff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23535616->23539711] (req 23535616->23539711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760762.983422:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520996736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35065us (35541us total) trans 4294973066 rc 0/0
00000100:00100000:1.0:1789760762.983433:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5779
00000100:00100000:1.0:1789760762.983674:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734576778725 time 734634986992 state 0x2 ref 0
00000100:00100000:2.0:1789760762.987616:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760762.987696:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520996864
00000100:00100000:3.0:1789760762.987706:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520996864
00000100:00100000:3.0:1789760762.987760:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734576778725 time 734634986992 state 0x0 ref 1
00000100:00100000:3.0:1789760762.987774:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734635247408 time 734634986992 state 0x1 ref 1
00000100:00100000:3.0:1789760762.987807:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734635247408 time 734674481034 state 0x0 ref 1
00000100:00100000:3.0:1789760762.987820:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520996864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760762.987995:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23539712, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:3.0:1789760762.988006:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.988022:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:3.0:1789760762.988026:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760762.988032:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760762.988045:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760763.001586:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda745aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548762496:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760763.001652:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760763.001724:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789760763.001732:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548762624:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760763.001761:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760763.001801:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548762496
00000100:00100000:1.0:1789760763.001810:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548762496
00000100:00100000:1.0:1789760763.001856:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548762624
00000100:00100000:1.0:1789760763.001859:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548762624
00000100:00100000:1.0:1789760763.001876:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376
00000100:00100000:1.0:1789760763.001885:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548762496:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:1.0:1789760763.001915:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760763.001957:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548762496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (306us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760763.001964:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376
00000100:00100000:1.0:1789760763.001978:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377
00000100:00100000:1.0:1789760763.001985:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548762624:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:1.0:1789760763.001996:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:1.0:1789760763.002020:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548762624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (260us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760763.002026:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377
00000100:00080000:1.0:1789760763.002048:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:1.0:1789760763.002081:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dadea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548762624:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760763.002093:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda745aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548762496:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760763.003919:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548762752:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.003979:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760763.004081:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548763264:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.004109:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760763.004129:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548763776:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.004152:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760763.004187:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:0.0:1789760763.004206:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548762880:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.004231:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760763.004250:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548763392:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.004272:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760763.004288:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548763904:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.004309:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760763.004360:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548763264
00000100:00100000:0.0:1789760763.004366:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548763264
00000100:00100000:0.0:1789760763.004404:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443
00000100:00100000:0.0:1789760763.004413:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548763264:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.004466:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548763264:12345-0@lo:400:kworker.0 Request processed in 53us (355us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760763.004470:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548762752
00000100:00100000:0.0:1789760763.004473:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443
00000100:00100000:3.0:1789760763.004474:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548762752
00000100:00100000:0.0:1789760763.004494:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548763776
00000100:00100000:0.0:1789760763.004497:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548763776
00000100:00100000:3.0:1789760763.004498:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479
00000100:00100000:3.0:1789760763.004504:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548762752:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.004528:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299
00000100:00100000:0.0:1789760763.004534:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548763776:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760763.004539:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548762752:12345-0@lo:400:kworker.0 Request processed in 35us (560us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760763.004545:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479
00000100:00100000:0.0:1789760763.004899:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548763776:12345-0@lo:400:kworker.0 Request processed in 363us (744us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760763.004906:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299
00000100:00100000:0.0:1789760763.004969:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548762880
00000100:00100000:0.0:1789760763.004973:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548762880
00000100:00100000:0.0:1789760763.004996:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548763392
00000100:00100000:0.0:1789760763.004999:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548763392
00000100:00100000:0.0:1789760763.005020:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548763904
00000100:00100000:0.0:1789760763.005023:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548763904
00000100:00100000:0.0:1789760763.005037:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917
00000100:00100000:0.0:1789760763.005043:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548762880:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.005075:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548762880:12345-0@lo:400:kworker.0 Request processed in 32us (843us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760763.005084:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917
00000100:00100000:0.0:1789760763.005096:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918
00000100:00100000:0.0:1789760763.005103:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548763392:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.005133:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548763392:12345-0@lo:400:kworker.0 Request processed in 31us (860us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760763.005138:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918
00000100:00100000:0.0:1789760763.005149:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919
00000100:00100000:0.0:1789760763.005154:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548763904:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.005417:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548763904:12345-0@lo:400:kworker.0 Request processed in 262us (1106us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760763.005423:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919
00000100:00100000:0.0:1789760763.005468:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548762880:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.005480:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548763392:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.005488:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548763904:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.005496:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548762752:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.005505:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548763264:0@lo:400:kworker.0
00000100:00100000:0.0:1789760763.005514:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548763776:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.007459:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3456:1876699548763136:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.007530:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760763.007563:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548763648:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.007601:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760763.007625:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:1.0:1789760763.007632:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548763008:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.007656:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760763.007673:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3456:1876699548763520:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.007721:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760763.007742:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3456:1876699548764032:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.007764:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760763.009373:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548763136
00000100:00100000:3.0:1789760763.009386:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548763136
00000100:00100000:3.0:1789760763.009428:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548763520
00000100:00100000:3.0:1789760763.009431:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548763520
00000100:00100000:3.0:1789760763.009453:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548764032
00000100:00100000:3.0:1789760763.009457:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548764032
00000100:00100000:3.0:1789760763.009475:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920
00000100:00100000:3.0:1789760763.009484:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3456:x1876699548763136:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760763.009565:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3456:x1876699548763136:12345-0@lo:400:kworker.0 Request processed in 81us (2034us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760763.009572:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920
00000100:00100000:3.0:1789760763.009598:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921
00000100:00100000:3.0:1789760763.009604:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876699548763520:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760763.009641:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876699548763520:12345-0@lo:400:kworker.0 Request processed in 37us (1919us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760763.009648:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921
00000100:00100000:3.0:1789760763.009662:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922
00000100:00100000:3.0:1789760763.009669:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876699548764032:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760763.009701:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876699548764032:12345-0@lo:400:kworker.0 Request processed in 33us (1936us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760763.009707:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922
00000100:00100000:1.0:1789760763.010413:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548763648
00000100:00100000:1.0:1789760763.010422:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548763648
00000100:00100000:1.0:1789760763.010463:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300
00000100:00100000:1.0:1789760763.010470:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548763648:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.010519:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548763648:12345-0@lo:400:kworker.0 Request processed in 49us (2917us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760763.010525:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300
00000100:00100000:1.0:1789760763.010548:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548763008
00000100:00100000:1.0:1789760763.010552:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548763008
00000100:00100000:1.0:1789760763.010589:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444
00000100:00100000:1.0:1789760763.010596:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548763008:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.010637:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548763008:12345-0@lo:400:kworker.0 Request processed in 41us (2979us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760763.010644:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444
00000100:00100000:1.0:1789760763.010767:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548763008:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.010781:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3456:1876699548763520:0@lo:400:kworker.0
00000100:00080000:0.0:1789760763.013389:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:0.0:1789760763.013399:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:0.0:1789760763.013403:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1789760763.014980:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3456:1876699548764032:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.015028:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3456:1876699548763136:0@lo:400:kworker.0
00000100:00100000:1.0:1789760763.015044:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548763648:0@lo:400:kworker.0
00000001:00080000:0.0:1789760763.026649:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973067 is committed
00002000:00010000:2.0:1789760763.026757:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23539712 -> 23543808
00010000:00010000:2.0:1789760763.026783:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.026798:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.026808:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.026816:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760763.026821:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.026831:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.026851:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.026864:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d006 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23539712->23543807] (req 23539712->23543807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760763.026965:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520996864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39141us (39352us total) trans 4294973067 rc 0/0
00000100:00100000:2.0:1789760763.026977:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5780
00000100:00100000:2.0:1789760763.026988:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734635247408 time 734674481034 state 0x2 ref 0
00000100:00100000:0.0:1789760763.033675:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760763.034042:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520996992
00000100:00100000:2.0:1789760763.034052:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520996992
00000100:00100000:2.0:1789760763.034111:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734635247408 time 734674481034 state 0x0 ref 1
00000100:00100000:2.0:1789760763.034127:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734674741450 time 734674481034 state 0x1 ref 1
00000100:00100000:2.0:1789760763.034218:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734674741450 time 734720899229 state 0x0 ref 1
00000100:00100000:2.0:1789760763.034231:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520996992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760763.034278:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23543808, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:2.0:1789760763.034288:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.034304:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:2.0:1789760763.034309:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760763.034344:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.034363:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760763.085656:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973068 is committed
00002000:00010000:0.0:1789760763.086112:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23543808 -> 23547904
00010000:00010000:0.0:1789760763.086128:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.086142:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.086151:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.086157:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760763.086162:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.086171:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.086189:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.086197:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d00d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23543808->23547903] (req 23543808->23547903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760763.086429:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520996992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52195us (52757us total) trans 4294973068 rc 0/0
00000100:00100000:1.0:1789760763.086440:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5781
00000100:00100000:1.0:1789760763.086450:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734674741450 time 734720899229 state 0x2 ref 0
00000100:00100000:0.0:1789760763.092177:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760763.092267:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520997120
00000100:00100000:1.0:1789760763.092277:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520997120
00000100:00100000:1.0:1789760763.092371:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734674741450 time 734720899229 state 0x0 ref 1
00000100:00100000:1.0:1789760763.092386:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734721159645 time 734720899229 state 0x1 ref 1
00000100:00100000:1.0:1789760763.092410:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734721159645 time 734779093502 state 0x0 ref 1
00000100:00100000:1.0:1789760763.092423:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520997120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760763.092470:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23547904, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:1.0:1789760763.092479:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.092494:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:1.0:1789760763.092499:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760763.092505:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.092522:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760763.120839:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973069 is committed
00002000:00010000:0.0:1789760763.120978:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23547904 -> 23552000
00010000:00010000:0.0:1789760763.120993:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.121072:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.121084:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.121092:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760763.121097:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.121165:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.121188:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.121195:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d014 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23547904->23551999] (req 23547904->23551999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760763.121452:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520997120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29027us (29279us total) trans 4294973069 rc 0/0
00000100:00100000:0.0:1789760763.121464:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5782
00000100:00100000:0.0:1789760763.121473:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734721159645 time 734779093502 state 0x2 ref 0
00000100:00100000:2.0:1789760763.125837:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760763.125957:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520997248
00000100:00100000:3.0:1789760763.125966:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520997248
00000100:00100000:3.0:1789760763.126029:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734721159645 time 734779093502 state 0x0 ref 1
00000100:00100000:3.0:1789760763.126043:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734779353918 time 734779093502 state 0x1 ref 1
00000100:00100000:3.0:1789760763.126072:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734779353918 time 734812754851 state 0x0 ref 1
00000100:00100000:3.0:1789760763.126083:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520997248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760763.126137:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23552000, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:3.0:1789760763.126146:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.126160:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:3.0:1789760763.126165:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760763.126170:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.126183:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760763.158802:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973070 is committed
00002000:00010000:0.0:1789760763.158884:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23552000 -> 23556096
00010000:00010000:0.0:1789760763.158899:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.158919:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.158928:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.158935:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760763.158939:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.158948:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.158967:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.158975:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d01b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23552000->23556095] (req 23552000->23556095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760763.160601:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520997248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34497us (34751us total) trans 4294973070 rc 0/0
00000100:00100000:0.0:1789760763.160614:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5783
00000100:00100000:0.0:1789760763.160624:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734779353918 time 734812754851 state 0x2 ref 0
00000100:00100000:3.0:1789760763.165899:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760763.165988:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520997376
00000100:00100000:2.0:1789760763.165998:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520997376
00000100:00100000:2.0:1789760763.166129:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734779353918 time 734812754851 state 0x0 ref 1
00000100:00100000:2.0:1789760763.166145:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734813015267 time 734812754851 state 0x1 ref 1
00000100:00100000:2.0:1789760763.166174:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734813015267 time 734852856746 state 0x0 ref 1
00000100:00100000:2.0:1789760763.166187:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520997376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760763.166244:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23556096, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:2.0:1789760763.166255:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.166271:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:2.0:1789760763.166275:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760763.166281:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.166296:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760763.207423:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973071 is committed
00002000:00010000:3.0:1789760763.207569:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23556096 -> 23560192
00010000:00010000:3.0:1789760763.207593:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.207606:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.207615:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.207622:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760763.207627:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.207640:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.207659:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.207668:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d022 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23556096->23560191] (req 23556096->23560191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760763.207790:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520997376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41600us (41895us total) trans 4294973071 rc 0/0
00000100:00100000:3.0:1789760763.207801:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5784
00000100:00100000:3.0:1789760763.207811:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734813015267 time 734852856746 state 0x2 ref 0
00000100:00100000:3.0:1789760763.211558:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760763.211630:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520997504
00000100:00100000:2.0:1789760763.211640:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520997504
00000100:00100000:2.0:1789760763.211692:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734813015267 time 734852856746 state 0x0 ref 1
00000100:00100000:2.0:1789760763.211709:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734853117162 time 734852856746 state 0x1 ref 1
00000100:00100000:2.0:1789760763.211743:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734853117162 time 734898426115 state 0x0 ref 1
00000100:00100000:2.0:1789760763.211755:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520997504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760763.211803:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23560192, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:2.0:1789760763.211812:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.211827:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:2.0:1789760763.211832:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760763.211838:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.211850:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760763.235067:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973072 is committed
00002000:00010000:1.0:1789760763.235227:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23560192 -> 23564288
00010000:00010000:1.0:1789760763.235241:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.235255:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.235264:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.235271:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760763.235276:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.235285:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.235305:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.235342:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d029 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23560192->23564287] (req 23560192->23564287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760763.235426:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520997504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23667us (23872us total) trans 4294973072 rc 0/0
00000100:00100000:1.0:1789760763.235437:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5785
00000100:00100000:1.0:1789760763.235447:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734853117162 time 734898426115 state 0x2 ref 0
00000100:00100000:0.0:1789760763.244050:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760763.244360:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520997632
00000100:00100000:1.0:1789760763.244369:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520997632
00000100:00100000:1.0:1789760763.244423:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734853117162 time 734898426115 state 0x0 ref 1
00000100:00100000:1.0:1789760763.244437:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734898686531 time 734898426115 state 0x1 ref 1
00000100:00100000:1.0:1789760763.244467:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734898686531 time 734931149269 state 0x0 ref 1
00000100:00100000:1.0:1789760763.244478:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520997632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760763.244525:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23564288, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:1.0:1789760763.244533:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.244547:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:1.0:1789760763.244563:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760763.244569:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.244590:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760763.274010:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973073 is committed
00002000:00010000:1.0:1789760763.274240:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23564288 -> 23568384
00010000:00010000:1.0:1789760763.274255:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.274267:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.274275:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.274283:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760763.274287:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.274297:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.274349:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.274357:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d030 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23564288->23568383] (req 23564288->23568383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760763.274440:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520997632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29958us (30396us total) trans 4294973073 rc 0/0
00000100:00100000:1.0:1789760763.274450:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5786
00000100:00100000:1.0:1789760763.274458:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734898686531 time 734931149269 state 0x2 ref 0
00000100:00100000:2.0:1789760763.279179:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760763.279369:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520997760
00000100:00100000:1.0:1789760763.279379:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520997760
00000100:00100000:1.0:1789760763.279433:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734898686531 time 734931149269 state 0x0 ref 1
00000100:00100000:1.0:1789760763.279449:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734931409685 time 734931149269 state 0x1 ref 1
00000100:00100000:1.0:1789760763.279484:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734931409685 time 734966165916 state 0x0 ref 1
00000100:00100000:1.0:1789760763.279496:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520997760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760763.279548:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23568384, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:1.0:1789760763.279557:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.279573:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=734s v=(0 0)
00010000:00010000:1.0:1789760763.279587:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760763.279594:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.279608:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760763.311044:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973074 is committed
00002000:00010000:1.0:1789760763.311292:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23568384 -> 23572480
00010000:00010000:1.0:1789760763.311307:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.311339:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.311354:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.311361:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760763.311365:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.311374:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.311392:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.311400:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d037 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23568384->23572479] (req 23568384->23572479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760763.311531:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520997760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32033us (32357us total) trans 4294973074 rc 0/0
00000100:00100000:1.0:1789760763.311542:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5787
00000100:00100000:1.0:1789760763.311551:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734931409685 time 734966165916 state 0x2 ref 0
00000100:00100000:0.0:1789760763.315664:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760763.315757:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520997888
00000100:00100000:3.0:1789760763.315766:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520997888
00000100:00100000:3.0:1789760763.315895:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734931409685 time 734966165916 state 0x0 ref 1
00000100:00100000:3.0:1789760763.315911:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734966426332 time 734966165916 state 0x1 ref 1
00000100:00100000:3.0:1789760763.315972:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734966426332 time 735002653634 state 0x0 ref 1
00000100:00100000:3.0:1789760763.315984:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520997888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760763.316031:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23572480, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:3.0:1789760763.316041:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.316057:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760763.316061:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760763.316068:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.316085:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760763.354902:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23572480 -> 23576576
00010000:00010000:2.0:1789760763.354923:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.354936:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.354945:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.354953:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760763.354958:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.354967:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.354985:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.354993:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d03e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23572480->23576575] (req 23572480->23576575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760763.355085:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699520997888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39098us (39425us total) trans 4294973075 rc 0/0
00000100:00100000:2.0:1789760763.355095:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5788
00000100:00100000:2.0:1789760763.356333:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734966426332 time 735002653634 state 0x2 ref 0
00000001:00080000:0.0:1789760763.356412:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973075 is committed
00000100:00100000:0.0:1789760763.358648:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760763.358747:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520998016
00000100:00100000:2.0:1789760763.358757:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520998016
00000100:00100000:2.0:1789760763.358810:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 734966426332 time 735002653634 state 0x0 ref 1
00000100:00100000:2.0:1789760763.358825:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735002914050 time 735002653634 state 0x1 ref 1
00000100:00100000:2.0:1789760763.358854:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735002914050 time 735045536608 state 0x0 ref 1
00000100:00100000:2.0:1789760763.358866:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520998016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760763.358910:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23576576, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:2.0:1789760763.358920:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.358935:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:2.0:1789760763.358940:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760763.358946:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.358960:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760763.382933:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973076 is committed
00002000:00010000:2.0:1789760763.383032:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23576576 -> 23580672
00010000:00010000:2.0:1789760763.383048:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.383062:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.383075:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.383082:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760763.383086:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.383096:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.383124:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.383132:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d045 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23576576->23580671] (req 23576576->23580671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760763.383229:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520998016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24360us (24583us total) trans 4294973076 rc 0/0
00000100:00100000:2.0:1789760763.383239:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5789
00000100:00100000:2.0:1789760763.383248:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735002914050 time 735045536608 state 0x2 ref 0
00000100:00100000:3.0:1789760763.385934:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760763.386021:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520998144
00000100:00100000:0.0:1789760763.386031:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520998144
00000100:00100000:0.0:1789760763.386082:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735002914050 time 735045536608 state 0x0 ref 1
00000100:00100000:0.0:1789760763.386097:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735045797024 time 735045536608 state 0x1 ref 1
00000100:00100000:0.0:1789760763.386130:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735045797024 time 735072812945 state 0x0 ref 1
00000100:00100000:0.0:1789760763.386142:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520998144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760763.386191:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23580672, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:0.0:1789760763.386201:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.386216:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:0.0:1789760763.386221:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760763.386227:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.386241:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760763.417214:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23580672 -> 23584768
00010000:00010000:1.0:1789760763.417234:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.417253:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.417262:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.417270:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760763.417275:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.417284:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.417303:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760763.417329:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d04c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23580672->23584767] (req 23580672->23584767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760763.417423:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520998144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31278us (31493us total) trans 4294973077 rc 0/0
00000100:00100000:1.0:1789760763.417434:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5790
00000100:00100000:1.0:1789760763.417443:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735045797024 time 735072812945 state 0x2 ref 0
00000100:00100000:1.0:1789760763.421288:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000001:00080000:2.0:1789760763.421422:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973077 is committed
00000100:00100000:3.0:1789760763.421489:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520998272
00000100:00100000:3.0:1789760763.421499:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520998272
00000100:00100000:3.0:1789760763.421548:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735045797024 time 735072812945 state 0x0 ref 1
00000100:00100000:3.0:1789760763.421563:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735073073361 time 735072812945 state 0x1 ref 1
00000100:00100000:3.0:1789760763.421597:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735073073361 time 735108279098 state 0x0 ref 1
00000100:00100000:3.0:1789760763.421610:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520998272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760763.421658:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23584768, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:3.0:1789760763.421667:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.421687:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760763.421691:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760763.421698:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.421711:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.455649:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760763.457600:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973078 is committed
00002000:00010000:2.0:1789760763.458191:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23584768 -> 23588864
00010000:00010000:2.0:1789760763.458264:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.458278:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.458286:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.458293:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760763.458298:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.458306:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.458343:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.458350:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d053 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23584768->23588863] (req 23584768->23588863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760763.458481:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520998272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36869us (37198us total) trans 4294973078 rc 0/0
00000100:00100000:2.0:1789760763.458492:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5791
00000100:00100000:2.0:1789760763.458501:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735073073361 time 735108279098 state 0x2 ref 0
00000100:00100000:3.0:1789760763.462587:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760763.462832:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520998400
00000100:00100000:2.0:1789760763.462843:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520998400
00000100:00100000:2.0:1789760763.462897:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735073073361 time 735108279098 state 0x0 ref 1
00000100:00100000:2.0:1789760763.462913:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735108539514 time 735108279098 state 0x1 ref 1
00000100:00100000:2.0:1789760763.463057:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735108539514 time 735149738209 state 0x0 ref 1
00000100:00100000:2.0:1789760763.463069:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520998400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760763.463126:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23588864, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:2.0:1789760763.463135:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.463152:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:2.0:1789760763.463157:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760763.463164:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.463178:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760763.492668:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23588864 -> 23592960
00010000:00010000:2.0:1789760763.492686:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.492699:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.492714:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.492721:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760763.492727:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.492735:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.492752:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.492759:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d05a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23588864->23592959] (req 23588864->23592959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760763.492855:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520998400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29779us (30277us total) trans 4294973079 rc 0/0
00000100:00100000:2.0:1789760763.492866:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5792
00000100:00100000:2.0:1789760763.492876:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735108539514 time 735149738209 state 0x2 ref 0
00000001:00080000:3.0:1789760763.494485:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973079 is committed
00000100:00100000:3.0:1789760763.496996:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760763.497283:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520998528
00000100:00100000:2.0:1789760763.497294:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520998528
00000100:00100000:2.0:1789760763.499302:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735108539514 time 735149738209 state 0x0 ref 1
00000100:00100000:2.0:1789760763.499337:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735149998625 time 735149738209 state 0x1 ref 1
00000100:00100000:2.0:1789760763.499381:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735149998625 time 735186063697 state 0x0 ref 1
00000100:00100000:2.0:1789760763.499401:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520998528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760763.499451:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23592960, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:2.0:1789760763.499461:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.499477:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:2.0:1789760763.499482:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760763.499488:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.499502:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760763.529888:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23592960 -> 23597056
00010000:00010000:3.0:1789760763.529909:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.529922:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.529932:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760763.530018:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973080 is committed
00010000:00010000:3.0:1789760763.530059:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760763.530065:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.530075:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.530093:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.530102:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d061 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23592960->23597055] (req 23592960->23597055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760763.530302:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520998528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30904us (33312us total) trans 4294973080 rc 0/0
00000100:00100000:3.0:1789760763.530355:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5793
00000100:00100000:3.0:1789760763.530365:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735149998625 time 735186063697 state 0x2 ref 0
00000100:00100000:1.0:1789760763.533631:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760763.533735:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520998656
00000100:00100000:0.0:1789760763.533745:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520998656
00000100:00100000:0.0:1789760763.533798:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735149998625 time 735186063697 state 0x0 ref 1
00000100:00100000:0.0:1789760763.533814:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735186324113 time 735186063697 state 0x1 ref 1
00000100:00100000:0.0:1789760763.533845:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735186324113 time 735220528032 state 0x0 ref 1
00000100:00100000:0.0:1789760763.533857:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520998656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760763.533905:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23597056, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:0.0:1789760763.533914:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.533928:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:0.0:1789760763.533933:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760763.533951:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.533964:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760763.569583:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973081 is committed
00002000:00010000:3.0:1789760763.569782:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23597056 -> 23601152
00010000:00010000:3.0:1789760763.569795:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.569805:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.569811:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.569816:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760763.569819:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.569829:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.569843:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.569847:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d068 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23597056->23601151] (req 23597056->23601151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760763.569926:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520998656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36067us (36300us total) trans 4294973081 rc 0/0
00000100:00100000:3.0:1789760763.569936:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5794
00000100:00100000:3.0:1789760763.569946:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735186324113 time 735220528032 state 0x2 ref 0
00000100:00100000:2.0:1789760763.573538:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760763.573846:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520998784
00000100:00100000:0.0:1789760763.573855:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520998784
00000100:00100000:0.0:1789760763.573911:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735186324113 time 735220528032 state 0x0 ref 1
00000100:00100000:0.0:1789760763.573926:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735220788448 time 735220528032 state 0x1 ref 1
00000100:00100000:0.0:1789760763.573962:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735220788448 time 735260644368 state 0x0 ref 1
00000100:00100000:0.0:1789760763.573983:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520998784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760763.574033:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23601152, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:0.0:1789760763.574042:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.574070:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:0.0:1789760763.574074:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760763.574081:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.574096:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760763.635257:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973082 is committed
00002000:00010000:3.0:1789760763.640399:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23601152 -> 23605248
00010000:00010000:3.0:1789760763.640421:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.640433:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.640442:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.640449:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760763.640455:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.640463:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.640483:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.640490:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d06f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23601152->23605247] (req 23601152->23605247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760763.640783:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520998784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 66797us (67249us total) trans 4294973082 rc 0/0
00000100:00100000:3.0:1789760763.640794:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5795
00000100:00100000:3.0:1789760763.640804:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735220788448 time 735260644368 state 0x2 ref 0
00000100:00100000:0.0:1789760763.648685:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760763.648870:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520998912
00000100:00100000:2.0:1789760763.648888:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520998912
00000100:00100000:2.0:1789760763.648952:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735220788448 time 735260644368 state 0x0 ref 1
00000100:00100000:2.0:1789760763.648966:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735260904784 time 735260644368 state 0x1 ref 1
00000100:00100000:2.0:1789760763.648994:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735260904784 time 735335677252 state 0x0 ref 1
00000100:00100000:2.0:1789760763.649006:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520998912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760763.649055:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23605248, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:2.0:1789760763.649065:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.649079:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:2.0:1789760763.649083:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760763.649089:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760763.649113:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760763.717555:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23605248 -> 23609344
00010000:00010000:0.0:1789760763.717587:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.717600:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.717608:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.717619:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760763.717624:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.717639:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.717658:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.717665:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d076 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23605248->23609343] (req 23605248->23609343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760763.718212:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699520998912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 69200us (69529us total) trans 4294973083 rc 0/0
00000100:00100000:0.0:1789760763.718224:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5796
00000100:00100000:0.0:1789760763.718234:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735260904784 time 735335677252 state 0x2 ref 0
00000001:00080000:1.0:1789760763.718433:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973083 is committed
00000100:00100000:0.0:1789760763.730161:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760763.730251:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520999040
00000100:00100000:3.0:1789760763.730260:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520999040
00000100:00100000:3.0:1789760763.730343:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735260904784 time 735335677252 state 0x0 ref 1
00000100:00100000:3.0:1789760763.730359:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735335937668 time 735335677252 state 0x1 ref 1
00000100:00100000:3.0:1789760763.730384:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735335937668 time 735417066490 state 0x0 ref 1
00000100:00100000:3.0:1789760763.730396:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520999040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760763.730453:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23609344, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:3.0:1789760763.730463:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.730480:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760763.730484:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760763.730490:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.730505:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760763.767180:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973084 is committed
00002000:00010000:0.0:1789760763.767344:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23609344 -> 23613440
00010000:00010000:0.0:1789760763.767360:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.767372:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.767381:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.767394:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760763.767399:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.767409:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.767428:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.767436:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d07d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23609344->23613439] (req 23609344->23613439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760763.767523:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699520999040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37123us (37366us total) trans 4294973084 rc 0/0
00000100:00100000:0.0:1789760763.767533:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5797
00000100:00100000:0.0:1789760763.767543:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735335937668 time 735417066490 state 0x2 ref 0
00000100:00100000:2.0:1789760763.772671:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760763.772818:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520999168
00000100:00100000:3.0:1789760763.772829:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520999168
00000100:00100000:3.0:1789760763.772881:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735335937668 time 735417066490 state 0x0 ref 1
00000100:00100000:3.0:1789760763.772898:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735417326906 time 735417066490 state 0x1 ref 1
00000100:00100000:3.0:1789760763.772924:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735417326906 time 735459606326 state 0x0 ref 1
00000100:00100000:3.0:1789760763.772938:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520999168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760763.772988:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23613440, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:3.0:1789760763.772998:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.773015:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760763.773020:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760763.773027:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.773041:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760763.806931:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973085 is committed
00002000:00010000:3.0:1789760763.807061:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23613440 -> 23617536
00010000:00010000:3.0:1789760763.807078:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.807090:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.807108:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.807117:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760763.807122:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.807134:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.807156:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.807163:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d084 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23613440->23617535] (req 23613440->23617535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760763.807585:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520999168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34635us (34909us total) trans 4294973085 rc 0/0
00000100:00100000:3.0:1789760763.807596:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5798
00000100:00100000:3.0:1789760763.807606:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735417326906 time 735459606326 state 0x2 ref 0
00000100:00100000:0.0:1789760763.811705:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760763.811782:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520999296
00000100:00100000:3.0:1789760763.811793:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520999296
00000100:00100000:3.0:1789760763.811844:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735417326906 time 735459606326 state 0x0 ref 1
00000100:00100000:3.0:1789760763.811857:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735459866742 time 735459606326 state 0x1 ref 1
00000100:00100000:3.0:1789760763.811876:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735459866742 time 735498559938 state 0x0 ref 1
00000100:00100000:3.0:1789760763.811886:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520999296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760763.811929:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23617536, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:3.0:1789760763.811938:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.811952:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760763.811957:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760763.811963:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.811976:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760763.837785:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973086 is committed
00002000:00010000:3.0:1789760763.837881:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23617536 -> 23621632
00010000:00010000:3.0:1789760763.837896:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.837911:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.837920:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.837928:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760763.837933:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.837942:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.837962:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.837970:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d08b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23617536->23621631] (req 23617536->23621631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760763.838062:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699520999296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26171us (26361us total) trans 4294973086 rc 0/0
00000100:00100000:3.0:1789760763.838076:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5799
00000100:00100000:3.0:1789760763.838086:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735459866742 time 735498559938 state 0x2 ref 0
00000100:00100000:2.0:1789760763.841729:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760763.841850:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520999424
00000100:00100000:0.0:1789760763.841859:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520999424
00000100:00100000:0.0:1789760763.841911:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735459866742 time 735498559938 state 0x0 ref 1
00000100:00100000:0.0:1789760763.841927:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735498820354 time 735498559938 state 0x1 ref 1
00000100:00100000:0.0:1789760763.841994:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735498820354 time 735528675855 state 0x0 ref 1
00000100:00100000:0.0:1789760763.842007:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520999424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760763.842056:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23621632, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:0.0:1789760763.842066:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.842087:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:0.0:1789760763.842092:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760763.842098:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.842112:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760763.882706:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973087 is committed
00002000:00010000:0.0:1789760763.883070:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23621632 -> 23625728
00010000:00010000:0.0:1789760763.883085:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.883098:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.883112:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.883119:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760763.883134:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.883144:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.883165:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.883173:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d092 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23621632->23625727] (req 23621632->23625727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760763.883276:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520999424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41266us (41552us total) trans 4294973087 rc 0/0
00000100:00100000:0.0:1789760763.883286:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5800
00000100:00100000:0.0:1789760763.883296:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735498820354 time 735528675855 state 0x2 ref 0
00000100:00100000:0.0:1789760763.888225:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760763.888491:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520999552
00000100:00100000:3.0:1789760763.888501:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520999552
00000100:00100000:3.0:1789760763.888551:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735498820354 time 735528675855 state 0x0 ref 1
00000100:00100000:3.0:1789760763.888585:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735528936271 time 735528675855 state 0x1 ref 1
00000100:00100000:3.0:1789760763.888612:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735528936271 time 735575294842 state 0x0 ref 1
00000100:00100000:3.0:1789760763.888624:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520999552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760763.888668:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23625728, mtime: 0x6aad94fc, atime: 0x0, ctime: 0x6aad94fc, blocks: 0xb807
00010000:00010000:3.0:1789760763.888676:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.888691:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760763.888696:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760763.888702:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.888715:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760763.926553:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973088 is committed
00002000:00010000:0.0:1789760763.926893:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23625728 -> 23629824
00002000:00010000:0.0:1789760763.926898:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760764 -> 1789760765
00002000:00010000:0.0:1789760763.926900:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760764 -> 1789760765
00010000:00010000:0.0:1789760763.926913:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.926925:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.926939:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.926946:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760763.926950:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.926964:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.926988:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.926996:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d099 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23625728->23629823] (req 23625728->23629823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760763.927296:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520999552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38669us (39076us total) trans 4294973088 rc 0/0
00000100:00100000:0.0:1789760763.927307:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5801
00000100:00100000:0.0:1789760763.927384:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735528936271 time 735575294842 state 0x2 ref 0
00000100:00100000:1.0:1789760763.932178:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760763.932293:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520999680
00000100:00100000:3.0:1789760763.932302:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520999680
00000100:00100000:3.0:1789760763.932387:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735528936271 time 735575294842 state 0x0 ref 1
00000100:00100000:3.0:1789760763.932401:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735575555258 time 735575294842 state 0x1 ref 1
00000100:00100000:3.0:1789760763.932425:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735575555258 time 735619108675 state 0x0 ref 1
00000100:00100000:3.0:1789760763.932437:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520999680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760763.932483:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23629824, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760763.932497:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.932512:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760763.932517:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760763.932523:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760763.932536:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760763.985129:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23629824 -> 23633920
00010000:00010000:0.0:1789760763.985150:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.985170:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.985178:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.985186:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760763.985190:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.985199:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.985219:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.985226:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23629824->23633919] (req 23629824->23633919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760763.985395:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973089 is committed
00000100:00100000:0.0:1789760763.985407:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699520999680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52956us (53223us total) trans 4294973089 rc 0/0
00000100:00100000:0.0:1789760763.985420:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5802
00000100:00100000:0.0:1789760763.985430:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735575555258 time 735619108675 state 0x2 ref 0
00000100:00100000:2.0:1789760763.996672:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760763.996795:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520999808
00000100:00100000:0.0:1789760763.996805:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520999808
00000100:00100000:0.0:1789760763.996868:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735575555258 time 735619108675 state 0x0 ref 1
00000100:00100000:0.0:1789760763.996884:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735619369091 time 735619108675 state 0x1 ref 1
00000100:00100000:0.0:1789760763.996978:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735619369091 time 735683659301 state 0x0 ref 1
00000100:00100000:0.0:1789760763.996992:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520999808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760763.997044:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23633920, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:0.0:1789760763.997053:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.997069:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:0.0:1789760763.997073:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760763.997080:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760763.997093:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760764.033568:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973090 is committed
00002000:00010000:0.0:1789760764.033660:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23633920 -> 23638016
00010000:00010000:0.0:1789760764.033676:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.033689:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.033704:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.033712:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760764.033717:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.033727:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.033746:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.033754:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d0a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23633920->23638015] (req 23633920->23638015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760764.034044:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699520999808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37049us (37376us total) trans 4294973090 rc 0/0
00000100:00100000:0.0:1789760764.034055:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5803
00000100:00100000:0.0:1789760764.034065:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735619369091 time 735683659301 state 0x2 ref 0
00000100:00100000:2.0:1789760764.038278:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760764.038408:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699520999936
00000100:00100000:0.0:1789760764.038419:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699520999936
00000100:00100000:0.0:1789760764.038483:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735619369091 time 735683659301 state 0x0 ref 1
00000100:00100000:0.0:1789760764.038498:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735683919717 time 735683659301 state 0x1 ref 1
00000100:00100000:0.0:1789760764.038527:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735683919717 time 735725209067 state 0x0 ref 1
00000100:00100000:0.0:1789760764.038539:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520999936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760764.038598:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23638016, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:0.0:1789760764.038608:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.038623:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:0.0:1789760764.038628:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760764.038634:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.038647:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760764.039137:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760764.095795:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973091 is committed
00002000:00010000:1.0:1789760764.095916:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23638016 -> 23642112
00010000:00010000:1.0:1789760764.095933:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.095946:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.095955:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.095968:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760764.095973:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.095981:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.096001:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.096014:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60d0ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23638016->23642111] (req 23638016->23642111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760764.096118:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699520999936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57575us (57844us total) trans 4294973091 rc 0/0
00000100:00100000:1.0:1789760764.096128:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5804
00000100:00100000:1.0:1789760764.096139:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735683919717 time 735725209067 state 0x2 ref 0
00000100:00100000:1.0:1789760764.101777:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.102068:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521000064
00000100:00100000:3.0:1789760764.102077:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521000064
00000100:00100000:3.0:1789760764.102142:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735683919717 time 735725209067 state 0x0 ref 1
00000100:00100000:3.0:1789760764.102157:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735725469483 time 735725209067 state 0x1 ref 1
00000100:00100000:3.0:1789760764.102191:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735725469483 time 735788874091 state 0x0 ref 1
00000100:00100000:3.0:1789760764.102203:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521000064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.102263:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23642112, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.102273:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.102290:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760764.102294:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.102301:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.102347:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760764.161247:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973092 is committed
00002000:00010000:2.0:1789760764.161446:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23642112 -> 23646208
00010000:00010000:2.0:1789760764.161463:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.161476:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.161486:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.161499:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760764.161504:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.161513:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.161531:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.161539:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d0b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23642112->23646207] (req 23642112->23646207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760764.161645:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521000064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59438us (59873us total) trans 4294973092 rc 0/0
00000100:00100000:2.0:1789760764.161656:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5805
00000100:00100000:2.0:1789760764.161666:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735725469483 time 735788874091 state 0x2 ref 0
00000100:00100000:2.0:1789760764.173662:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.173741:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521000192
00000100:00100000:3.0:1789760764.173751:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521000192
00000100:00100000:3.0:1789760764.173804:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735725469483 time 735788874091 state 0x0 ref 1
00000100:00100000:3.0:1789760764.173818:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735789134507 time 735788874091 state 0x1 ref 1
00000100:00100000:3.0:1789760764.173852:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735789134507 time 735860534675 state 0x0 ref 1
00000100:00100000:3.0:1789760764.173865:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521000192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.173914:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23646208, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.173933:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.173949:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760764.173955:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.173962:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.173976:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760764.206007:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973093 is committed
00002000:00010000:1.0:1789760764.206113:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23646208 -> 23650304
00010000:00010000:1.0:1789760764.206129:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.206142:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.206152:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.206160:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760764.206164:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.206174:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.206199:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.206206:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d0bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23646208->23650303] (req 23646208->23650303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760764.206302:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521000192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32434us (32645us total) trans 4294973093 rc 0/0
00000100:00100000:1.0:1789760764.206345:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5806
00000100:00100000:1.0:1789760764.206355:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735789134507 time 735860534675 state 0x2 ref 0
00000100:00100000:0.0:1789760764.210122:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.210219:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521000320
00000100:00100000:3.0:1789760764.210230:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521000320
00000100:00100000:3.0:1789760764.210288:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735789134507 time 735860534675 state 0x0 ref 1
00000100:00100000:3.0:1789760764.210303:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735860795091 time 735860534675 state 0x1 ref 1
00000100:00100000:3.0:1789760764.210361:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735860795091 time 735897042954 state 0x0 ref 1
00000100:00100000:3.0:1789760764.210375:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521000320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.210430:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23650304, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.210440:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.210456:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:3.0:1789760764.210460:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.210467:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.210490:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760764.253070:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973094 is committed
00002000:00010000:1.0:1789760764.253383:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23650304 -> 23654400
00010000:00010000:1.0:1789760764.253398:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.253410:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.253419:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.253425:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760764.253430:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.253442:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.253460:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.253466:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d0c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23650304->23654399] (req 23650304->23654399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760764.253557:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521000320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43179us (43440us total) trans 4294973094 rc 0/0
00000100:00100000:1.0:1789760764.253578:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5807
00000100:00100000:1.0:1789760764.253588:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735860795091 time 735897042954 state 0x2 ref 0
00000100:00100000:3.0:1789760764.256831:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760764.257026:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521000448
00000100:00100000:1.0:1789760764.257036:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521000448
00000100:00100000:1.0:1789760764.257089:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735860795091 time 735897042954 state 0x0 ref 1
00000100:00100000:1.0:1789760764.257115:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735897303370 time 735897042954 state 0x1 ref 1
00000100:00100000:1.0:1789760764.257145:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735897303370 time 735943827582 state 0x0 ref 1
00000100:00100000:1.0:1789760764.257158:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521000448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760764.257214:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23654400, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:1.0:1789760764.257224:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.257240:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=735s v=(0 0)
00010000:00010000:1.0:1789760764.257244:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760764.257251:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.257265:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760764.316393:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973095 is committed
00002000:00010000:1.0:1789760764.316526:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23654400 -> 23658496
00010000:00010000:1.0:1789760764.316542:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.316555:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.316564:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.316582:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760764.316587:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.316596:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.316626:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.316636:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d0ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23654400->23658495] (req 23654400->23658495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760764.316743:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521000448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59582us (59915us total) trans 4294973095 rc 0/0
00000100:00100000:1.0:1789760764.316753:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5808
00000100:00100000:1.0:1789760764.316763:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735897303370 time 735943827582 state 0x2 ref 0
00000100:00100000:2.0:1789760764.319530:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.319624:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521000576
00000100:00100000:3.0:1789760764.319635:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521000576
00000100:00100000:3.0:1789760764.319687:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735897303370 time 735943827582 state 0x0 ref 1
00000100:00100000:3.0:1789760764.319702:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735944087998 time 735943827582 state 0x1 ref 1
00000100:00100000:3.0:1789760764.319733:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735944087998 time 736006414936 state 0x0 ref 1
00000100:00100000:3.0:1789760764.319745:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521000576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.319789:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23658496, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.319798:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.319814:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760764.319819:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.319825:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.319838:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760764.357945:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973096 is committed
00002000:00010000:3.0:1789760764.358950:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23658496 -> 23662592
00010000:00010000:3.0:1789760764.358967:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.358981:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.358992:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.359000:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760764.359005:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.359015:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.359035:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.359044:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23658496->23662591] (req 23658496->23662591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760764.359395:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521000576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39647us (39868us total) trans 4294973096 rc 0/0
00000100:00100000:3.0:1789760764.359410:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5809
00000100:00100000:3.0:1789760764.359419:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735944087998 time 736006414936 state 0x2 ref 0
00000100:00100000:0.0:1789760764.366888:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.367555:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521000704
00000100:00100000:3.0:1789760764.367565:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521000704
00000100:00100000:3.0:1789760764.367883:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 735944087998 time 736006414936 state 0x0 ref 1
00000100:00100000:3.0:1789760764.367908:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736006675352 time 736006414936 state 0x1 ref 1
00000100:00100000:3.0:1789760764.367941:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736006675352 time 736054622572 state 0x0 ref 1
00000100:00100000:3.0:1789760764.367953:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521000704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.368001:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23662592, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.368010:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.368026:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760764.368031:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.368037:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.368050:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760764.401969:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973097 is committed
00002000:00010000:3.0:1789760764.402082:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23662592 -> 23666688
00010000:00010000:3.0:1789760764.402106:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.402120:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.402130:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.402138:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760764.402142:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.402150:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.402170:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.402177:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23662592->23666687] (req 23662592->23666687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760764.402349:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521000704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34358us (35430us total) trans 4294973097 rc 0/0
00000100:00100000:3.0:1789760764.402361:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5810
00000100:00100000:3.0:1789760764.402370:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736006675352 time 736054622572 state 0x2 ref 0
00000100:00100000:1.0:1789760764.405782:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.405868:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521000832
00000100:00100000:3.0:1789760764.405947:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521000832
00000100:00100000:3.0:1789760764.406765:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736006675352 time 736054622572 state 0x0 ref 1
00000100:00100000:3.0:1789760764.406781:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736054882988 time 736054622572 state 0x1 ref 1
00000100:00100000:3.0:1789760764.406813:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736054882988 time 736093495568 state 0x0 ref 1
00000100:00100000:3.0:1789760764.406827:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521000832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.406873:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23666688, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.406980:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.406997:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760764.407002:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.407009:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.407022:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760764.441558:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973098 is committed
00002000:00010000:2.0:1789760764.441710:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23666688 -> 23670784
00010000:00010000:2.0:1789760764.441727:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.441746:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.441755:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.441762:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760764.441767:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.441776:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.441795:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.441802:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d0df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23666688->23670783] (req 23666688->23670783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760764.441897:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521000832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35069us (36120us total) trans 4294973098 rc 0/0
00000100:00100000:2.0:1789760764.441907:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5811
00000100:00100000:2.0:1789760764.441917:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736054882988 time 736093495568 state 0x2 ref 0
00000100:00100000:2.0:1789760764.446302:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760764.446518:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521000960
00000100:00100000:1.0:1789760764.446529:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521000960
00000100:00100000:1.0:1789760764.446592:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736054882988 time 736093495568 state 0x0 ref 1
00000100:00100000:1.0:1789760764.446607:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736093755984 time 736093495568 state 0x1 ref 1
00000100:00100000:1.0:1789760764.446672:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736093755984 time 736133353335 state 0x0 ref 1
00000100:00100000:1.0:1789760764.446684:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521000960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760764.446732:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23670784, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:1.0:1789760764.446741:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.446757:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:1.0:1789760764.446761:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760764.446768:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.446782:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.474010:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760764.488991:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973099 is committed
00002000:00010000:2.0:1789760764.489071:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23670784 -> 23674880
00010000:00010000:2.0:1789760764.489087:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.489165:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.489175:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.489183:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760764.489188:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.489266:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.489288:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.489297:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d0e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23670784->23674879] (req 23670784->23674879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760764.489488:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521000960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42801us (43191us total) trans 4294973099 rc 0/0
00000100:00100000:2.0:1789760764.489499:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5812
00000100:00100000:2.0:1789760764.489526:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736093755984 time 736133353335 state 0x2 ref 0
00000100:00100000:1.0:1789760764.492875:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760764.493170:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521001088
00000100:00100000:2.0:1789760764.493180:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521001088
00000100:00100000:2.0:1789760764.493306:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736093755984 time 736133353335 state 0x0 ref 1
00000100:00100000:2.0:1789760764.493426:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736133613751 time 736133353335 state 0x1 ref 1
00000100:00100000:0.0:1789760764.493551:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736133613751 time 736180231041 state 0x0 ref 1
00000100:00100000:0.0:1789760764.493565:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521001088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760764.493623:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23674880, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:0.0:1789760764.493633:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.493655:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:0.0:1789760764.493660:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760764.493667:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.493681:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760764.522032:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973100 is committed
00002000:00010000:3.0:1789760764.522131:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23674880 -> 23678976
00010000:00010000:3.0:1789760764.522148:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.522161:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.522175:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.522183:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760764.522188:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.522268:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.522290:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.522298:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d0ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23674880->23678975] (req 23674880->23678975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760764.522412:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521001088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28845us (29543us total) trans 4294973100 rc 0/0
00000100:00100000:3.0:1789760764.522422:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5813
00000100:00100000:3.0:1789760764.522432:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736133613751 time 736180231041 state 0x2 ref 0
00000100:00100000:1.0:1789760764.526901:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.526994:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521001216
00000100:00100000:3.0:1789760764.527004:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521001216
00000100:00100000:3.0:1789760764.527058:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736133613751 time 736180231041 state 0x0 ref 1
00000100:00100000:3.0:1789760764.527072:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736180491457 time 736180231041 state 0x1 ref 1
00000100:00100000:3.0:1789760764.527191:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736180491457 time 736213872625 state 0x0 ref 1
00000100:00100000:3.0:1789760764.527263:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521001216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.527344:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23678976, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.527354:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.527370:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760764.527374:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.527380:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.527394:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760764.554221:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23678976 -> 23683072
00010000:00010000:1.0:1789760764.554239:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.554252:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.554261:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.554268:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760764.554272:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.554282:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.554300:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.554334:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d0f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23678976->23683071] (req 23678976->23683071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760764.554416:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521001216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27210us (27520us total) trans 4294973101 rc 0/0
00000100:00100000:1.0:1789760764.554427:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5814
00000100:00100000:1.0:1789760764.554437:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736180491457 time 736213872625 state 0x2 ref 0
00000001:00080000:2.0:1789760764.554561:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973101 is committed
00000100:00100000:1.0:1789760764.557493:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.557608:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521001344
00000100:00100000:3.0:1789760764.557617:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521001344
00000100:00100000:3.0:1789760764.557665:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736180491457 time 736213872625 state 0x0 ref 1
00000100:00100000:3.0:1789760764.557678:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736214133041 time 736213872625 state 0x1 ref 1
00000100:00100000:3.0:1789760764.557709:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736214133041 time 736244391496 state 0x0 ref 1
00000100:00100000:3.0:1789760764.557720:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521001344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.557763:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23683072, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.557772:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.557786:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760764.557790:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.557796:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.557809:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760764.589894:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23683072 -> 23687168
00010000:00010000:3.0:1789760764.589914:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.589928:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.589937:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.589944:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760764.589949:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.589959:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.589984:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.589992:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d0fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23683072->23687167] (req 23683072->23687167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760764.590080:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521001344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32357us (32591us total) trans 4294973102 rc 0/0
00000100:00100000:3.0:1789760764.590091:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5815
00000100:00100000:3.0:1789760764.590110:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736214133041 time 736244391496 state 0x2 ref 0
00000001:00080000:3.0:1789760764.590147:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973102 is committed
00000100:00100000:3.0:1789760764.593807:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760764.594124:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521001472
00000100:00100000:2.0:1789760764.594134:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521001472
00000100:00100000:2.0:1789760764.594186:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736214133041 time 736244391496 state 0x0 ref 1
00000100:00100000:2.0:1789760764.594258:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736244651912 time 736244391496 state 0x1 ref 1
00000100:00100000:2.0:1789760764.594289:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736244651912 time 736280972353 state 0x0 ref 1
00000100:00100000:2.0:1789760764.594302:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521001472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760764.594574:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23687168, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:2.0:1789760764.594584:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.594599:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:2.0:1789760764.594603:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760764.594608:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.594621:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760764.620615:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973103 is committed
00002000:00010000:2.0:1789760764.620780:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23687168 -> 23691264
00010000:00010000:2.0:1789760764.620797:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.620810:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.620820:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.620828:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760764.620833:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.620843:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.620862:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.620870:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d102 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23687168->23691263] (req 23687168->23691263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760764.620956:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521001472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26651us (27155us total) trans 4294973103 rc 0/0
00000100:00100000:2.0:1789760764.620970:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5816
00000100:00100000:2.0:1789760764.620979:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736244651912 time 736280972353 state 0x2 ref 0
00000100:00100000:3.0:1789760764.624173:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760764.624342:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521001600
00000100:00100000:1.0:1789760764.624351:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521001600
00000100:00100000:1.0:1789760764.624402:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736244651912 time 736280972353 state 0x0 ref 1
00000100:00100000:1.0:1789760764.624416:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736281232769 time 736280972353 state 0x1 ref 1
00000100:00100000:1.0:1789760764.624446:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736281232769 time 736311128306 state 0x0 ref 1
00000100:00100000:1.0:1789760764.624457:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521001600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760764.624503:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23691264, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:1.0:1789760764.624513:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.624527:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:1.0:1789760764.624531:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760764.624537:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.624551:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760764.663180:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973104 is committed
00002000:00010000:3.0:1789760764.663363:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23691264 -> 23695360
00010000:00010000:3.0:1789760764.663380:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.663392:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.663401:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.663408:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760764.663413:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.663422:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.663439:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.663447:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d109 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23691264->23695359] (req 23691264->23695359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760764.663537:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521001600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39076us (39367us total) trans 4294973104 rc 0/0
00000100:00100000:3.0:1789760764.663547:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5817
00000100:00100000:3.0:1789760764.663556:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736281232769 time 736311128306 state 0x2 ref 0
00000100:00100000:1.0:1789760764.668756:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.668839:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521001728
00000100:00100000:3.0:1789760764.668848:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521001728
00000100:00100000:3.0:1789760764.668899:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736281232769 time 736311128306 state 0x0 ref 1
00000100:00100000:3.0:1789760764.668915:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736311388722 time 736311128306 state 0x1 ref 1
00000100:00100000:3.0:1789760764.668950:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736311388722 time 736355632195 state 0x0 ref 1
00000100:00100000:3.0:1789760764.668961:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521001728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.669007:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23695360, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.669021:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.669036:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760764.669041:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.669048:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.669063:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760764.706018:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23695360 -> 23699456
00010000:00010000:3.0:1789760764.706037:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.706050:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.706059:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.706067:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760764.706072:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.706081:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.706113:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.706121:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d110 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23695360->23699455] (req 23695360->23699455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760764.706214:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521001728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37249us (37463us total) trans 4294973105 rc 0/0
00000100:00100000:3.0:1789760764.706224:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5818
00000100:00100000:3.0:1789760764.706233:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736311388722 time 736355632195 state 0x2 ref 0
00000001:00080000:1.0:1789760764.708113:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973105 is committed
00000100:00100000:3.0:1789760764.708874:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760764.709287:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521001856
00000100:00100000:0.0:1789760764.709296:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521001856
00000100:00100000:0.0:1789760764.709367:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736311388722 time 736355632195 state 0x0 ref 1
00000100:00100000:0.0:1789760764.709381:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736355892611 time 736355632195 state 0x1 ref 1
00000100:00100000:0.0:1789760764.709400:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736355892611 time 736396083576 state 0x0 ref 1
00000100:00100000:0.0:1789760764.709410:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521001856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760764.709455:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23699456, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:0.0:1789760764.709464:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.709481:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:0.0:1789760764.709485:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760764.709491:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.709505:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760764.742450:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973106 is committed
00002000:00010000:0.0:1789760764.742548:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23699456 -> 23703552
00010000:00010000:0.0:1789760764.742563:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.742586:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.742595:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.742603:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760764.742608:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.742618:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.742638:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.742654:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d117 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23699456->23703551] (req 23699456->23703551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760764.742753:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521001856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33338us (33878us total) trans 4294973106 rc 0/0
00000100:00100000:0.0:1789760764.742763:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5819
00000100:00100000:0.0:1789760764.742772:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736355892611 time 736396083576 state 0x2 ref 0
00000100:00100000:0.0:1789760764.746554:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760764.746642:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521001984
00000100:00100000:1.0:1789760764.746660:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521001984
00000100:00100000:1.0:1789760764.746713:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736355892611 time 736396083576 state 0x0 ref 1
00000100:00100000:1.0:1789760764.746728:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736396343992 time 736396083576 state 0x1 ref 1
00000100:00100000:1.0:1789760764.746757:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736396343992 time 736433439960 state 0x0 ref 1
00000100:00100000:1.0:1789760764.746771:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521001984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760764.746827:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23703552, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:1.0:1789760764.746838:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.746854:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:1.0:1789760764.746859:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760764.746867:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.746883:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760764.784382:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973107 is committed
00002000:00010000:1.0:1789760764.784410:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23703552 -> 23707648
00010000:00010000:1.0:1789760764.784426:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.784438:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.784447:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.784453:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760764.784458:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.784465:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.784485:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.784493:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d11e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23703552->23707647] (req 23703552->23707647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760764.784726:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521001984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37953us (38175us total) trans 4294973107 rc 0/0
00000100:00100000:1.0:1789760764.784741:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5820
00000100:00100000:1.0:1789760764.784750:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736396343992 time 736433439960 state 0x2 ref 0
00000100:00100000:1.0:1789760764.788420:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760764.788518:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521002112
00000100:00100000:3.0:1789760764.788528:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521002112
00000100:00100000:3.0:1789760764.788599:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736396343992 time 736433439960 state 0x0 ref 1
00000100:00100000:3.0:1789760764.788615:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736433700376 time 736433439960 state 0x1 ref 1
00000100:00100000:3.0:1789760764.788650:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736433700376 time 736475333232 state 0x0 ref 1
00000100:00100000:3.0:1789760764.788662:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760764.788714:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23707648, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:3.0:1789760764.788723:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.788745:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760764.788750:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760764.788756:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760764.788771:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760764.872182:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973108 is committed
00002000:00010000:0.0:1789760764.872288:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23707648 -> 23711744
00010000:00010000:0.0:1789760764.872304:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.872336:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.872346:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.872354:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760764.872358:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.872368:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.872387:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.872399:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d125 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23707648->23711743] (req 23707648->23711743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760764.872505:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 83839us (84088us total) trans 4294973108 rc 0/0
00000100:00100000:0.0:1789760764.872577:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5821
00000100:00100000:0.0:1789760764.872588:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736433700376 time 736475333232 state 0x2 ref 0
00000100:00100000:3.0:1789760764.876040:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760764.876199:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521002240
00000100:00100000:1.0:1789760764.876209:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521002240
00000100:00100000:1.0:1789760764.876442:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736433700376 time 736475333232 state 0x0 ref 1
00000100:00100000:1.0:1789760764.876459:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736475593648 time 736475333232 state 0x1 ref 1
00000100:00100000:1.0:1789760764.876523:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736475593648 time 736563204688 state 0x0 ref 1
00000100:00100000:1.0:1789760764.876547:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760764.876601:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23711744, mtime: 0x6aad94fd, atime: 0x0, ctime: 0x6aad94fd, blocks: 0xb807
00010000:00010000:1.0:1789760764.876610:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.876625:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:1.0:1789760764.876629:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760764.876635:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.876649:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760764.917973:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973109 is committed
00002000:00010000:1.0:1789760764.918079:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23711744 -> 23715840
00002000:00010000:1.0:1789760764.918083:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760765 -> 1789760766
00002000:00010000:1.0:1789760764.918086:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760765 -> 1789760766
00010000:00010000:1.0:1789760764.918162:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.918176:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.918185:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.918193:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760764.918261:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.918271:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.918292:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.918301:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d12c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23711744->23715839] (req 23711744->23715839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760764.918498:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41950us (42463us total) trans 4294973109 rc 0/0
00000100:00100000:1.0:1789760764.918509:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5822
00000100:00100000:1.0:1789760764.918518:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736475593648 time 736563204688 state 0x2 ref 0
00000100:00100000:0.0:1789760764.921945:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760764.922040:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521002368
00000100:00100000:2.0:1789760764.922051:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521002368
00000100:00100000:2.0:1789760764.922162:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736475593648 time 736563204688 state 0x0 ref 1
00000100:00100000:2.0:1789760764.922176:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736563465104 time 736563204688 state 0x1 ref 1
00000100:00100000:2.0:1789760764.922295:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736563465104 time 736608976753 state 0x0 ref 1
00000100:00100000:2.0:1789760764.922310:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760764.922441:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23715840, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:2.0:1789760764.922450:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.922466:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:2.0:1789760764.922470:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760764.922476:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760764.922489:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760764.957609:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973110 is committed
00002000:00010000:0.0:1789760764.957700:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23715840 -> 23719936
00010000:00010000:0.0:1789760764.957716:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.957728:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.957737:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.957743:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760764.957748:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.957757:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.957780:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760764.957788:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d133 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23715840->23719935] (req 23715840->23719935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760764.957909:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35597us (35969us total) trans 4294973110 rc 0/0
00000100:00100000:0.0:1789760764.957920:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5823
00000100:00100000:0.0:1789760764.957929:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736563465104 time 736608976753 state 0x2 ref 0
00000100:00100000:2.0:1789760764.963376:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760764.963445:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521002496
00000100:00100000:1.0:1789760764.963455:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521002496
00000100:00100000:1.0:1789760764.963524:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736563465104 time 736608976753 state 0x0 ref 1
00000100:00100000:1.0:1789760764.963540:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736609237169 time 736608976753 state 0x1 ref 1
00000100:00100000:1.0:1789760764.963581:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736609237169 time 736650263105 state 0x0 ref 1
00000100:00100000:1.0:1789760764.963593:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760764.963641:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23719936, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:1.0:1789760764.963650:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.963665:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:1.0:1789760764.963670:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760764.963675:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760764.963688:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760765.002705:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23719936 -> 23724032
00010000:00010000:1.0:1789760765.002726:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.002740:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.002749:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.002757:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760765.002762:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.002771:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.002791:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.002799:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d13a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23719936->23724031] (req 23719936->23724031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760765.002974:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521002496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39378us (39603us total) trans 4294973111 rc 0/0
00000100:00100000:1.0:1789760765.002988:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5824
00000100:00100000:1.0:1789760765.002998:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736609237169 time 736650263105 state 0x2 ref 0
00000001:00080000:3.0:1789760765.003101:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973111 is committed
00000100:00100000:0.0:1789760765.006889:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.006976:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521002624
00000100:00100000:3.0:1789760765.006986:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521002624
00000100:00100000:3.0:1789760765.007035:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736609237169 time 736650263105 state 0x0 ref 1
00000100:00100000:3.0:1789760765.007050:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736650523521 time 736650263105 state 0x1 ref 1
00000100:00100000:3.0:1789760765.007105:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736650523521 time 736693787935 state 0x0 ref 1
00000100:00100000:3.0:1789760765.007117:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521002624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.007168:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23724032, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.007178:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.007258:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760765.007264:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.007272:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.007288:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760765.040301:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23724032 -> 23728128
00010000:00010000:3.0:1789760765.040353:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.040367:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.040377:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.040385:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760765.040390:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.040400:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.040423:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.040430:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d141 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23724032->23728127] (req 23724032->23728127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760765.040527:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521002624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33406us (33643us total) trans 4294973112 rc 0/0
00000100:00100000:3.0:1789760765.040538:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5825
00000100:00100000:3.0:1789760765.040756:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736650523521 time 736693787935 state 0x2 ref 0
00000001:00080000:2.0:1789760765.040831:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973112 is committed
00000100:00100000:2.0:1789760765.044618:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.044743:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521002752
00000100:00100000:3.0:1789760765.044754:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521002752
00000100:00100000:3.0:1789760765.044808:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736650523521 time 736693787935 state 0x0 ref 1
00000100:00100000:3.0:1789760765.044824:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736694048351 time 736693787935 state 0x1 ref 1
00000100:00100000:3.0:1789760765.044860:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736694048351 time 736731541625 state 0x0 ref 1
00000100:00100000:3.0:1789760765.044872:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.044919:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23728128, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.044928:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.044945:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760765.044950:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.044956:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.044970:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760765.077068:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23728128 -> 23732224
00010000:00010000:0.0:1789760765.077089:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.077112:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.077123:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.077130:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.077135:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.077148:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.077167:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.077175:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d148 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23728128->23732223] (req 23728128->23732223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.077412:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521002752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32535us (32797us total) trans 4294973113 rc 0/0
00000100:00100000:0.0:1789760765.077422:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5826
00000100:00100000:0.0:1789760765.077432:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736694048351 time 736731541625 state 0x2 ref 0
00000001:00080000:2.0:1789760765.079687:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973113 is committed
00000100:00100000:2.0:1789760765.080805:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.080904:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521002880
00000100:00100000:0.0:1789760765.080914:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521002880
00000100:00100000:0.0:1789760765.080964:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736694048351 time 736731541625 state 0x0 ref 1
00000100:00100000:0.0:1789760765.080978:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736731802041 time 736731541625 state 0x1 ref 1
00000100:00100000:0.0:1789760765.081008:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736731802041 time 736767690751 state 0x0 ref 1
00000100:00100000:0.0:1789760765.081021:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760765.081066:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23732224, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:0.0:1789760765.081076:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.081294:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:0.0:1789760765.081299:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760765.081306:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.081344:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760765.117943:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973114 is committed
00002000:00010000:3.0:1789760765.118051:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23732224 -> 23736320
00010000:00010000:3.0:1789760765.118068:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.118080:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.118088:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.118107:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760765.118112:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.118121:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.118140:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.118147:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d14f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23732224->23736319] (req 23732224->23736319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760765.118525:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521002880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37288us (37508us total) trans 4294973114 rc 0/0
00000100:00100000:3.0:1789760765.118543:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5827
00000100:00100000:3.0:1789760765.118624:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736731802041 time 736767690751 state 0x2 ref 0
00000100:00100000:0.0:1789760765.124025:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760765.124119:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521003008
00000100:00100000:2.0:1789760765.124129:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521003008
00000100:00100000:2.0:1789760765.124183:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736731802041 time 736767690751 state 0x0 ref 1
00000100:00100000:2.0:1789760765.124305:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736767951167 time 736767690751 state 0x1 ref 1
00000100:00100000:2.0:1789760765.124406:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736767951167 time 736811087182 state 0x0 ref 1
00000100:00100000:2.0:1789760765.124418:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521003008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760765.124465:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23736320, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:2.0:1789760765.124475:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.124491:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:2.0:1789760765.124495:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760765.124501:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.124515:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760765.150079:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973115 is committed
00002000:00010000:0.0:1789760765.150275:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23736320 -> 23740416
00010000:00010000:0.0:1789760765.150293:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.150305:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.150331:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.150339:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.150344:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.150353:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.150377:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.150385:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d156 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23736320->23740415] (req 23736320->23740415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.150465:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+6:2405:x1876699521003008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26044us (26445us total) trans 4294973115 rc 0/0
00000100:00100000:0.0:1789760765.150475:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5828
00000100:00100000:0.0:1789760765.150484:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736767951167 time 736811087182 state 0x2 ref 0
00000100:00100000:2.0:1789760765.154650:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.154746:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521003136
00000100:00100000:3.0:1789760765.154755:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521003136
00000100:00100000:3.0:1789760765.154808:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736767951167 time 736811087182 state 0x0 ref 1
00000100:00100000:3.0:1789760765.154822:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736811347598 time 736811087182 state 0x1 ref 1
00000100:00100000:3.0:1789760765.154886:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736811347598 time 736841568294 state 0x0 ref 1
00000100:00100000:3.0:1789760765.154899:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521003136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.154948:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23740416, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.154958:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.154974:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:3.0:1789760765.154978:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.154984:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.154997:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760765.186306:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23740416 -> 23744512
00010000:00010000:3.0:1789760765.186347:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.186359:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.186368:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.186376:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760765.186381:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.186390:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.186411:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.186420:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d15d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23740416->23744511] (req 23740416->23744511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760765.186504:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521003136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31601us (31858us total) trans 4294973116 rc 0/0
00000100:00100000:3.0:1789760765.186514:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5829
00000100:00100000:3.0:1789760765.186525:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736811347598 time 736841568294 state 0x2 ref 0
00000001:00080000:3.0:1789760765.186574:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973116 is committed
00000100:00100000:2.0:1789760765.190422:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.190528:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521003264
00000100:00100000:0.0:1789760765.190537:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521003264
00000100:00100000:0.0:1789760765.190598:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736811347598 time 736841568294 state 0x0 ref 1
00000100:00100000:0.0:1789760765.190613:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736841828710 time 736841568294 state 0x1 ref 1
00000100:00100000:0.0:1789760765.190643:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736841828710 time 736877325674 state 0x0 ref 1
00000100:00100000:0.0:1789760765.190655:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521003264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760765.190703:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23744512, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:0.0:1789760765.190712:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.190727:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:0.0:1789760765.190732:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760765.190738:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.190751:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760765.218745:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23744512 -> 23748608
00010000:00010000:0.0:1789760765.218774:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.218788:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.218798:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.218806:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.218811:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.218820:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.218840:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.218849:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60d164 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23744512->23748607] (req 23744512->23748607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.218935:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521003264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28277us (28518us total) trans 4294973117 rc 0/0
00000100:00100000:0.0:1789760765.218947:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5830
00000100:00100000:0.0:1789760765.218956:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736841828710 time 736877325674 state 0x2 ref 0
00000001:00080000:3.0:1789760765.219691:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973117 is committed
00000100:00100000:3.0:1789760765.225931:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760765.226094:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521003392
00000100:00100000:2.0:1789760765.226105:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521003392
00000100:00100000:2.0:1789760765.226166:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736841828710 time 736877325674 state 0x0 ref 1
00000100:00100000:2.0:1789760765.226185:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736877586090 time 736877325674 state 0x1 ref 1
00000100:00100000:2.0:1789760765.226215:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736877586090 time 736912897591 state 0x0 ref 1
00000100:00100000:2.0:1789760765.226227:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521003392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760765.226297:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23748608, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:2.0:1789760765.226309:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.226453:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:2.0:1789760765.226457:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760765.226464:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.226481:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760765.270688:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973118 is committed
00002000:00010000:2.0:1789760765.270904:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23748608 -> 23752704
00010000:00010000:2.0:1789760765.270922:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.270935:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.270948:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.270955:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760765.270959:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.270967:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.270985:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760765.270992:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d16b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23748608->23752703] (req 23748608->23752703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760765.271080:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521003392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44851us (45156us total) trans 4294973118 rc 0/0
00000100:00100000:2.0:1789760765.272005:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5831
00000100:00100000:2.0:1789760765.272017:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736877586090 time 736912897591 state 0x2 ref 0
00000100:00100000:2.0:1789760765.277176:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.277276:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521003520
00000100:00100000:0.0:1789760765.277288:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521003520
00000100:00100000:0.0:1789760765.277379:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736877586090 time 736912897591 state 0x0 ref 1
00000100:00100000:0.0:1789760765.277394:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736913158007 time 736912897591 state 0x1 ref 1
00000100:00100000:0.0:1789760765.277470:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736913158007 time 736964151895 state 0x0 ref 1
00000100:00100000:0.0:1789760765.277483:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521003520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760765.277531:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23752704, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:0.0:1789760765.277540:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.277556:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=736s v=(0 0)
00010000:00010000:0.0:1789760765.277573:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760765.277580:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.277595:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760765.315938:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973119 is committed
00002000:00010000:0.0:1789760765.315970:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23752704 -> 23756800
00010000:00010000:0.0:1789760765.315985:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.315998:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.316008:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.316015:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.316021:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.316030:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.316051:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.316058:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d172 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23752704->23756799] (req 23752704->23756799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.317807:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521003520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40314us (41288us total) trans 4294973119 rc 0/0
00000100:00100000:0.0:1789760765.317825:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5832
00000100:00100000:0.0:1789760765.317835:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736913158007 time 736964151895 state 0x2 ref 0
00000100:00100000:0.0:1789760765.321290:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.321449:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521003648
00000100:00100000:3.0:1789760765.321458:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521003648
00000100:00100000:3.0:1789760765.321515:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736913158007 time 736964151895 state 0x0 ref 1
00000100:00100000:3.0:1789760765.321529:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736964412311 time 736964151895 state 0x1 ref 1
00000100:00100000:3.0:1789760765.321570:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736964412311 time 737008242126 state 0x0 ref 1
00000100:00100000:3.0:1789760765.321583:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521003648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.321631:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23756800, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.321640:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.321654:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.321659:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.321676:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.321691:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760765.354332:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973120 is committed
00002000:00010000:3.0:1789760765.354441:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23756800 -> 23760896
00010000:00010000:3.0:1789760765.354459:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.354473:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.354483:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.354490:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760765.354495:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.354504:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.354522:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.354529:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d179 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23756800->23760895] (req 23756800->23760895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760765.354624:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521003648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33039us (33338us total) trans 4294973120 rc 0/0
00000100:00100000:3.0:1789760765.354635:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5833
00000100:00100000:3.0:1789760765.354643:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736964412311 time 737008242126 state 0x2 ref 0
00000100:00100000:0.0:1789760765.357655:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.357731:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521003776
00000100:00100000:3.0:1789760765.357741:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521003776
00000100:00100000:3.0:1789760765.357798:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 736964412311 time 737008242126 state 0x0 ref 1
00000100:00100000:3.0:1789760765.357814:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737008502542 time 737008242126 state 0x1 ref 1
00000100:00100000:3.0:1789760765.357836:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737008502542 time 737044519709 state 0x0 ref 1
00000100:00100000:3.0:1789760765.357848:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521003776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.357895:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23760896, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.357902:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.357918:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.357922:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.357929:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.357942:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760765.389145:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973121 is committed
00002000:00010000:0.0:1789760765.389310:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23760896 -> 23764992
00010000:00010000:0.0:1789760765.389400:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.389413:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.389422:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.389430:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.389435:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.389445:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.389464:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.389471:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d180 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23760896->23764991] (req 23760896->23764991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.389611:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521003776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31760us (31960us total) trans 4294973121 rc 0/0
00000100:00100000:0.0:1789760765.389623:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5834
00000100:00100000:0.0:1789760765.389632:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737008502542 time 737044519709 state 0x2 ref 0
00000100:00100000:2.0:1789760765.393380:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.393450:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521003904
00000100:00100000:3.0:1789760765.393460:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521003904
00000100:00100000:3.0:1789760765.393518:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737008502542 time 737044519709 state 0x0 ref 1
00000100:00100000:3.0:1789760765.393533:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737044780125 time 737044519709 state 0x1 ref 1
00000100:00100000:3.0:1789760765.393619:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737044780125 time 737080300201 state 0x0 ref 1
00000100:00100000:3.0:1789760765.393646:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521003904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.393701:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23764992, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.393710:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.393727:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.393731:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.393738:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.393751:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760765.417381:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973122 is committed
00002000:00010000:0.0:1789760765.417475:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23764992 -> 23769088
00010000:00010000:0.0:1789760765.417491:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.417504:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.417513:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.417520:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.417525:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.417534:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.417552:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.417574:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d187 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23764992->23769087] (req 23764992->23769087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.417730:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521003904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24082us (24356us total) trans 4294973122 rc 0/0
00000100:00100000:0.0:1789760765.417741:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5835
00000100:00100000:0.0:1789760765.417750:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737044780125 time 737080300201 state 0x2 ref 0
00000100:00100000:2.0:1789760765.423790:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.423974:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521004032
00000100:00100000:0.0:1789760765.423985:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521004032
00000100:00100000:0.0:1789760765.424038:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737044780125 time 737080300201 state 0x0 ref 1
00000100:00100000:0.0:1789760765.424053:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737080560617 time 737080300201 state 0x1 ref 1
00000100:00100000:3.0:1789760765.424117:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737080560617 time 737110796557 state 0x0 ref 1
00000100:00100000:3.0:1789760765.424134:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.424179:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23769088, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.424189:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.424407:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.424412:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.424420:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.424440:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760765.466463:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973123 is committed
00002000:00010000:0.0:1789760765.466584:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23769088 -> 23773184
00010000:00010000:0.0:1789760765.466599:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.466612:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.466621:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.466638:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.466643:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.466654:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.466673:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.466682:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d18e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23769088->23773183] (req 23769088->23773183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.466773:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42638us (42987us total) trans 4294973123 rc 0/0
00000100:00100000:0.0:1789760765.466783:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5836
00000100:00100000:0.0:1789760765.466793:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737080560617 time 737110796557 state 0x2 ref 0
00000100:00100000:2.0:1789760765.470591:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.474503:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521004160
00000100:00100000:0.0:1789760765.474519:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521004160
00000100:00100000:3.0:1789760765.474730:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737080560617 time 737110796557 state 0x0 ref 1
00000100:00100000:3.0:1789760765.474747:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737111056973 time 737110796557 state 0x1 ref 1
00000100:00100000:3.0:1789760765.474779:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737111056973 time 737161461909 state 0x0 ref 1
00000100:00100000:3.0:1789760765.474792:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521004160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.474848:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23773184, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.474961:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.474977:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.474981:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.474988:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.475003:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.497723:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760765.517337:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973124 is committed
00002000:00010000:3.0:1789760765.517471:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23773184 -> 23777280
00010000:00010000:3.0:1789760765.517487:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.517500:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.517509:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.517516:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760765.517521:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.517530:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.517548:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.517556:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d195 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23773184->23777279] (req 23773184->23777279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760765.517741:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521004160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42944us (47150us total) trans 4294973124 rc 0/0
00000100:00100000:3.0:1789760765.517752:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5837
00000100:00100000:3.0:1789760765.517761:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737111056973 time 737161461909 state 0x2 ref 0
00000100:00100000:1.0:1789760765.522911:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760765.523063:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521004288
00000100:00100000:2.0:1789760765.523073:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521004288
00000100:00100000:2.0:1789760765.523125:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737111056973 time 737161461909 state 0x0 ref 1
00000100:00100000:2.0:1789760765.523141:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737161722325 time 737161461909 state 0x1 ref 1
00000100:00100000:2.0:1789760765.523171:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737161722325 time 737209854023 state 0x0 ref 1
00000100:00100000:2.0:1789760765.523184:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.523393:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23777280, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.523405:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.523422:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.523428:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.523434:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.523448:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760765.559760:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973125 is committed
00002000:00010000:0.0:1789760765.559844:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23777280 -> 23781376
00010000:00010000:0.0:1789760765.560359:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.560373:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.560383:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.560395:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.560400:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.560409:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.560428:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.560436:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d19c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23777280->23781375] (req 23777280->23781375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.560578:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37391us (37673us total) trans 4294973125 rc 0/0
00000100:00100000:0.0:1789760765.560589:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5838
00000100:00100000:0.0:1789760765.560600:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737161722325 time 737209854023 state 0x2 ref 0
00000100:00100000:1.0:1789760765.561612:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548764160:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760765.561674:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760765.561834:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548764160
00000100:00100000:0.0:1789760765.561842:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548764160
00000100:00100000:0.0:1789760765.561898:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445
00000100:00100000:0.0:1789760765.561906:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548764160:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:0.0:1789760765.561944:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:0.0:1789760765.561985:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548764160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (310us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760765.561995:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445
00000100:00100000:1.0:1789760765.562339:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548764160:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1789760765.564047:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.564239:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521004416
00000100:00100000:0.0:1789760765.564248:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521004416
00000100:00100000:0.0:1789760765.564299:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737161722325 time 737209854023 state 0x0 ref 1
00000100:00100000:0.0:1789760765.564389:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737210114439 time 737209854023 state 0x1 ref 1
00000100:00100000:0.0:1789760765.564420:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737210114439 time 737251102154 state 0x0 ref 1
00000100:00100000:0.0:1789760765.564432:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760765.564480:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23781376, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:0.0:1789760765.564489:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.564504:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:0.0:1789760765.564508:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760765.564519:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.564533:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760765.628502:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23781376 -> 23785472
00010000:00010000:1.0:1789760765.628523:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.628536:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.628547:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.628554:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760765.628567:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.628582:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.628602:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.628609:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d1a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23781376->23785471] (req 23781376->23785471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760765.628703:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521004416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64268us (64657us total) trans 4294973126 rc 0/0
00000100:00100000:1.0:1789760765.628714:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5839
00000100:00100000:1.0:1789760765.628725:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737210114439 time 737251102154 state 0x2 ref 0
00000001:00080000:1.0:1789760765.628766:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973126 is committed
00000100:00100000:2.0:1789760765.636592:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.636679:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521004544
00000100:00100000:3.0:1789760765.636688:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521004544
00000100:00100000:3.0:1789760765.636749:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737210114439 time 737251102154 state 0x0 ref 1
00000100:00100000:3.0:1789760765.636768:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737251362570 time 737251102154 state 0x1 ref 1
00000100:00100000:3.0:1789760765.636803:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737251362570 time 737323485114 state 0x0 ref 1
00000100:00100000:3.0:1789760765.636815:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521004544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.636875:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23785472, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.636884:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.636900:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.636904:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.636911:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.636927:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760765.675396:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973127 is committed
00002000:00010000:1.0:1789760765.675460:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23785472 -> 23789568
00010000:00010000:1.0:1789760765.675475:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.675490:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.675500:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.675514:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760765.675519:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.675529:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.675549:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.675568:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d1aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23785472->23789567] (req 23785472->23789567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760765.675668:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521004544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38850us (39082us total) trans 4294973127 rc 0/0
00000100:00100000:1.0:1789760765.675679:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5840
00000100:00100000:1.0:1789760765.675689:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737251362570 time 737323485114 state 0x2 ref 0
00000100:00100000:0.0:1789760765.681605:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.681752:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521004672
00000100:00100000:3.0:1789760765.681763:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521004672
00000100:00100000:3.0:1789760765.681886:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737251362570 time 737323485114 state 0x0 ref 1
00000100:00100000:3.0:1789760765.681902:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737323745530 time 737323485114 state 0x1 ref 1
00000100:00100000:3.0:1789760765.681980:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737323745530 time 737368661757 state 0x0 ref 1
00000100:00100000:3.0:1789760765.682036:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.682086:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23789568, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.682095:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.682110:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.682114:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.682121:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.682134:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760765.725928:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973128 is committed
00002000:00010000:0.0:1789760765.725944:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23789568 -> 23793664
00010000:00010000:0.0:1789760765.725962:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.725980:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.725988:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.725995:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.726001:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.726009:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.726030:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.726037:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23789568->23793663] (req 23789568->23793663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.726552:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44515us (44951us total) trans 4294973128 rc 0/0
00000100:00100000:0.0:1789760765.726571:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5841
00000100:00100000:0.0:1789760765.726581:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737323745530 time 737368661757 state 0x2 ref 0
00000100:00100000:2.0:1789760765.731214:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.733460:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521004800
00000100:00100000:0.0:1789760765.733476:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521004800
00000100:00100000:0.0:1789760765.733539:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737323745530 time 737368661757 state 0x0 ref 1
00000100:00100000:0.0:1789760765.733555:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737368922173 time 737368661757 state 0x1 ref 1
00000100:00100000:0.0:1789760765.733586:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737368922173 time 737420268973 state 0x0 ref 1
00000100:00100000:0.0:1789760765.733600:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521004800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760765.733650:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23793664, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:0.0:1789760765.733659:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.733675:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:0.0:1789760765.733680:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760765.733686:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.733700:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760765.767533:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973129 is committed
00002000:00010000:0.0:1789760765.767639:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23793664 -> 23797760
00010000:00010000:0.0:1789760765.767655:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.767668:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.767693:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.767701:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.767705:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.767714:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.767733:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.767741:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d1b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23793664->23797759] (req 23793664->23797759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.767835:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521004800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34234us (36627us total) trans 4294973129 rc 0/0
00000100:00100000:0.0:1789760765.767844:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5842
00000100:00100000:0.0:1789760765.767853:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737368922173 time 737420268973 state 0x2 ref 0
00000100:00100000:2.0:1789760765.790019:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760765.792930:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521004928
00000100:00100000:1.0:1789760765.792947:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521004928
00000100:00100000:1.0:1789760765.793019:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737368922173 time 737420268973 state 0x0 ref 1
00000100:00100000:1.0:1789760765.793038:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737420529389 time 737420268973 state 0x1 ref 1
00000100:00100000:1.0:1789760765.793121:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737420529389 time 737479803320 state 0x0 ref 1
00000100:00100000:1.0:1789760765.793134:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760765.793894:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23797760, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:1.0:1789760765.793904:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.793921:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:1.0:1789760765.793924:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760765.793930:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.793943:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760765.841908:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973130 is committed
00002000:00010000:1.0:1789760765.842060:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23797760 -> 23801856
00010000:00010000:1.0:1789760765.842076:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.842090:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.842099:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.842107:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760765.842112:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.842129:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.842149:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.842157:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23797760->23801855] (req 23797760->23801855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760765.842257:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521004928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49121us (52245us total) trans 4294973130 rc 0/0
00000100:00100000:1.0:1789760765.842268:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5843
00000100:00100000:1.0:1789760765.842277:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737420529389 time 737479803320 state 0x2 ref 0
00000100:00100000:1.0:1789760765.847000:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760765.847156:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521005056
00000100:00100000:3.0:1789760765.847165:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521005056
00000100:00100000:3.0:1789760765.847282:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737420529389 time 737479803320 state 0x0 ref 1
00000100:00100000:3.0:1789760765.847297:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737480063736 time 737479803320 state 0x1 ref 1
00000100:00100000:3.0:1789760765.847457:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737480063736 time 737534137680 state 0x0 ref 1
00000100:00100000:3.0:1789760765.847694:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521005056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760765.847810:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23801856, mtime: 0x6aad94fe, atime: 0x0, ctime: 0x6aad94fe, blocks: 0xb807
00010000:00010000:3.0:1789760765.847822:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.847840:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760765.847844:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760765.847850:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760765.847867:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760765.883451:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23801856 -> 23805952
00002000:00010000:1.0:1789760765.883459:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760766 -> 1789760767
00002000:00010000:1.0:1789760765.883463:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760766 -> 1789760767
00010000:00010000:1.0:1789760765.883475:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.883488:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.883502:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.883510:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760765.883516:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.883526:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.883545:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760765.883972:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973131 is committed
00010000:00010000:1.0:1789760765.884017:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d1c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23801856->23805951] (req 23801856->23805951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760765.884152:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521005056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36678us (37158us total) trans 4294973131 rc 0/0
00000100:00100000:1.0:1789760765.884163:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5844
00000100:00100000:1.0:1789760765.884171:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737480063736 time 737534137680 state 0x2 ref 0
00000100:00100000:2.0:1789760765.888928:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.889032:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521005184
00000100:00100000:0.0:1789760765.889041:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521005184
00000100:00100000:0.0:1789760765.889091:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737480063736 time 737534137680 state 0x0 ref 1
00000100:00100000:0.0:1789760765.889167:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737534398096 time 737534137680 state 0x1 ref 1
00000100:00100000:1.0:1789760765.889374:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737534398096 time 737576053163 state 0x0 ref 1
00000100:00100000:1.0:1789760765.889389:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521005184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760765.889438:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23805952, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:1.0:1789760765.889448:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.889463:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:1.0:1789760765.889468:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760765.889474:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.889487:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760765.937302:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23805952 -> 23810048
00010000:00010000:1.0:1789760765.937350:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.937366:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.937377:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.937384:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760765.937389:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.937398:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.937419:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760765.937428:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d1cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23805952->23810047] (req 23805952->23810047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760765.937515:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521005184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48124us (48591us total) trans 4294973132 rc 0/0
00000100:00100000:1.0:1789760765.937526:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5845
00000100:00100000:1.0:1789760765.937535:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737534398096 time 737576053163 state 0x2 ref 0
00000001:00080000:3.0:1789760765.938056:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973132 is committed
00000100:00100000:1.0:1789760765.941576:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760765.942506:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521005312
00000100:00100000:0.0:1789760765.942518:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521005312
00000100:00100000:0.0:1789760765.942883:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737534398096 time 737576053163 state 0x0 ref 1
00000100:00100000:0.0:1789760765.942899:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737576313579 time 737576053163 state 0x1 ref 1
00000100:00100000:0.0:1789760765.942962:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737576313579 time 737629644039 state 0x0 ref 1
00000100:00100000:0.0:1789760765.942976:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521005312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760765.943025:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23810048, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760765.943034:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.943051:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:0.0:1789760765.943055:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760765.943062:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.943075:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760765.990885:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973133 is committed
00002000:00010000:0.0:1789760765.991340:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23810048 -> 23814144
00010000:00010000:0.0:1789760765.991356:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.991368:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.991378:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.991386:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760765.991392:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.991401:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.991419:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760765.991426:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23810048->23814143] (req 23810048->23814143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760765.991510:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521005312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48533us (49938us total) trans 4294973133 rc 0/0
00000100:00100000:0.0:1789760765.991520:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5846
00000100:00100000:0.0:1789760765.991529:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737576313579 time 737629644039 state 0x2 ref 0
00000100:00100000:0.0:1789760765.999823:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760765.999923:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521005440
00000100:00100000:2.0:1789760765.999934:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521005440
00000100:00100000:2.0:1789760765.999986:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737576313579 time 737629644039 state 0x0 ref 1
00000100:00100000:2.0:1789760766.000001:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737629904455 time 737629644039 state 0x1 ref 1
00000100:00100000:2.0:1789760766.000032:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737629904455 time 737686714286 state 0x0 ref 1
00000100:00100000:2.0:1789760766.000044:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521005440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760766.000101:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23814144, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:2.0:1789760766.000111:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.000127:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:2.0:1789760766.000131:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760766.000137:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.000150:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760766.034370:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973134 is committed
00002000:00010000:0.0:1789760766.034726:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23814144 -> 23818240
00010000:00010000:0.0:1789760766.034747:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.034766:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.034774:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.034781:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760766.034795:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.034805:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.034826:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.034833:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d1db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23814144->23818239] (req 23814144->23818239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.034925:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521005440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34878us (35107us total) trans 4294973134 rc 0/0
00000100:00100000:0.0:1789760766.034935:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5847
00000100:00100000:0.0:1789760766.034943:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737629904455 time 737686714286 state 0x2 ref 0
00000100:00100000:3.0:1789760766.039860:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760766.040269:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521005568
00000100:00100000:1.0:1789760766.040280:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521005568
00000100:00100000:1.0:1789760766.040385:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737629904455 time 737686714286 state 0x0 ref 1
00000100:00100000:1.0:1789760766.040402:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737686974702 time 737686714286 state 0x1 ref 1
00000100:00080000:0.0:1789760766.040425:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1789760766.040427:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737686974702 time 737727110211 state 0x0 ref 1
00000100:00100000:1.0:1789760766.040441:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521005568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760766.040494:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23818240, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:1.0:1789760766.040503:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.040527:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:1.0:1789760766.040532:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760766.040539:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.040552:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760766.078596:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973135 is committed
00002000:00010000:0.0:1789760766.078784:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23818240 -> 23822336
00010000:00010000:0.0:1789760766.078799:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.078812:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.078821:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.078829:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760766.078833:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.078842:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.078861:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.078869:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d1e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23818240->23822335] (req 23818240->23822335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.078965:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521005568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38522us (39110us total) trans 4294973135 rc 0/0
00000100:00100000:0.0:1789760766.078975:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5848
00000100:00100000:0.0:1789760766.078984:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737686974702 time 737727110211 state 0x2 ref 0
00000100:00100000:1.0:1789760766.082770:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.082872:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521005696
00000100:00100000:0.0:1789760766.082882:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521005696
00000100:00100000:0.0:1789760766.082939:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737686974702 time 737727110211 state 0x0 ref 1
00000100:00100000:0.0:1789760766.082954:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737727370627 time 737727110211 state 0x1 ref 1
00000100:00100000:0.0:1789760766.082988:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737727370627 time 737769670589 state 0x0 ref 1
00000100:00100000:0.0:1789760766.083001:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521005696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.083052:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23822336, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.083060:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.083075:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:0.0:1789760766.083079:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.083086:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.083099:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760766.119781:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973136 is committed
00002000:00010000:0.0:1789760766.119893:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23822336 -> 23826432
00010000:00010000:0.0:1789760766.119908:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.119920:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.119931:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.119939:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760766.119944:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.119952:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.119972:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.119980:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23822336->23826431] (req 23822336->23826431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.120065:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521005696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37062us (37303us total) trans 4294973136 rc 0/0
00000100:00100000:0.0:1789760766.120076:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5849
00000100:00100000:0.0:1789760766.120094:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737727370627 time 737769670589 state 0x2 ref 0
00000100:00100000:1.0:1789760766.124088:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760766.124233:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521005824
00000100:00100000:3.0:1789760766.124243:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521005824
00000100:00100000:3.0:1789760766.124297:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737727370627 time 737769670589 state 0x0 ref 1
00000100:00100000:3.0:1789760766.124936:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737769931005 time 737769670589 state 0x1 ref 1
00000100:00100000:3.0:1789760766.124970:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737769931005 time 737811652325 state 0x0 ref 1
00000100:00100000:3.0:1789760766.124985:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521005824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760766.125034:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23826432, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:3.0:1789760766.125043:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.125059:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:3.0:1789760766.125063:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760766.125069:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.125083:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760766.153278:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973137 is committed
00002000:00010000:0.0:1789760766.153497:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23826432 -> 23830528
00010000:00010000:0.0:1789760766.153514:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.153530:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.153539:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.153546:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760766.153551:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.153568:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.153588:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.153595:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d1f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23826432->23830527] (req 23826432->23830527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.153710:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521005824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28725us (29627us total) trans 4294973137 rc 0/0
00000100:00100000:0.0:1789760766.153720:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5850
00000100:00100000:0.0:1789760766.153729:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737769931005 time 737811652325 state 0x2 ref 0
00000100:00100000:3.0:1789760766.159506:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760766.159609:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521005952
00000100:00100000:2.0:1789760766.159619:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521005952
00000100:00100000:2.0:1789760766.159670:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737769931005 time 737811652325 state 0x0 ref 1
00000100:00100000:2.0:1789760766.159686:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737811912741 time 737811652325 state 0x1 ref 1
00000100:00100000:2.0:1789760766.159751:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737811912741 time 737846433105 state 0x0 ref 1
00000100:00100000:2.0:1789760766.159764:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521005952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760766.159810:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23830528, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:2.0:1789760766.159819:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.159835:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:2.0:1789760766.159840:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760766.159846:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.160073:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760766.196717:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973138 is committed
00002000:00010000:2.0:1789760766.196802:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23830528 -> 23834624
00010000:00010000:2.0:1789760766.196820:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.196834:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.196842:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.196849:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760766.196853:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.196862:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.196953:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.196961:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d1f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23830528->23834623] (req 23830528->23834623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760766.197099:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521005952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37333us (37598us total) trans 4294973138 rc 0/0
00000100:00100000:2.0:1789760766.197111:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5851
00000100:00100000:2.0:1789760766.197121:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737811912741 time 737846433105 state 0x2 ref 0
00000100:00100000:1.0:1789760766.200822:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.203744:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521006080
00000100:00100000:0.0:1789760766.203759:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521006080
00000100:00100000:0.0:1789760766.203832:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737811912741 time 737846433105 state 0x0 ref 1
00000100:00100000:0.0:1789760766.203852:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737846693521 time 737846433105 state 0x1 ref 1
00000100:00100000:0.0:1789760766.203891:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737846693521 time 737890573289 state 0x0 ref 1
00000100:00100000:0.0:1789760766.203905:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521006080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.203962:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23834624, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.203973:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.203987:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:0.0:1789760766.203993:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.203999:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.204015:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760766.231760:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973139 is committed
00002000:00010000:1.0:1789760766.231844:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23834624 -> 23838720
00010000:00010000:1.0:1789760766.231860:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.231872:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.231882:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.231890:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760766.231894:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.231908:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.231927:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.231935:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d1fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23834624->23838719] (req 23834624->23838719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760766.232058:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521006080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28152us (31242us total) trans 4294973139 rc 0/0
00000100:00100000:1.0:1789760766.232068:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5852
00000100:00100000:1.0:1789760766.232077:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737846693521 time 737890573289 state 0x2 ref 0
00000100:00100000:1.0:1789760766.238873:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.238963:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521006208
00000100:00100000:0.0:1789760766.238974:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521006208
00000100:00100000:0.0:1789760766.239029:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737846693521 time 737890573289 state 0x0 ref 1
00000100:00100000:0.0:1789760766.239045:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737890833705 time 737890573289 state 0x1 ref 1
00000100:00100000:0.0:1789760766.239076:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737890833705 time 737925758164 state 0x0 ref 1
00000100:00100000:0.0:1789760766.239092:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521006208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.239139:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23838720, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.239149:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.239165:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:0.0:1789760766.239169:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.239176:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.239189:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760766.278010:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973140 is committed
00002000:00010000:1.0:1789760766.278171:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23838720 -> 23842816
00010000:00010000:1.0:1789760766.278250:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.278266:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.278274:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.278287:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760766.278292:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.278301:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.278352:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.278360:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d205 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23838720->23842815] (req 23838720->23842815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760766.278446:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521006208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39351us (39576us total) trans 4294973140 rc 0/0
00000100:00100000:1.0:1789760766.278458:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5853
00000100:00100000:1.0:1789760766.278467:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737890833705 time 737925758164 state 0x2 ref 0
00000100:00100000:3.0:1789760766.282179:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.282423:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521006336
00000100:00100000:0.0:1789760766.282433:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521006336
00000100:00100000:0.0:1789760766.282484:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737890833705 time 737925758164 state 0x0 ref 1
00000100:00100000:0.0:1789760766.282499:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737926018580 time 737925758164 state 0x1 ref 1
00000100:00100000:0.0:1789760766.282526:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737926018580 time 737969209127 state 0x0 ref 1
00000100:00100000:0.0:1789760766.282539:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521006336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.282594:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23842816, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.282603:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.282625:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=737s v=(0 0)
00010000:00010000:0.0:1789760766.282629:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.282635:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.282648:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760766.317206:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973141 is committed
00002000:00010000:2.0:1789760766.317524:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23842816 -> 23846912
00010000:00010000:2.0:1789760766.317540:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.317562:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.317573:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.317580:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760766.317585:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.317594:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.317614:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.317628:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d20c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23842816->23846911] (req 23842816->23846911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760766.317889:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521006336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35346us (35713us total) trans 4294973141 rc 0/0
00000100:00100000:2.0:1789760766.317900:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5854
00000100:00100000:2.0:1789760766.317911:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737926018580 time 737969209127 state 0x2 ref 0
00000100:00100000:2.0:1789760766.328151:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.328249:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521006464
00000100:00100000:0.0:1789760766.328260:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521006464
00000100:00100000:0.0:1789760766.328361:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737926018580 time 737969209127 state 0x0 ref 1
00000100:00100000:0.0:1789760766.328376:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737969469543 time 737969209127 state 0x1 ref 1
00000100:00100000:0.0:1789760766.328396:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737969469543 time 738015078946 state 0x0 ref 1
00000100:00100000:0.0:1789760766.328408:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521006464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.328455:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23846912, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.328464:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.328483:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:0.0:1789760766.328487:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.328494:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.328513:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760766.356726:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973142 is committed
00002000:00010000:0.0:1789760766.356820:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23846912 -> 23851008
00010000:00010000:0.0:1789760766.356836:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.356848:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.356857:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.356863:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760766.356868:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.356876:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.356896:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.356903:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d213 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23846912->23851007] (req 23846912->23851007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.357044:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521006464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28634us (28897us total) trans 4294973142 rc 0/0
00000100:00100000:0.0:1789760766.357056:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5855
00000100:00100000:0.0:1789760766.357064:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737969469543 time 738015078946 state 0x2 ref 0
00000100:00100000:1.0:1789760766.361781:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.361853:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521006592
00000100:00100000:0.0:1789760766.361863:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521006592
00000100:00100000:0.0:1789760766.361917:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 737969469543 time 738015078946 state 0x0 ref 1
00000100:00100000:0.0:1789760766.361933:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738015339362 time 738015078946 state 0x1 ref 1
00000100:00100000:0.0:1789760766.361964:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738015339362 time 738048646746 state 0x0 ref 1
00000100:00100000:0.0:1789760766.361976:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521006592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.362023:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23851008, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.362032:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.362047:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:0.0:1789760766.362051:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.362058:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.362071:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760766.403912:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973143 is committed
00002000:00010000:2.0:1789760766.403991:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23851008 -> 23855104
00010000:00010000:2.0:1789760766.404007:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.404020:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.404029:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.404036:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760766.404040:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.404049:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.404072:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.404079:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d21a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23851008->23855103] (req 23851008->23855103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760766.404279:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521006592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42299us (42501us total) trans 4294973143 rc 0/0
00000100:00100000:2.0:1789760766.404289:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5856
00000100:00100000:2.0:1789760766.404299:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738015339362 time 738048646746 state 0x2 ref 0
00000100:00100000:3.0:1789760766.410664:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760766.410783:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521006720
00000100:00100000:1.0:1789760766.410793:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521006720
00000100:00100000:1.0:1789760766.410845:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738015339362 time 738048646746 state 0x0 ref 1
00000100:00100000:1.0:1789760766.410861:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738048907162 time 738048646746 state 0x1 ref 1
00000100:00100000:1.0:1789760766.410894:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738048907162 time 738097575835 state 0x0 ref 1
00000100:00100000:1.0:1789760766.410906:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521006720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760766.410955:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23855104, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:1.0:1789760766.410963:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.410978:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:1.0:1789760766.410982:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760766.410987:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.411001:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760766.439773:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973144 is committed
00002000:00010000:1.0:1789760766.439865:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23855104 -> 23859200
00010000:00010000:1.0:1789760766.439881:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.439894:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.439904:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.439912:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760766.439916:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.439925:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.439945:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.439952:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d221 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23855104->23859199] (req 23855104->23859199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760766.440077:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521006720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29169us (29420us total) trans 4294973144 rc 0/0
00000100:00100000:1.0:1789760766.440097:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5857
00000100:00100000:1.0:1789760766.440107:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738048907162 time 738097575835 state 0x2 ref 0
00000100:00100000:1.0:1789760766.446802:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.447177:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521006848
00000100:00100000:0.0:1789760766.447187:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521006848
00000100:00100000:0.0:1789760766.447243:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738048907162 time 738097575835 state 0x0 ref 1
00000100:00100000:0.0:1789760766.447257:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738097836251 time 738097575835 state 0x1 ref 1
00000100:00100000:0.0:1789760766.447288:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738097836251 time 738133970522 state 0x0 ref 1
00000100:00100000:0.0:1789760766.447299:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521006848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.447363:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23859200, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.447373:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.447389:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:0.0:1789760766.447394:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.447401:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.447414:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760766.514304:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973145 is committed
00002000:00010000:0.0:1789760766.514707:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23859200 -> 23863296
00010000:00010000:0.0:1789760766.514725:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.514743:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.514752:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.514759:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760766.514764:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.514775:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.514792:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.514799:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d228 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23859200->23863295] (req 23859200->23863295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.514886:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521006848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67584us (68089us total) trans 4294973145 rc 0/0
00000100:00100000:0.0:1789760766.514898:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5858
00000100:00100000:0.0:1789760766.514907:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738097836251 time 738133970522 state 0x2 ref 0
00000100:00100000:0.0:1789760766.523697:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760766.523819:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521006976
00000100:00100000:1.0:1789760766.523828:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521006976
00000100:00100000:1.0:1789760766.523880:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738097836251 time 738133970522 state 0x0 ref 1
00000100:00100000:1.0:1789760766.523895:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738134230938 time 738133970522 state 0x1 ref 1
00000100:00100000:1.0:1789760766.523926:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738134230938 time 738210608296 state 0x0 ref 1
00000100:00100000:1.0:1789760766.523939:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521006976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760766.523990:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23863296, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:1.0:1789760766.523999:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.524015:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:1.0:1789760766.524020:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760766.524027:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.524041:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.524536:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1789760766.588295:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548764288:0@lo:41:osp-pre-1-0.0
00000100:00100000:0.0:1789760766.588387:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760766.589361:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548764288
00000100:00100000:1.0:1789760766.589372:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548764288
00000100:00100000:1.0:1789760766.589436:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446
00000100:00100000:1.0:1789760766.589447:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548764288:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1789760766.589492:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:1.0:1789760766.589592:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548764288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (1204us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760766.589600:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446
00000100:00100000:0.0:1789760766.589666:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548764288:0@lo:41:osp-pre-1-0.0
00002000:00010000:1.0:1789760766.598306:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23863296 -> 23867392
00000001:00080000:0.0:1789760766.598359:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973146 is committed
00010000:00010000:1.0:1789760766.598365:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.598380:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.598399:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.598407:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760766.598413:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.598423:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.598441:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.598449:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d22f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23863296->23867391] (req 23863296->23867391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.598775:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521006976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 74831us (75082us total) trans 4294973146 rc 0/0
00000100:00100000:0.0:1789760766.598788:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5859
00000100:00100000:0.0:1789760766.598799:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738134230938 time 738210608296 state 0x2 ref 0
00000100:00100000:3.0:1789760766.608712:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760766.609019:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521007104
00000100:00100000:2.0:1789760766.609270:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521007104
00000100:00100000:2.0:1789760766.609377:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738134230938 time 738210608296 state 0x0 ref 1
00000100:00100000:2.0:1789760766.609395:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738210868712 time 738210608296 state 0x1 ref 1
00000100:00100000:0.0:1789760766.609446:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738210868712 time 738296124489 state 0x0 ref 1
00000100:00100000:0.0:1789760766.609466:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521007104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.609523:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23867392, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.609533:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.609574:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:0.0:1789760766.609578:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.609585:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.609610:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760766.657666:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973147 is committed
00002000:00010000:0.0:1789760766.657814:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23867392 -> 23871488
00010000:00010000:0.0:1789760766.657831:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.657845:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.657855:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.657862:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760766.657867:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.657877:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.657896:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.657904:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d236 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23867392->23871487] (req 23867392->23871487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.658040:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521007104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48574us (49331us total) trans 4294973147 rc 0/0
00000100:00100000:0.0:1789760766.658050:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5860
00000100:00100000:0.0:1789760766.658061:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738210868712 time 738296124489 state 0x2 ref 0
00000100:00100000:1.0:1789760766.661997:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.664761:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521007232
00000100:00100000:0.0:1789760766.664777:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521007232
00000100:00100000:0.0:1789760766.664839:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738210868712 time 738296124489 state 0x0 ref 1
00000100:00100000:0.0:1789760766.664855:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738296384905 time 738296124489 state 0x1 ref 1
00000100:00100000:0.0:1789760766.664890:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738296384905 time 738351572773 state 0x0 ref 1
00000100:00100000:0.0:1789760766.664903:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521007232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760766.664950:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23871488, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:0.0:1789760766.664959:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.664975:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:0.0:1789760766.664979:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760766.664985:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.664999:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760766.708267:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973148 is committed
00002000:00010000:1.0:1789760766.708374:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23871488 -> 23875584
00010000:00010000:1.0:1789760766.708389:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.708403:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.708412:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.708420:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760766.708425:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.708433:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.708456:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.708464:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d23d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23871488->23875583] (req 23871488->23875583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760766.708570:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521007232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43664us (46579us total) trans 4294973148 rc 0/0
00000100:00100000:1.0:1789760766.708582:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5861
00000100:00100000:1.0:1789760766.708600:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738296384905 time 738351572773 state 0x2 ref 0
00000100:00100000:0.0:1789760766.712847:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760766.712952:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521007360
00000100:00100000:3.0:1789760766.712963:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521007360
00000100:00100000:3.0:1789760766.713019:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738296384905 time 738351572773 state 0x0 ref 1
00000100:00100000:3.0:1789760766.713034:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738351833189 time 738351572773 state 0x1 ref 1
00000100:00100000:3.0:1789760766.713100:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738351833189 time 738399781476 state 0x0 ref 1
00000100:00100000:3.0:1789760766.713112:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521007360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760766.713162:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23875584, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:3.0:1789760766.713172:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.713198:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:3.0:1789760766.713203:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760766.713210:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.713224:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760766.764058:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973149 is committed
00002000:00010000:0.0:1789760766.764495:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23875584 -> 23879680
00010000:00010000:0.0:1789760766.764512:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.764523:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.764534:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.764540:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760766.764544:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.764681:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.764701:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760766.764708:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d244 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23875584->23879679] (req 23875584->23879679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760766.764850:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521007360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51735us (52011us total) trans 4294973149 rc 0/0
00000100:00100000:0.0:1789760766.764861:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5862
00000100:00100000:0.0:1789760766.764871:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738351833189 time 738399781476 state 0x2 ref 0
00000100:00100000:2.0:1789760766.769791:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.769909:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521007488
00000100:00100000:0.0:1789760766.769920:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521007488
00000100:00100000:0.0:1789760766.769978:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738351833189 time 738399781476 state 0x0 ref 1
00000100:00100000:0.0:1789760766.769994:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738400041892 time 738399781476 state 0x1 ref 1
00000100:00100000:1.0:1789760766.770074:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738400041892 time 738456753530 state 0x0 ref 1
00000100:00100000:1.0:1789760766.770472:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521007488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760766.770519:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23879680, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:1.0:1789760766.770529:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.770545:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:1.0:1789760766.770672:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760766.770682:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.770699:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760766.813519:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760766.813676:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521007744
00000100:00100000:2.0:1789760766.813686:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521007744
00000100:00100000:2.0:1789760766.813752:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 923
00000100:00100000:2.0:1789760766.813763:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699521007744:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760766.813838:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699521007744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 77us (327us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760766.813845:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 923
00000100:00080000:2.0:1789760766.813865:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789760766.814701:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.814751:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521008000
00000100:00100000:0.0:1789760766.814758:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521008000
00000100:00100000:0.0:1789760766.814813:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 924
00000100:00100000:0.0:1789760766.814822:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699521008000:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760766.814864:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699521008000:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 44us (1292us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760766.814871:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 924
00000100:00100000:1.0:1789760766.815105:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760766.815139:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760766.815171:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.815335:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521007872
00000100:00100000:2.0:1789760766.815335:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521007616
00000100:00100000:0.0:1789760766.815340:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521007872
00000100:00100000:2.0:1789760766.815340:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521007616
00000100:00100000:2.0:1789760766.815366:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 480
00000100:00100000:0.0:1789760766.815370:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 925
00000100:00100000:2.0:1789760766.815373:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699521007616:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760766.815376:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521007872:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760766.815432:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521008128
00000100:00100000:1.0:1789760766.815436:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521008128
00000100:00100000:1.0:1789760766.815466:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 926
00000100:00100000:1.0:1789760766.815472:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699521008128:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760766.815520:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699521007616:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 146us (415us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760766.815527:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 480
00000100:00080000:3.0:1789760766.815796:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1789760766.815800:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00002000:00010000:3.0:1789760766.821487:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23879680 -> 23883776
00010000:00010000:3.0:1789760766.821506:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.821519:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.821529:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.821536:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760766.821541:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.821562:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.821591:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.821599:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d24b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23879680->23883775] (req 23879680->23883775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760766.822458:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521007488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51985us (52670us total) trans 4294973150 rc 0/0
00000100:00100000:3.0:1789760766.822470:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5863
00000100:00100000:3.0:1789760766.822479:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738400041892 time 738456753530 state 0x2 ref 0
00000100:00100000:1.0:1789760766.822567:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699521008128:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 7092us (7393us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760766.822585:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 926
00000001:00080000:1.0:1789760766.822618:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973150 is committed
00000100:00100000:0.0:1789760766.822760:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521007872:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 7381us (7618us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760766.822768:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 925
00000100:00100000:2.0:1789760766.826271:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760766.826407:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521008256
00000100:00100000:0.0:1789760766.826418:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521008256
00000100:00100000:1.0:1789760766.826520:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738400041892 time 738456753530 state 0x0 ref 1
00000100:00100000:1.0:1789760766.826536:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738457013946 time 738456753530 state 0x1 ref 1
00000100:00100000:1.0:1789760766.826674:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738457013946 time 738513254761 state 0x0 ref 1
00000100:00100000:1.0:1789760766.826690:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760766.826738:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23883776, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:1.0:1789760766.826747:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.826764:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:1.0:1789760766.826769:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760766.826776:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.826790:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760766.871526:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973151 is committed
00002000:00010000:2.0:1789760766.871640:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23883776 -> 23887872
00010000:00010000:2.0:1789760766.871656:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.871669:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.871678:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.871686:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760766.871690:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.871700:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.871720:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.871728:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d252 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23883776->23887871] (req 23883776->23887871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760766.871826:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45131us (45554us total) trans 4294973151 rc 0/0
00000100:00100000:2.0:1789760766.871836:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5864
00000100:00100000:2.0:1789760766.871845:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738457013946 time 738513254761 state 0x2 ref 0
00000100:00100000:2.0:1789760766.876444:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760766.876756:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521008384
00000100:00100000:1.0:1789760766.876768:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521008384
00000100:00100000:1.0:1789760766.876823:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738457013946 time 738513254761 state 0x0 ref 1
00000100:00100000:1.0:1789760766.876837:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738513515177 time 738513254761 state 0x1 ref 1
00000100:00100000:1.0:1789760766.876869:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738513515177 time 738563552089 state 0x0 ref 1
00000100:00100000:1.0:1789760766.876881:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760766.876928:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23887872, mtime: 0x6aad94ff, atime: 0x0, ctime: 0x6aad94ff, blocks: 0xb807
00010000:00010000:1.0:1789760766.876938:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.876955:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:1.0:1789760766.876960:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760766.876967:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.876986:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760766.915810:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23887872 -> 23891968
00000001:00080000:3.0:1789760766.915933:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973152 is committed
00002000:00010000:1.0:1789760766.916890:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760767 -> 1789760768
00002000:00010000:1.0:1789760766.916894:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760767 -> 1789760768
00010000:00010000:1.0:1789760766.916910:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.916922:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.916932:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.916939:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760766.916944:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.916954:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.916973:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760766.916980:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d259 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23887872->23891967] (req 23887872->23891967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760766.917075:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40192us (40638us total) trans 4294973152 rc 0/0
00000100:00100000:1.0:1789760766.917086:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5865
00000100:00100000:1.0:1789760766.917096:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738513515177 time 738563552089 state 0x2 ref 0
00000100:00100000:1.0:1789760766.921382:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760766.921647:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521008512
00000100:00100000:3.0:1789760766.921657:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521008512
00000100:00100000:3.0:1789760766.921708:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738513515177 time 738563552089 state 0x0 ref 1
00000100:00100000:3.0:1789760766.921727:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738563812505 time 738563552089 state 0x1 ref 1
00000100:00100000:3.0:1789760766.921760:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738563812505 time 738608442220 state 0x0 ref 1
00000100:00100000:3.0:1789760766.921772:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760766.921819:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23891968, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:3.0:1789760766.921828:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.921844:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:3.0:1789760766.921848:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760766.921855:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.921868:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760766.990912:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973153 is committed
00002000:00010000:2.0:1789760766.991397:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23891968 -> 23896064
00010000:00010000:2.0:1789760766.991414:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.991428:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.991437:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.991445:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760766.991450:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.991459:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.991483:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760766.991491:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d260 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23891968->23896063] (req 23891968->23896063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760766.991677:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 69902us (70299us total) trans 4294973153 rc 0/0
00000100:00100000:2.0:1789760766.991689:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5866
00000100:00100000:2.0:1789760766.991699:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738563812505 time 738608442220 state 0x2 ref 0
00000100:00100000:2.0:1789760766.995490:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760766.995561:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521008640
00000100:00100000:3.0:1789760766.995571:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521008640
00000100:00100000:3.0:1789760766.995624:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738563812505 time 738608442220 state 0x0 ref 1
00000100:00100000:3.0:1789760766.995639:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738608702636 time 738608442220 state 0x1 ref 1
00000100:00100000:3.0:1789760766.995665:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738608702636 time 738682347331 state 0x0 ref 1
00000100:00100000:3.0:1789760766.995679:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760766.995731:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23896064, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:3.0:1789760766.995740:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.995756:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:3.0:1789760766.995761:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760766.995767:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760766.995781:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760767.036108:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973154 is committed
00002000:00010000:2.0:1789760767.036211:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23896064 -> 23900160
00010000:00010000:2.0:1789760767.036228:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.036242:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.036252:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.036260:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760767.036265:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.036280:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.036299:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.036307:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d267 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23896064->23900159] (req 23896064->23900159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760767.036413:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40734us (40929us total) trans 4294973154 rc 0/0
00000100:00100000:2.0:1789760767.036424:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5867
00000100:00100000:2.0:1789760767.036434:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738608702636 time 738682347331 state 0x2 ref 0
00000100:00100000:0.0:1789760767.045681:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760767.045866:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521008768
00000100:00100000:2.0:1789760767.045878:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521008768
00000100:00100000:2.0:1789760767.045945:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738608702636 time 738682347331 state 0x0 ref 1
00000100:00100000:2.0:1789760767.045962:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738682607747 time 738682347331 state 0x1 ref 1
00000100:00100000:2.0:1789760767.045997:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738682607747 time 738732679255 state 0x0 ref 1
00000100:00100000:2.0:1789760767.046011:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760767.046063:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23900160, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:2.0:1789760767.046073:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.046090:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:2.0:1789760767.046094:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760767.046100:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.046114:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760767.088581:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973155 is committed
00002000:00010000:2.0:1789760767.088714:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23900160 -> 23904256
00010000:00010000:2.0:1789760767.088731:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.088746:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.088755:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.088762:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760767.088767:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.088775:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.088795:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.088803:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d26e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23900160->23904255] (req 23900160->23904255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760767.088895:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521008768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42883us (43221us total) trans 4294973155 rc 0/0
00000100:00100000:2.0:1789760767.088905:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5868
00000100:00100000:2.0:1789760767.088914:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738682607747 time 738732679255 state 0x2 ref 0
00000100:00100000:1.0:1789760767.093964:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760767.094107:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521008896
00000100:00100000:0.0:1789760767.094119:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521008896
00000100:00100000:0.0:1789760767.094176:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738682607747 time 738732679255 state 0x0 ref 1
00000100:00100000:0.0:1789760767.094192:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738732939671 time 738732679255 state 0x1 ref 1
00000100:00100000:0.0:1789760767.094263:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738732939671 time 738780944074 state 0x0 ref 1
00000100:00100000:0.0:1789760767.094277:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521008896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760767.094351:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23904256, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:0.0:1789760767.094361:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.094378:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:0.0:1789760767.094386:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760767.094392:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.094407:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760767.097539:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548764416:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1789760767.097629:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760767.097705:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548764416
00000100:00100000:0.0:1789760767.097714:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548764416
00000100:00100000:0.0:1789760767.097763:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378
00000100:00100000:0.0:1789760767.097772:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548764416:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1789760767.097795:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527499264 pending 1703936 free 3834642432 avail 3794796544
00000100:00100000:0.0:1789760767.097837:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548764416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (207us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760767.097845:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378
00000100:00080000:0.0:1789760767.097864:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760767.097895:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548764416:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1789760767.097998:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1789760767.098008:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd85005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548764544:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1789760767.098037:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760767.098068:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548764544
00000100:00100000:1.0:1789760767.098072:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548764544
00000100:00100000:1.0:1789760767.098098:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379
00000100:00100000:1.0:1789760767.098105:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548764544:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1789760767.098117:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527499264 pending 1703936 free 3834642432 avail 3794796544
00000100:00100000:1.0:1789760767.098146:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548764544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (107us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760767.098153:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379
00000100:00100000:1.0:1789760767.098179:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd85005880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548764544:0@lo:13:osp-pre-0-1.0
00000100:00080000:0.0:1789760767.098472:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00010000:1.0:1789760767.140994:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23904256 -> 23908352
00010000:00010000:1.0:1789760767.141015:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.141028:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.141038:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.141045:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760767.141049:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.141058:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.141089:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.141097:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d275 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23904256->23908351] (req 23904256->23908351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760767.141186:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521008896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46907us (47232us total) trans 4294973156 rc 0/0
00000100:00100000:1.0:1789760767.141197:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5869
00000100:00100000:1.0:1789760767.141208:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738732939671 time 738780944074 state 0x2 ref 0
00000001:00080000:1.0:1789760767.141245:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973156 is committed
00000100:00100000:1.0:1789760767.147472:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760767.147569:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521009024
00000100:00100000:3.0:1789760767.147578:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521009024
00000100:00100000:3.0:1789760767.147644:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738732939671 time 738780944074 state 0x0 ref 1
00000100:00100000:3.0:1789760767.147661:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738781204490 time 738780944074 state 0x1 ref 1
00000100:00100000:3.0:1789760767.147693:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738781204490 time 738834375344 state 0x0 ref 1
00000100:00100000:3.0:1789760767.147706:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521009024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760767.147759:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23908352, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:3.0:1789760767.147769:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.147785:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:3.0:1789760767.147790:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760767.147797:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.147810:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760767.218542:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973157 is committed
00002000:00010000:1.0:1789760767.218677:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23908352 -> 23912448
00010000:00010000:1.0:1789760767.218691:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.218705:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.218714:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.218721:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760767.218726:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.218735:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.218753:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.218761:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d27c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23908352->23912447] (req 23908352->23912447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760767.218845:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521009024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 71139us (71381us total) trans 4294973157 rc 0/0
00000100:00100000:1.0:1789760767.218853:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5870
00000100:00100000:1.0:1789760767.218860:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738781204490 time 738834375344 state 0x2 ref 0
00000100:00100000:0.0:1789760767.222073:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760767.222173:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521009152
00000100:00100000:2.0:1789760767.222183:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521009152
00000100:00100000:2.0:1789760767.222237:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738781204490 time 738834375344 state 0x0 ref 1
00000100:00100000:2.0:1789760767.222252:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738834635760 time 738834375344 state 0x1 ref 1
00000100:00100000:2.0:1789760767.222350:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738834635760 time 738909031982 state 0x0 ref 1
00000100:00100000:2.0:1789760767.222364:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521009152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760767.222413:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23912448, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:2.0:1789760767.222423:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.222439:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:2.0:1789760767.222443:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760767.222450:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.222463:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760767.247337:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23912448 -> 23916544
00010000:00010000:2.0:1789760767.247359:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.247373:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.247382:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.247389:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760767.247394:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.247403:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.247424:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.247431:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d283 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23912448->23916543] (req 23912448->23916543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760767.247532:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521009152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25166us (25465us total) trans 4294973158 rc 0/0
00000100:00100000:2.0:1789760767.247543:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5871
00000100:00100000:2.0:1789760767.247564:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738834635760 time 738909031982 state 0x2 ref 0
00000001:00080000:3.0:1789760767.248970:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973158 is committed
00000100:00100000:2.0:1789760767.251648:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760767.252296:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521009280
00000100:00100000:1.0:1789760767.252428:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521009280
00000100:00100000:0.0:1789760767.252566:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738834635760 time 738909031982 state 0x0 ref 1
00000100:00100000:0.0:1789760767.252582:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738909292398 time 738909031982 state 0x1 ref 1
00000100:00100000:0.0:1789760767.252614:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738909292398 time 738939296415 state 0x0 ref 1
00000100:00100000:0.0:1789760767.252627:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521009280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760767.252673:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23916544, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:0.0:1789760767.252682:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.252699:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:0.0:1789760767.252702:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760767.252709:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.252722:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760767.277763:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23916544 -> 23920640
00010000:00010000:1.0:1789760767.277784:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.277798:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.277807:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.277813:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760767.277818:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.277827:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.277844:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.277857:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d28a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23916544->23920639] (req 23916544->23920639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760767.277952:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521009280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25322us (26307us total) trans 4294973159 rc 0/0
00000100:00100000:1.0:1789760767.277962:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5872
00000100:00100000:1.0:1789760767.277971:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738909292398 time 738939296415 state 0x2 ref 0
00000001:00080000:3.0:1789760767.278392:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973159 is committed
00000100:00100000:1.0:1789760767.284848:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760767.284947:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521009408
00000100:00100000:0.0:1789760767.284959:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521009408
00000100:00100000:0.0:1789760767.285019:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738909292398 time 738939296415 state 0x0 ref 1
00000100:00100000:0.0:1789760767.285035:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738939556831 time 738939296415 state 0x1 ref 1
00000100:00100000:0.0:1789760767.285068:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738939556831 time 738971750679 state 0x0 ref 1
00000100:00100000:0.0:1789760767.285094:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521009408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760767.285144:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23920640, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:0.0:1789760767.285153:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.285168:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=738s v=(0 0)
00010000:00010000:0.0:1789760767.285173:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760767.285180:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.285193:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760767.315886:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23920640 -> 23924736
00010000:00010000:1.0:1789760767.315905:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.315919:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.315929:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.315937:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760767.315942:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.315951:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.315976:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.315984:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d291 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23920640->23924735] (req 23920640->23924735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760767.316069:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521009408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30974us (31226us total) trans 4294973160 rc 0/0
00000100:00100000:1.0:1789760767.316086:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5873
00000100:00100000:1.0:1789760767.316096:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738939556831 time 738971750679 state 0x2 ref 0
00000001:00080000:3.0:1789760767.320976:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973160 is committed
00000100:00100000:0.0:1789760767.321812:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760767.321885:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521009536
00000100:00100000:1.0:1789760767.321894:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521009536
00000100:00100000:1.0:1789760767.321943:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738939556831 time 738971750679 state 0x0 ref 1
00000100:00100000:1.0:1789760767.321957:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738972011095 time 738971750679 state 0x1 ref 1
00000100:00100000:1.0:1789760767.321985:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738972011095 time 739008668136 state 0x0 ref 1
00000100:00100000:1.0:1789760767.321996:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521009536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760767.322038:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23924736, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:1.0:1789760767.322047:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.322061:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:1.0:1789760767.322065:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760767.322071:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.322095:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760767.359463:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23924736 -> 23928832
00010000:00010000:3.0:1789760767.359484:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.359497:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.359508:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.359516:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760767.359521:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.359529:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.359557:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.359567:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d298 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23924736->23928831] (req 23924736->23928831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760767.359659:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521009536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37657us (37846us total) trans 4294973161 rc 0/0
00000100:00100000:3.0:1789760767.359670:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5874
00000100:00100000:3.0:1789760767.359680:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738972011095 time 739008668136 state 0x2 ref 0
00000001:00080000:0.0:1789760767.362027:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973161 is committed
00000100:00100000:0.0:1789760767.362750:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760767.362838:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521009664
00000100:00100000:2.0:1789760767.362848:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521009664
00000100:00100000:2.0:1789760767.362899:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 738972011095 time 739008668136 state 0x0 ref 1
00000100:00100000:2.0:1789760767.362914:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739008928552 time 739008668136 state 0x1 ref 1
00000100:00100000:2.0:1789760767.362999:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739008928552 time 739049679577 state 0x0 ref 1
00000100:00100000:2.0:1789760767.363013:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521009664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760767.363060:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23928832, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:2.0:1789760767.363069:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.363091:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:2.0:1789760767.363096:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760767.363102:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.363116:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760767.388010:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973162 is committed
00002000:00010000:1.0:1789760767.388163:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23928832 -> 23932928
00010000:00010000:1.0:1789760767.388177:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.388190:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.388199:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.388206:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760767.388212:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.388221:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.388240:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.388248:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d29f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23928832->23932927] (req 23928832->23932927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760767.388375:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521009664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25360us (25625us total) trans 4294973162 rc 0/0
00000100:00100000:1.0:1789760767.388386:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5875
00000100:00100000:1.0:1789760767.388395:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739008928552 time 739049679577 state 0x2 ref 0
00000100:00100000:1.0:1789760767.392247:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760767.392359:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521009792
00000100:00100000:0.0:1789760767.392370:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521009792
00000100:00100000:0.0:1789760767.392426:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739008928552 time 739049679577 state 0x0 ref 1
00000100:00100000:0.0:1789760767.392441:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739049939993 time 739049679577 state 0x1 ref 1
00000100:00100000:0.0:1789760767.392473:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739049939993 time 739079155704 state 0x0 ref 1
00000100:00100000:0.0:1789760767.392485:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521009792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760767.392532:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23932928, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:0.0:1789760767.392542:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.392566:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:0.0:1789760767.392571:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760767.392578:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.392592:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760767.430410:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973163 is committed
00002000:00010000:1.0:1789760767.430518:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23932928 -> 23937024
00010000:00010000:1.0:1789760767.430533:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.430555:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.430565:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.430573:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760767.430579:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.430589:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.430610:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.430625:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d2a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23932928->23937023] (req 23932928->23937023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760767.430726:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521009792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38238us (38484us total) trans 4294973163 rc 0/0
00000100:00100000:1.0:1789760767.430738:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5876
00000100:00100000:1.0:1789760767.430748:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739049939993 time 739079155704 state 0x2 ref 0
00000100:00100000:1.0:1789760767.434236:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760767.434414:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521009920
00000100:00100000:0.0:1789760767.434424:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521009920
00000100:00100000:0.0:1789760767.434481:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739049939993 time 739079155704 state 0x0 ref 1
00000100:00100000:0.0:1789760767.434496:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739079416120 time 739079155704 state 0x1 ref 1
00000100:00100000:0.0:1789760767.434563:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739079416120 time 739121244569 state 0x0 ref 1
00000100:00100000:0.0:1789760767.434576:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521009920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760767.434625:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23937024, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:0.0:1789760767.434634:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.434649:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:0.0:1789760767.434654:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760767.434660:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.434675:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760767.488063:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973164 is committed
00002000:00010000:1.0:1789760767.488367:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23937024 -> 23941120
00010000:00010000:1.0:1789760767.488381:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.488394:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.488404:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.488411:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760767.488416:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.488426:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.488449:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.488456:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23937024->23941119] (req 23937024->23941119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760767.489524:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521009920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53953us (54361us total) trans 4294973164 rc 0/0
00000100:00100000:1.0:1789760767.489604:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5877
00000100:00100000:1.0:1789760767.489613:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739079416120 time 739121244569 state 0x2 ref 0
00000100:00100000:2.0:1789760767.491419:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760767.491489:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521010048
00000100:00100000:3.0:1789760767.491497:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521010048
00000100:00100000:3.0:1789760767.491558:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739079416120 time 739121244569 state 0x0 ref 1
00000100:00100000:3.0:1789760767.491572:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739121504985 time 739121244569 state 0x1 ref 1
00000100:00100000:3.0:1789760767.491594:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739121504985 time 739178276613 state 0x0 ref 1
00000100:00100000:3.0:1789760767.491605:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521010048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760767.491648:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23941120, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:3.0:1789760767.491656:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.491671:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:3.0:1789760767.491676:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760767.491682:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.491696:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760767.525743:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23941120 -> 23945216
00010000:00010000:3.0:1789760767.525764:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.525779:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.525788:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.525796:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760767.525801:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.525810:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.525830:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.525837:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23941120->23945215] (req 23941120->23945215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760767.525946:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521010048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34337us (34528us total) trans 4294973165 rc 0/0
00000100:00100000:3.0:1789760767.525956:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5878
00000100:00100000:3.0:1789760767.525964:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739121504985 time 739178276613 state 0x2 ref 0
00000001:00080000:3.0:1789760767.525999:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973165 is committed
00000100:00100000:0.0:1789760767.530007:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760767.530128:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521010176
00000100:00100000:1.0:1789760767.530138:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521010176
00000100:00100000:1.0:1789760767.530197:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739121504985 time 739178276613 state 0x0 ref 1
00000100:00100000:1.0:1789760767.530212:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739178537029 time 739178276613 state 0x1 ref 1
00000100:00100000:1.0:1789760767.530280:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739178537029 time 739216962736 state 0x0 ref 1
00000100:00100000:1.0:1789760767.530293:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521010176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760767.530380:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23945216, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:1.0:1789760767.530389:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.530404:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:1.0:1789760767.530409:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760767.530415:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.530428:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.545830:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760767.559516:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973166 is committed
00002000:00010000:3.0:1789760767.559733:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23945216 -> 23949312
00010000:00010000:3.0:1789760767.559751:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.559764:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.559774:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.559782:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760767.559787:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.559796:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.559814:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.559828:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d2bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23945216->23949311] (req 23945216->23949311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760767.560024:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521010176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29729us (30022us total) trans 4294973166 rc 0/0
00000100:00100000:3.0:1789760767.560036:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5879
00000100:00100000:3.0:1789760767.560046:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739178537029 time 739216962736 state 0x2 ref 0
00000100:00100000:2.0:1789760767.565400:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760767.565937:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521010304
00000100:00100000:1.0:1789760767.565948:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521010304
00000100:00100000:1.0:1789760767.565999:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739178537029 time 739216962736 state 0x0 ref 1
00000100:00100000:1.0:1789760767.566014:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739217223152 time 739216962736 state 0x1 ref 1
00000100:00100000:1.0:1789760767.566079:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739217223152 time 739252755484 state 0x0 ref 1
00000100:00100000:1.0:1789760767.566091:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521010304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760767.566133:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23949312, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:1.0:1789760767.566142:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.566157:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:1.0:1789760767.566161:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760767.566167:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.566190:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760767.615292:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973167 is committed
00002000:00010000:1.0:1789760767.616787:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23949312 -> 23953408
00010000:00010000:1.0:1789760767.616807:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.616820:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.616828:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.616836:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760767.616840:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.616849:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.616868:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.616882:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23949312->23953407] (req 23949312->23953407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760767.617033:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521010304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50938us (51636us total) trans 4294973167 rc 0/0
00000100:00100000:1.0:1789760767.617048:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5880
00000100:00100000:1.0:1789760767.617058:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739217223152 time 739252755484 state 0x2 ref 0
00000100:00100000:2.0:1789760767.624753:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760767.624860:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521010432
00000100:00100000:0.0:1789760767.624870:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521010432
00000100:00100000:0.0:1789760767.624920:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739217223152 time 739252755484 state 0x0 ref 1
00000100:00100000:0.0:1789760767.624935:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739253015900 time 739252755484 state 0x1 ref 1
00000100:00100000:0.0:1789760767.625007:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739253015900 time 739311689250 state 0x0 ref 1
00000100:00100000:0.0:1789760767.625020:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521010432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760767.625066:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23953408, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:0.0:1789760767.625076:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.625091:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:0.0:1789760767.625095:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760767.625102:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.625115:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760767.672573:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973168 is committed
00002000:00010000:0.0:1789760767.672686:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23953408 -> 23957504
00010000:00010000:0.0:1789760767.672703:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.672716:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.672725:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.672732:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760767.672737:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.672746:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.672766:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.672772:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d2c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23953408->23957503] (req 23953408->23957503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760767.672865:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521010432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47842us (48117us total) trans 4294973168 rc 0/0
00000100:00100000:0.0:1789760767.672880:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5881
00000100:00100000:0.0:1789760767.672889:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739253015900 time 739311689250 state 0x2 ref 0
00000100:00100000:0.0:1789760767.677970:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760767.678063:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521010560
00000100:00100000:3.0:1789760767.678073:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521010560
00000100:00100000:3.0:1789760767.678128:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739253015900 time 739311689250 state 0x0 ref 1
00000100:00100000:3.0:1789760767.678142:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739311949666 time 739311689250 state 0x1 ref 1
00000100:00100000:3.0:1789760767.678172:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739311949666 time 739364855632 state 0x0 ref 1
00000100:00100000:3.0:1789760767.678185:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521010560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760767.678233:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23957504, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:3.0:1789760767.678242:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.678258:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:3.0:1789760767.678262:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760767.678269:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.678289:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760767.723575:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973169 is committed
00002000:00010000:3.0:1789760767.723866:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23957504 -> 23961600
00010000:00010000:3.0:1789760767.723882:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.723894:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.723903:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.723910:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760767.723915:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.723925:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.723944:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.723950:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23957504->23961599] (req 23957504->23961599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760767.724086:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521010560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45889us (46111us total) trans 4294973169 rc 0/0
00000100:00100000:3.0:1789760767.724096:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5882
00000100:00100000:3.0:1789760767.724105:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739311949666 time 739364855632 state 0x2 ref 0
00000100:00100000:2.0:1789760767.727476:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760767.727564:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521010688
00000100:00100000:3.0:1789760767.727574:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521010688
00000100:00100000:3.0:1789760767.727626:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739311949666 time 739364855632 state 0x0 ref 1
00000100:00100000:3.0:1789760767.727647:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739365116048 time 739364855632 state 0x1 ref 1
00000100:00100000:3.0:1789760767.727678:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739365116048 time 739414359614 state 0x0 ref 1
00000100:00100000:3.0:1789760767.727690:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521010688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760767.727739:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23961600, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:3.0:1789760767.727749:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.727770:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:3.0:1789760767.727775:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760767.727781:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.727796:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760767.756392:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973170 is committed
00002000:00010000:2.0:1789760767.756709:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23961600 -> 23965696
00010000:00010000:2.0:1789760767.756725:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.756737:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.756747:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.756754:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760767.756759:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.756768:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.756792:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.756799:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d2d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23961600->23965695] (req 23961600->23965695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760767.756921:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521010688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29229us (29454us total) trans 4294973170 rc 0/0
00000100:00100000:2.0:1789760767.756933:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5883
00000100:00100000:2.0:1789760767.756943:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739365116048 time 739414359614 state 0x2 ref 0
00000100:00100000:0.0:1789760767.767825:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760767.770451:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521010816
00000100:00100000:1.0:1789760767.770467:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521010816
00000100:00100000:2.0:1789760767.770649:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739365116048 time 739414359614 state 0x0 ref 1
00000100:00100000:2.0:1789760767.770665:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739414620030 time 739414359614 state 0x1 ref 1
00000100:00100000:2.0:1789760767.770740:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739414620030 time 739457422919 state 0x0 ref 1
00000100:00100000:2.0:1789760767.770754:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521010816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760767.770804:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23965696, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:2.0:1789760767.770814:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.770831:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:2.0:1789760767.770836:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760767.770843:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.770857:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760767.815421:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973171 is committed
00002000:00010000:3.0:1789760767.815523:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23965696 -> 23969792
00010000:00010000:3.0:1789760767.815540:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.815561:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.815570:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.815578:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760767.815583:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.815591:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.815610:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.815617:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d2de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23965696->23969791] (req 23965696->23969791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760767.815707:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521010816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44952us (47888us total) trans 4294973171 rc 0/0
00000100:00100000:3.0:1789760767.815717:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5884
00000100:00100000:3.0:1789760767.815727:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739414620030 time 739457422919 state 0x2 ref 0
00000100:00100000:0.0:1789760767.824099:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760767.824212:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521010944
00000100:00100000:1.0:1789760767.824221:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521010944
00000100:00100000:1.0:1789760767.824274:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739414620030 time 739457422919 state 0x0 ref 1
00000100:00100000:1.0:1789760767.824289:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739457683335 time 739457422919 state 0x1 ref 1
00000100:00100000:1.0:1789760767.824357:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739457683335 time 739511039131 state 0x0 ref 1
00000100:00100000:1.0:1789760767.824371:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521010944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760767.824422:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23969792, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:1.0:1789760767.824432:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.824448:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:1.0:1789760767.824452:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760767.824458:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.824472:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760767.869702:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973172 is committed
00002000:00010000:2.0:1789760767.869928:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23969792 -> 23973888
00010000:00010000:2.0:1789760767.869944:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.869958:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.869967:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.869975:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760767.869980:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.869988:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.870007:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.870015:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d2e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23969792->23973887] (req 23969792->23973887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760767.870125:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521010944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45750us (46028us total) trans 4294973172 rc 0/0
00000100:00100000:2.0:1789760767.870135:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5885
00000100:00100000:2.0:1789760767.870145:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739457683335 time 739511039131 state 0x2 ref 0
00000100:00100000:2.0:1789760767.873873:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760767.873985:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521011072
00000100:00100000:0.0:1789760767.873994:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521011072
00000100:00100000:0.0:1789760767.874044:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739457683335 time 739511039131 state 0x0 ref 1
00000100:00100000:0.0:1789760767.874058:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739511299547 time 739511039131 state 0x1 ref 1
00000100:00100000:0.0:1789760767.874094:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739511299547 time 739560776866 state 0x0 ref 1
00000100:00100000:0.0:1789760767.874106:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521011072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760767.874150:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23973888, mtime: 0x6aad9500, atime: 0x0, ctime: 0x6aad9500, blocks: 0xb807
00010000:00010000:0.0:1789760767.874159:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.874174:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:0.0:1789760767.874400:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760767.874409:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.874496:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760767.915413:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973173 is committed
00002000:00010000:0.0:1789760767.915549:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23973888 -> 23977984
00002000:00010000:0.0:1789760767.915554:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760768 -> 1789760769
00002000:00010000:0.0:1789760767.915556:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760768 -> 1789760769
00010000:00010000:0.0:1789760767.915570:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.915583:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.915592:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.915600:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760767.915605:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.915614:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.915632:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760767.915639:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d2ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23973888->23977983] (req 23973888->23977983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760767.915767:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521011072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41658us (41898us total) trans 4294973173 rc 0/0
00000100:00100000:0.0:1789760767.915777:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5886
00000100:00100000:0.0:1789760767.915786:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739511299547 time 739560776866 state 0x2 ref 0
00000100:00100000:0.0:1789760767.918768:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760767.918856:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521011200
00000100:00100000:2.0:1789760767.918866:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521011200
00000100:00100000:2.0:1789760767.918920:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739511299547 time 739560776866 state 0x0 ref 1
00000100:00100000:2.0:1789760767.918933:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739561037282 time 739560776866 state 0x1 ref 1
00000100:00100000:2.0:1789760767.919005:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739561037282 time 739605686092 state 0x0 ref 1
00000100:00100000:2.0:1789760767.919018:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521011200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760767.919066:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23977984, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:2.0:1789760767.919075:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.919102:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:2.0:1789760767.919107:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760767.919113:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.919127:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760767.957025:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973174 is committed
00002000:00010000:2.0:1789760767.957229:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23977984 -> 23982080
00010000:00010000:2.0:1789760767.957245:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.957259:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.957269:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.957276:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760767.957281:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.957290:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.957308:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760767.957389:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d2f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23977984->23982079] (req 23977984->23982079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760767.957721:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521011200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38700us (38956us total) trans 4294973174 rc 0/0
00000100:00100000:3.0:1789760767.957732:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5887
00000100:00100000:3.0:1789760767.957741:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739561037282 time 739605686092 state 0x2 ref 0
00000100:00100000:0.0:1789760767.960971:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760767.961101:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521011328
00000100:00100000:3.0:1789760767.961112:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521011328
00000100:00100000:3.0:1789760767.961165:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739561037282 time 739605686092 state 0x0 ref 1
00000100:00100000:3.0:1789760767.961178:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739605946508 time 739605686092 state 0x1 ref 1
00000100:00100000:3.0:1789760767.961207:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739605946508 time 739647889940 state 0x0 ref 1
00000100:00100000:3.0:1789760767.961220:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521011328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760767.961273:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23982080, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760767.961282:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.961297:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:3.0:1789760767.961302:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760767.961308:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.961402:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760767.989798:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973175 is committed
00002000:00010000:3.0:1789760767.990039:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23982080 -> 23986176
00010000:00010000:3.0:1789760767.990056:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.990067:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.990074:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.990081:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760767.990085:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.990093:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.990111:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760767.990118:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d2fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23982080->23986175] (req 23982080->23986175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760767.990215:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521011328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28993us (29247us total) trans 4294973175 rc 0/0
00000100:00100000:3.0:1789760767.990225:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5888
00000100:00100000:3.0:1789760767.990234:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739605946508 time 739647889940 state 0x2 ref 0
00000100:00100000:2.0:1789760767.996891:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760767.996987:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521011456
00000100:00100000:1.0:1789760767.996997:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521011456
00000100:00100000:1.0:1789760767.997147:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739605946508 time 739647889940 state 0x0 ref 1
00000100:00100000:1.0:1789760767.997164:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739648150356 time 739647889940 state 0x1 ref 1
00000100:00100000:1.0:1789760767.997198:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739648150356 time 739683880343 state 0x0 ref 1
00000100:00100000:1.0:1789760767.997211:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521011456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760767.997254:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23986176, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:1.0:1789760767.997264:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.997280:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:1.0:1789760767.997284:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760767.997291:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760767.997306:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760768.031639:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973176 is committed
00002000:00010000:1.0:1789760768.031778:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23986176 -> 23990272
00010000:00010000:1.0:1789760768.031794:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.031807:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.031816:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.031823:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760768.031827:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.031835:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.031854:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.031863:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d301 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23986176->23990271] (req 23986176->23990271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760768.034105:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521011456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36878us (37205us total) trans 4294973176 rc 0/0
00000100:00100000:1.0:1789760768.034123:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5889
00000100:00100000:1.0:1789760768.034134:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739648150356 time 739683880343 state 0x2 ref 0
00000100:00100000:2.0:1789760768.048760:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760768.049017:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521011584
00000100:00100000:0.0:1789760768.049027:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521011584
00000100:00100000:0.0:1789760768.049103:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739648150356 time 739683880343 state 0x0 ref 1
00000100:00100000:0.0:1789760768.049118:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739684140759 time 739683880343 state 0x1 ref 1
00000100:00100000:0.0:1789760768.049149:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739684140759 time 739735832195 state 0x0 ref 1
00000100:00100000:0.0:1789760768.049163:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521011584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760768.049210:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23990272, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:0.0:1789760768.049218:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.049245:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:0.0:1789760768.049250:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760768.050143:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.050171:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:2.0:1789760768.051094:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:2.0:1789760768.098694:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973177 is committed
00002000:00010000:1.0:1789760768.098809:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23990272 -> 23994368
00010000:00010000:1.0:1789760768.098830:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.098845:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.098855:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.098863:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760768.098868:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.098882:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.098902:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.098911:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d308 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23990272->23994367] (req 23990272->23994367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760768.099011:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521011584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49846us (50257us total) trans 4294973177 rc 0/0
00000100:00100000:1.0:1789760768.099022:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5890
00000100:00100000:1.0:1789760768.099032:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739684140759 time 739735832195 state 0x2 ref 0
00000100:00100000:0.0:1789760768.105126:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.105364:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521011712
00000100:00100000:3.0:1789760768.105374:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521011712
00000100:00100000:3.0:1789760768.105552:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739684140759 time 739735832195 state 0x0 ref 1
00000100:00100000:3.0:1789760768.105568:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739736092611 time 739735832195 state 0x1 ref 1
00000100:00100000:3.0:1789760768.105651:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739736092611 time 739792332228 state 0x0 ref 1
00000100:00100000:3.0:1789760768.105665:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521011712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.105718:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23994368, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.105728:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.105744:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:3.0:1789760768.105748:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.105755:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.105768:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760768.121469:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789760768.121490:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda617ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548764672:0@lo:13:osp-pre-1-0.0
00000100:00100000:2.0:1789760768.121568:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760768.121644:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548764672
00000100:00100000:2.0:1789760768.121650:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548764672
00000100:00100000:2.0:1789760768.121696:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380
00000100:00100000:2.0:1789760768.121705:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548764672:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:2.0:1789760768.121737:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:2.0:1789760768.121783:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548764672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (214us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760768.121790:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380
00000100:00080000:2.0:1789760768.121810:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1789760768.121846:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda617ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548764672:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760768.123130:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1789760768.123147:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548764800:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760768.123197:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760768.123240:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548764800
00000100:00100000:0.0:1789760768.123246:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548764800
00000100:00100000:0.0:1789760768.123289:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381
00000100:00100000:0.0:1789760768.123298:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548764800:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:0.0:1789760768.123341:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760768.123383:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548764800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (184us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760768.123390:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381
00000100:00100000:0.0:1789760768.124437:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548764800:0@lo:13:osp-pre-1-1.0
00000100:00100000:1.0:1789760768.125447:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548765184:0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.125505:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760768.125555:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3456:1876699548765696:0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.125581:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760768.125600:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3456:1876699548766208:0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.125621:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760768.125641:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3]
00000100:00100000:1.0:1789760768.125646:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876699548765056:0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.125666:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760768.125681:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699548765568:0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.125704:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760768.125723:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3456:1876699548766080:0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.125742:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760768.125774:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548765184
00000100:00100000:1.0:1789760768.125780:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548765184
00000100:00100000:1.0:1789760768.125823:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447
00000100:00100000:1.0:1789760768.125832:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548765184:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.125880:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548765184:12345-0@lo:400:kworker.0 Request processed in 49us (375us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760768.125887:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447
00000100:00100000:1.0:1789760768.125909:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548765696
00000100:00100000:1.0:1789760768.125912:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548765696
00000100:00100000:1.0:1789760768.125932:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548766208
00000100:00100000:1.0:1789760768.125935:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548766208
00000100:00100000:1.0:1789760768.125947:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548765056
00000100:00100000:1.0:1789760768.125950:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548765056
00000100:00100000:1.0:1789760768.125960:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548765568
00000100:00100000:1.0:1789760768.125962:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548765568
00000100:00100000:1.0:1789760768.125973:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548766080
00000100:00100000:1.0:1789760768.125975:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548766080
00000100:00100000:1.0:1789760768.125986:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927
00000100:00100000:1.0:1789760768.125992:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876699548765696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.126023:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876699548765696:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760768.126029:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927
00000100:00100000:1.0:1789760768.126041:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928
00000100:00100000:1.0:1789760768.126047:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876699548766208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.126186:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548765312:0@lo:400:kworker.0
00000100:00100000:3.0:1789760768.126248:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548764928:0@lo:400:kworker.0
00000100:00080000:2.0:1789760768.126664:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:2.0:1789760768.126669:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1789760768.126671:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1789760768.126719:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760768.126760:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548765824:0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.126787:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760768.126825:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548765824
00000100:00100000:2.0:1789760768.126830:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548765824
00000100:00100000:2.0:1789760768.126862:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301
00000100:00100000:2.0:1789760768.126869:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548765824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.126911:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548765824:12345-0@lo:400:kworker.0 Request processed in 42us (122us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760768.126918:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301
00000100:00100000:2.0:1789760768.126960:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548765824:0@lo:400:kworker.0
00000100:00100000:3.0:1789760768.130968:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760768.131028:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548765440:0@lo:400:kworker.0
00000100:00100000:3.0:1789760768.131064:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760768.131094:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548765952:0@lo:400:kworker.0
00000100:00100000:3.0:1789760768.131114:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760768.131148:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548765440
00000100:00100000:3.0:1789760768.131154:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548765440
00000100:00100000:3.0:1789760768.131192:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448
00000100:00100000:3.0:1789760768.131199:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548765440:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760768.131253:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548765440:12345-0@lo:400:kworker.0 Request processed in 53us (187us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760768.131260:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448
00000100:00100000:3.0:1789760768.131281:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548765952
00000100:00100000:3.0:1789760768.131285:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548765952
00000100:00100000:3.0:1789760768.131309:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302
00000100:00100000:3.0:1789760768.131331:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548765952:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760768.131365:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548765952:12345-0@lo:400:kworker.0 Request processed in 35us (249us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760768.131372:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302
00000100:00100000:3.0:1789760768.131407:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548765440:0@lo:400:kworker.0
00000100:00100000:3.0:1789760768.131416:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548765952:0@lo:400:kworker.0
00000100:00100000:0.0:1789760768.131527:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548765312
00000100:00100000:0.0:1789760768.131532:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548765312
00000100:00100000:0.0:1789760768.131565:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929
00000100:00100000:0.0:1789760768.131572:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876699548765056:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760768.131610:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876699548765056:12345-0@lo:400:kworker.0 Request processed in 38us (5943us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760768.131616:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929
00000100:00100000:0.0:1789760768.131630:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930
00000100:00100000:0.0:1789760768.131636:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699548765568:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760768.131664:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699548765568:12345-0@lo:400:kworker.0 Request processed in 28us (5958us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760768.131670:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930
00000100:00100000:0.0:1789760768.131681:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931
00000100:00100000:0.0:1789760768.131687:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876699548766080:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760768.131711:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876699548766080:12345-0@lo:400:kworker.0 Request processed in 25us (5969us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760768.131717:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931
00000100:00100000:0.0:1789760768.131726:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932
00000100:00100000:0.0:1789760768.131731:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548765312:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760768.131761:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548765312:12345-0@lo:400:kworker.0 Request processed in 30us (5042us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760768.131766:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932
00000100:00100000:0.0:1789760768.131818:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548765312:0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.132732:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548764928
00000100:00100000:2.0:1789760768.132740:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548764928
00000100:00100000:2.0:1789760768.132774:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481
00000100:00100000:2.0:1789760768.132782:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3454:x1876699548764928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.132843:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3454:x1876699548764928:12345-0@lo:400:kworker.0 Request processed in 62us (1882us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760768.132850:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481
00000100:00100000:2.0:1789760768.132893:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548764928:0@lo:400:kworker.0
00002000:00010000:3.0:1789760768.135858:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23994368 -> 23998464
00010000:00010000:3.0:1789760768.135881:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.135897:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.135907:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.135917:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.135922:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.135932:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.135955:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.135963:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d30f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23994368->23998463] (req 23994368->23998463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.136052:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521011712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30384us (30931us total) trans 4294973178 rc 0/0
00000100:00100000:3.0:1789760768.136065:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5891
00000100:00100000:3.0:1789760768.136077:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739736092611 time 739792332228 state 0x2 ref 0
00000001:00080000:2.0:1789760768.136194:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973178 is committed
00000100:00100000:2.0:1789760768.136406:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876699548765056:0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.136420:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699548765568:0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.136435:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3456:1876699548766080:0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.136449:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548765184:0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.136461:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3456:1876699548765696:0@lo:400:kworker.0
00000100:00100000:2.0:1789760768.136474:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3456:1876699548766208:0@lo:400:kworker.0
00000100:00100000:1.0:1789760768.137998:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876699548766208:12345-0@lo:400:kworker.0 Request processed in 11942us (12367us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760768.138012:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928
00000100:00100000:0.0:1789760768.140893:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.141026:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521011840
00000100:00100000:3.0:1789760768.141039:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521011840
00000100:00100000:3.0:1789760768.141099:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739736092611 time 739792332228 state 0x0 ref 1
00000100:00100000:3.0:1789760768.141114:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739792592644 time 739792332228 state 0x1 ref 1
00000100:00100000:3.0:1789760768.141150:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739792592644 time 739827832391 state 0x0 ref 1
00000100:00100000:3.0:1789760768.141161:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521011840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.141221:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 23998464, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.141231:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.141245:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:3.0:1789760768.141249:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.141267:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.141281:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760768.177688:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973179 is committed
00002000:00010000:1.0:1789760768.178442:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 23998464 -> 24002560
00010000:00010000:1.0:1789760768.178461:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.178474:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.178484:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.178491:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760768.178497:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.178511:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.178530:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.178547:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d316 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [23998464->24002559] (req 23998464->24002559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760768.178650:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521011840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37485us (37765us total) trans 4294973179 rc 0/0
00000100:00100000:1.0:1789760768.178660:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5892
00000100:00100000:1.0:1789760768.178669:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739792592644 time 739827832391 state 0x2 ref 0
00000100:00100000:2.0:1789760768.186895:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760768.187000:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521011968
00000100:00100000:1.0:1789760768.187012:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521011968
00000100:00100000:1.0:1789760768.187082:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739792592644 time 739827832391 state 0x0 ref 1
00000100:00100000:1.0:1789760768.187098:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739828092807 time 739827832391 state 0x1 ref 1
00000100:00100000:1.0:1789760768.187130:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739828092807 time 739873811989 state 0x0 ref 1
00000100:00100000:1.0:1789760768.187143:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521011968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760768.187191:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24002560, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:1.0:1789760768.187200:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.187217:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:1.0:1789760768.187222:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760768.187229:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.187242:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760768.231751:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24002560 -> 24006656
00010000:00010000:1.0:1789760768.231771:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.231785:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.231795:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.231802:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760768.231807:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.231816:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.231836:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.231844:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d31d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24002560->24006655] (req 24002560->24006655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760768.231932:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521011968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44786us (45044us total) trans 4294973180 rc 0/0
00000100:00100000:1.0:1789760768.231943:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5893
00000100:00100000:1.0:1789760768.231953:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739828092807 time 739873811989 state 0x2 ref 0
00000001:00080000:3.0:1789760768.232422:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973180 is committed
00000100:00100000:0.0:1789760768.239991:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760768.240249:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521012096
00000100:00100000:1.0:1789760768.240481:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521012096
00000100:00100000:1.0:1789760768.240551:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739828092807 time 739873811989 state 0x0 ref 1
00000100:00100000:1.0:1789760768.240567:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739874072405 time 739873811989 state 0x1 ref 1
00000100:00100000:1.0:1789760768.240639:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739874072405 time 739927321085 state 0x0 ref 1
00000100:00100000:1.0:1789760768.240652:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521012096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760768.240702:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24006656, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:1.0:1789760768.240713:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.240729:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:1.0:1789760768.240733:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760768.240740:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.240759:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760768.298703:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973181 is committed
00002000:00010000:1.0:1789760768.298785:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24006656 -> 24010752
00010000:00010000:1.0:1789760768.298801:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.298814:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.298824:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.298832:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760768.298837:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.298846:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.298864:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.298873:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d324 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24006656->24010751] (req 24006656->24010751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760768.299019:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521012096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58362us (59030us total) trans 4294973181 rc 0/0
00000100:00100000:1.0:1789760768.299030:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5894
00000100:00100000:1.0:1789760768.299040:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739874072405 time 739927321085 state 0x2 ref 0
00000100:00100000:0.0:1789760768.302429:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.302520:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521012224
00000100:00100000:3.0:1789760768.302529:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521012224
00000100:00100000:3.0:1789760768.302649:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739874072405 time 739927321085 state 0x0 ref 1
00000100:00100000:3.0:1789760768.302664:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739927581501 time 739927321085 state 0x1 ref 1
00000100:00100000:3.0:1789760768.302718:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739927581501 time 739989400426 state 0x0 ref 1
00000100:00100000:3.0:1789760768.302732:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521012224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.302972:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24010752, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.302983:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.303000:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=739s v=(0 0)
00010000:00010000:3.0:1789760768.303004:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.303010:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.303025:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760768.333882:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973182 is committed
00002000:00010000:0.0:1789760768.334093:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24010752 -> 24014848
00010000:00010000:0.0:1789760768.334110:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.334122:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.334132:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.334140:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760768.334145:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.334155:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.334176:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.334184:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d32b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24010752->24014847] (req 24010752->24014847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760768.334523:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521012224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31788us (32264us total) trans 4294973182 rc 0/0
00000100:00100000:0.0:1789760768.334535:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5895
00000100:00100000:0.0:1789760768.334555:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739927581501 time 739989400426 state 0x2 ref 0
00000100:00100000:0.0:1789760768.346216:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.347049:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521012352
00000100:00100000:3.0:1789760768.347061:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521012352
00000100:00100000:2.0:1789760768.347371:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739927581501 time 739989400426 state 0x0 ref 1
00000100:00100000:2.0:1789760768.347389:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739989660842 time 739989400426 state 0x1 ref 1
00000100:00100000:2.0:1789760768.347467:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739989660842 time 740034148956 state 0x0 ref 1
00000100:00100000:2.0:1789760768.347481:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521012352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760768.347525:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24014848, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:2.0:1789760768.347535:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.347562:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:2.0:1789760768.347567:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760768.347574:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.347587:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760768.395583:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973183 is committed
00002000:00010000:3.0:1789760768.395855:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24014848 -> 24018944
00010000:00010000:3.0:1789760768.395871:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.395885:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.395901:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.395908:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.395913:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.395923:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.395943:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.395951:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d332 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24014848->24018943] (req 24014848->24018943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.396044:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521012352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48561us (49835us total) trans 4294973183 rc 0/0
00000100:00100000:3.0:1789760768.396055:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5896
00000100:00100000:3.0:1789760768.396064:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739989660842 time 740034148956 state 0x2 ref 0
00000100:00100000:2.0:1789760768.400079:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760768.400173:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521012480
00000100:00100000:1.0:1789760768.400183:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521012480
00000100:00100000:1.0:1789760768.400239:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 739989660842 time 740034148956 state 0x0 ref 1
00000100:00100000:1.0:1789760768.400389:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740034409372 time 740034148956 state 0x1 ref 1
00000100:00100000:1.0:1789760768.400417:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740034409372 time 740087099671 state 0x0 ref 1
00000100:00100000:1.0:1789760768.400431:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521012480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760768.400482:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24018944, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:1.0:1789760768.400490:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.400506:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:1.0:1789760768.400510:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760768.400516:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.400529:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760768.433507:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24018944 -> 24023040
00010000:00010000:1.0:1789760768.433527:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.433552:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.433561:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.433568:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760768.433573:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.433582:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.433602:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.433610:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d339 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24018944->24023039] (req 24018944->24023039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760768.433715:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521012480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33282us (33639us total) trans 4294973184 rc 0/0
00000100:00100000:1.0:1789760768.433730:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5897
00000100:00100000:1.0:1789760768.433740:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740034409372 time 740087099671 state 0x2 ref 0
00000001:00080000:0.0:1789760768.435512:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973184 is committed
00000100:00100000:0.0:1789760768.438471:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760768.438604:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521012608
00000100:00100000:1.0:1789760768.438614:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521012608
00000100:00100000:1.0:1789760768.438676:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740034409372 time 740087099671 state 0x0 ref 1
00000100:00100000:1.0:1789760768.438693:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740087360087 time 740087099671 state 0x1 ref 1
00000100:00100000:1.0:1789760768.438766:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740087360087 time 740125447784 state 0x0 ref 1
00000100:00100000:1.0:1789760768.438780:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521012608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760768.438830:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24023040, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:1.0:1789760768.438839:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.438854:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:1.0:1789760768.438858:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760768.438865:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.438879:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760768.468337:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973185 is committed
00002000:00010000:0.0:1789760768.468438:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24023040 -> 24027136
00010000:00010000:0.0:1789760768.468454:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.468473:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.468483:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.468490:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760768.468495:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.468505:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.468524:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.468533:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d340 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24023040->24027135] (req 24023040->24027135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760768.468682:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521012608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29899us (30218us total) trans 4294973185 rc 0/0
00000100:00100000:0.0:1789760768.468693:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5898
00000100:00100000:0.0:1789760768.468702:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740087360087 time 740125447784 state 0x2 ref 0
00000100:00100000:0.0:1789760768.471945:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.472007:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521012736
00000100:00100000:3.0:1789760768.472018:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521012736
00000100:00100000:3.0:1789760768.472087:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740087360087 time 740125447784 state 0x0 ref 1
00000100:00100000:3.0:1789760768.472107:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740125708200 time 740125447784 state 0x1 ref 1
00000100:00100000:3.0:1789760768.472137:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740125708200 time 740158819339 state 0x0 ref 1
00000100:00100000:3.0:1789760768.472150:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521012736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.472211:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24027136, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.472221:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.472237:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.472241:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.472248:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.472262:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760768.502705:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24027136 -> 24031232
00010000:00010000:3.0:1789760768.502725:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.502738:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.502748:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.502761:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.502766:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.502776:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.502799:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.502807:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d347 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24027136->24031231] (req 24027136->24031231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.502908:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521012736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30755us (30967us total) trans 4294973186 rc 0/0
00000100:00100000:3.0:1789760768.502919:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5899
00000100:00100000:3.0:1789760768.502929:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740125708200 time 740158819339 state 0x2 ref 0
00000001:00080000:0.0:1789760768.503139:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973186 is committed
00000100:00100000:2.0:1789760768.506649:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.506734:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521012864
00000100:00100000:3.0:1789760768.506745:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521012864
00000100:00100000:3.0:1789760768.506799:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740125708200 time 740158819339 state 0x0 ref 1
00000100:00100000:3.0:1789760768.506814:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740159079755 time 740158819339 state 0x1 ref 1
00000100:00100000:3.0:1789760768.506846:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740159079755 time 740193528737 state 0x0 ref 1
00000100:00100000:3.0:1789760768.506862:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521012864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.506910:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24031232, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.506919:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.506935:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.506939:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.506945:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.506960:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760768.537653:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973187 is committed
00002000:00010000:3.0:1789760768.537733:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24031232 -> 24035328
00010000:00010000:3.0:1789760768.537748:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.537762:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.537771:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.537779:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.537784:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.537794:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.537812:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.537821:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d34e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24031232->24035327] (req 24031232->24035327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.537954:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521012864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31090us (31311us total) trans 4294973187 rc 0/0
00000100:00100000:3.0:1789760768.537966:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5900
00000100:00100000:3.0:1789760768.537975:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740159079755 time 740193528737 state 0x2 ref 0
00000100:00100000:2.0:1789760768.541687:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760768.541784:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521012992
00000100:00100000:1.0:1789760768.541794:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521012992
00000100:00100000:1.0:1789760768.541847:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740159079755 time 740193528737 state 0x0 ref 1
00000100:00100000:1.0:1789760768.541863:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740193789153 time 740193528737 state 0x1 ref 1
00000100:00100000:1.0:1789760768.541922:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740193789153 time 740228603667 state 0x0 ref 1
00000100:00100000:1.0:1789760768.541935:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521012992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760768.541981:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24035328, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:1.0:1789760768.541991:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.542006:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:1.0:1789760768.542010:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760768.542016:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.542030:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760768.568099:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24035328 -> 24039424
00010000:00010000:3.0:1789760768.568120:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.568135:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.568146:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.568154:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.568160:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.568296:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.568348:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.568357:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d355 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24035328->24039423] (req 24035328->24039423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.568456:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521012992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26518us (26772us total) trans 4294973188 rc 0/0
00000100:00100000:3.0:1789760768.568467:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5901
00000100:00100000:3.0:1789760768.568477:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740193789153 time 740228603667 state 0x2 ref 0
00000001:00080000:0.0:1789760768.568579:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973188 is committed
00010000:00010000:0.0:1789760768.572392:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789760768.572678:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760768.572753:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521013120
00000100:00100000:0.0:1789760768.572762:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521013120
00000100:00100000:0.0:1789760768.572816:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740193789153 time 740228603667 state 0x0 ref 1
00000100:00100000:0.0:1789760768.572831:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740228864083 time 740228603667 state 0x1 ref 1
00000100:00100000:0.0:1789760768.572859:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740228864083 time 740259541705 state 0x0 ref 1
00000100:00100000:0.0:1789760768.572872:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521013120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760768.572923:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24039424, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:0.0:1789760768.572933:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.572950:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:0.0:1789760768.572955:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760768.572961:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.572974:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760768.597909:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973189 is committed
00002000:00010000:2.0:1789760768.598097:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24039424 -> 24043520
00010000:00010000:2.0:1789760768.598113:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.598125:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.598135:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.598143:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760768.598148:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.598157:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.598186:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.598194:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d35c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24039424->24043519] (req 24039424->24043519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760768.598289:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521013120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25414us (25611us total) trans 4294973189 rc 0/0
00000100:00100000:2.0:1789760768.598300:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5902
00000100:00100000:2.0:1789760768.598308:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740228864083 time 740259541705 state 0x2 ref 0
00000100:00100000:2.0:1789760768.601399:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.601510:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521013248
00000100:00100000:3.0:1789760768.601519:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521013248
00000100:00100000:3.0:1789760768.601582:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740228864083 time 740259541705 state 0x0 ref 1
00000100:00100000:3.0:1789760768.601596:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740259802121 time 740259541705 state 0x1 ref 1
00000100:00100000:3.0:1789760768.601627:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740259802121 time 740288309490 state 0x0 ref 1
00000100:00100000:3.0:1789760768.601640:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521013248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.601686:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24043520, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.601695:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.601710:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.601714:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.601720:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.601734:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760768.626776:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24043520 -> 24047616
00010000:00010000:3.0:1789760768.626796:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.626809:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.626817:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.626825:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.626830:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.626840:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.626866:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.626874:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d363 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24043520->24047615] (req 24043520->24047615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.626974:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521013248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25331us (25580us total) trans 4294973190 rc 0/0
00000100:00100000:3.0:1789760768.626984:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5903
00000100:00100000:3.0:1789760768.626994:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740259802121 time 740288309490 state 0x2 ref 0
00000001:00080000:0.0:1789760768.629569:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973190 is committed
00000100:00100000:3.0:1789760768.630622:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760768.630705:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521013376
00000100:00100000:2.0:1789760768.630715:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521013376
00000100:00100000:2.0:1789760768.630769:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740259802121 time 740288309490 state 0x0 ref 1
00000100:00100000:2.0:1789760768.630787:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740288569906 time 740288309490 state 0x1 ref 1
00000100:00100000:2.0:1789760768.630818:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740288569906 time 740317500151 state 0x0 ref 1
00000100:00100000:2.0:1789760768.630830:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521013376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760768.630877:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24047616, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:2.0:1789760768.630886:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.630902:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:2.0:1789760768.630906:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760768.630913:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760768.630927:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760768.670514:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24047616 -> 24051712
00010000:00010000:3.0:1789760768.670533:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.670556:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.670565:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.670573:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.670577:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.670592:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.670612:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.670622:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d36a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24047616->24051711] (req 24047616->24051711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.670717:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521013376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39884us (40096us total) trans 4294973191 rc 0/0
00000100:00100000:3.0:1789760768.670728:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5904
00000100:00100000:3.0:1789760768.670738:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740288569906 time 740317500151 state 0x2 ref 0
00000100:00100000:2.0:1789760768.674206:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.674353:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521013504
00000100:00100000:3.0:1789760768.674363:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521013504
00000100:00100000:3.0:1789760768.674419:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740288569906 time 740317500151 state 0x0 ref 1
00000100:00100000:3.0:1789760768.674433:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740317760567 time 740317500151 state 0x1 ref 1
00000100:00100000:3.0:1789760768.674454:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740317760567 time 740361137777 state 0x0 ref 1
00000100:00100000:3.0:1789760768.674466:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521013504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.674509:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24051712, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.674518:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.674533:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.674548:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.674555:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.674569:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760768.679392:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973191 is committed
00000001:00080000:2.0:1789760768.718348:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973192 is committed
00002000:00010000:3.0:1789760768.718452:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24051712 -> 24055808
00010000:00010000:3.0:1789760768.718467:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.718481:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.718491:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.718499:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.718504:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.718513:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.718544:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.718553:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d371 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24051712->24055807] (req 24051712->24055807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.718646:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521013504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44177us (44446us total) trans 4294973192 rc 0/0
00000100:00100000:3.0:1789760768.718658:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5905
00000100:00100000:3.0:1789760768.718667:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740317760567 time 740361137777 state 0x2 ref 0
00000100:00100000:0.0:1789760768.722436:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.722637:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521013632
00000100:00100000:3.0:1789760768.722647:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521013632
00000100:00100000:3.0:1789760768.722702:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740317760567 time 740361137777 state 0x0 ref 1
00000100:00100000:3.0:1789760768.722718:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740361398193 time 740361137777 state 0x1 ref 1
00000100:00100000:3.0:1789760768.722741:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740361398193 time 740409424505 state 0x0 ref 1
00000100:00100000:3.0:1789760768.722755:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521013632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.722802:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24055808, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.722812:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.722829:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.722833:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.722840:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.722872:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760768.753386:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973193 is committed
00002000:00010000:3.0:1789760768.753506:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24055808 -> 24059904
00010000:00010000:3.0:1789760768.753522:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.753544:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.753555:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.753563:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.753569:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.753578:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.753599:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.753607:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d378 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24055808->24059903] (req 24055808->24059903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.753833:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521013632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31073us (31400us total) trans 4294973193 rc 0/0
00000100:00100000:3.0:1789760768.753843:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5906
00000100:00100000:3.0:1789760768.753852:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740361398193 time 740409424505 state 0x2 ref 0
00000100:00100000:2.0:1789760768.759747:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.759854:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521013760
00000100:00100000:3.0:1789760768.759863:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521013760
00000100:00100000:3.0:1789760768.759973:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740361398193 time 740409424505 state 0x0 ref 1
00000100:00100000:3.0:1789760768.759990:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740409684921 time 740409424505 state 0x1 ref 1
00000100:00100000:3.0:1789760768.760021:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740409684921 time 740446703788 state 0x0 ref 1
00000100:00100000:3.0:1789760768.760033:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521013760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.760134:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24059904, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.760144:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.760159:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.760219:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.760228:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.760242:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760768.839666:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24059904 -> 24064000
00010000:00010000:3.0:1789760768.839684:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.839698:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.839708:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.839716:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.839721:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.839730:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.839747:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.839755:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d37f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24059904->24063999] (req 24059904->24063999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.839916:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521013760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 79880us (80174us total) trans 4294973194 rc 0/0
00000100:00100000:3.0:1789760768.839931:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5907
00000100:00100000:3.0:1789760768.839941:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740409684921 time 740446703788 state 0x2 ref 0
00000001:00080000:0.0:1789760768.840015:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973194 is committed
00000100:00100000:2.0:1789760768.843570:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760768.843665:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521013888
00000100:00100000:0.0:1789760768.843674:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521013888
00000100:00100000:0.0:1789760768.843720:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740409684921 time 740446703788 state 0x0 ref 1
00000100:00100000:0.0:1789760768.843735:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740446964204 time 740446703788 state 0x1 ref 1
00000100:00100000:0.0:1789760768.843791:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740446964204 time 740530472990 state 0x0 ref 1
00000100:00100000:0.0:1789760768.843803:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521013888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760768.843855:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24064000, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:0.0:1789760768.843864:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.843879:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:0.0:1789760768.843883:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760768.843889:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760768.843903:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760768.872840:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973195 is committed
00002000:00010000:1.0:1789760768.872952:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24064000 -> 24068096
00010000:00010000:1.0:1789760768.872969:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.872983:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.872997:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.873005:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760768.873010:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.873018:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.873037:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760768.873045:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d386 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24064000->24068095] (req 24064000->24068095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760768.873367:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521013888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29560us (29800us total) trans 4294973195 rc 0/0
00000100:00100000:1.0:1789760768.873379:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5908
00000100:00100000:1.0:1789760768.873389:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740446964204 time 740530472990 state 0x2 ref 0
00000100:00100000:1.0:1789760768.877803:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.877898:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521014016
00000100:00100000:3.0:1789760768.877908:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521014016
00000100:00100000:3.0:1789760768.877961:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740446964204 time 740530472990 state 0x0 ref 1
00000100:00100000:3.0:1789760768.877977:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740530733406 time 740530472990 state 0x1 ref 1
00000100:00100000:3.0:1789760768.878041:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740530733406 time 740564723067 state 0x0 ref 1
00000100:00100000:3.0:1789760768.878054:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521014016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.878112:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24068096, mtime: 0x6aad9501, atime: 0x0, ctime: 0x6aad9501, blocks: 0xb807
00010000:00010000:3.0:1789760768.878122:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.878137:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.878142:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.878149:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.878163:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760768.904150:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973196 is committed
00002000:00010000:3.0:1789760768.904239:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24068096 -> 24072192
00002000:00010000:3.0:1789760768.904244:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760769 -> 1789760770
00002000:00010000:3.0:1789760768.904248:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760769 -> 1789760770
00010000:00010000:3.0:1789760768.904262:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.904277:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.904287:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.904294:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.904299:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.904308:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.904402:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.904411:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d38d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24068096->24072191] (req 24068096->24072191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.904551:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521014016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26496us (26754us total) trans 4294973196 rc 0/0
00000100:00100000:3.0:1789760768.904562:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5909
00000100:00100000:3.0:1789760768.904572:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740530733406 time 740564723067 state 0x2 ref 0
00000100:00100000:2.0:1789760768.907428:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.907543:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521014144
00000100:00100000:3.0:1789760768.907555:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521014144
00000100:00100000:3.0:1789760768.907607:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740530733406 time 740564723067 state 0x0 ref 1
00000100:00100000:3.0:1789760768.907622:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740564983483 time 740564723067 state 0x1 ref 1
00000100:00100000:3.0:1789760768.907654:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740564983483 time 740594336390 state 0x0 ref 1
00000100:00100000:3.0:1789760768.907666:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521014144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.907716:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24072192, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:3.0:1789760768.907725:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.907740:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.907745:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.907751:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.907765:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760768.950309:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973197 is committed
00002000:00010000:3.0:1789760768.950753:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24072192 -> 24076288
00010000:00010000:3.0:1789760768.950771:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.950784:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.950794:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.950802:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760768.950808:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.950816:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.950836:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.950845:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d394 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24072192->24076287] (req 24072192->24076287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760768.950976:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521014144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43308us (43552us total) trans 4294973197 rc 0/0
00000100:00100000:3.0:1789760768.950987:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5910
00000100:00100000:3.0:1789760768.950996:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740564983483 time 740594336390 state 0x2 ref 0
00000100:00100000:2.0:1789760768.954895:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760768.955066:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521014272
00000100:00100000:3.0:1789760768.955076:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521014272
00000100:00100000:3.0:1789760768.955130:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740564983483 time 740594336390 state 0x0 ref 1
00000100:00100000:3.0:1789760768.955145:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740594596806 time 740594336390 state 0x1 ref 1
00000100:00100000:3.0:1789760768.955232:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740594596806 time 740641912594 state 0x0 ref 1
00000100:00100000:3.0:1789760768.955246:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521014272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760768.955305:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24076288, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:3.0:1789760768.955357:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.955372:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760768.955376:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760768.955382:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760768.955395:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.004934:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973198 is committed
00002000:00010000:3.0:1789760769.005019:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24076288 -> 24080384
00010000:00010000:3.0:1789760769.005035:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.005049:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.005059:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.005136:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760769.005141:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.005151:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.005169:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.005176:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d39b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24076288->24080383] (req 24076288->24080383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760769.005304:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521014272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50056us (50414us total) trans 4294973198 rc 0/0
00000100:00100000:3.0:1789760769.005384:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5911
00000100:00100000:3.0:1789760769.005394:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740594596806 time 740641912594 state 0x2 ref 0
00000100:00100000:1.0:1789760769.021458:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.021643:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521014400
00000100:00100000:0.0:1789760769.021653:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521014400
00000100:00100000:0.0:1789760769.021708:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740594596806 time 740641912594 state 0x0 ref 1
00000100:00100000:0.0:1789760769.021722:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740642173010 time 740641912594 state 0x1 ref 1
00000100:00100000:0.0:1789760769.021754:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740642173010 time 740708436844 state 0x0 ref 1
00000100:00100000:0.0:1789760769.021767:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521014400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.021811:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24080384, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:0.0:1789760769.021820:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.021834:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:0.0:1789760769.021838:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.021844:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.021857:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.057851:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973199 is committed
00002000:00010000:0.0:1789760769.057920:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24080384 -> 24084480
00010000:00010000:0.0:1789760769.057935:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.057947:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.057956:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.057969:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.057973:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.057982:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.058001:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.058009:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d3a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24080384->24084479] (req 24080384->24084479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.058603:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521014400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36832us (37148us total) trans 4294973199 rc 0/0
00000100:00100000:0.0:1789760769.058616:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5912
00000100:00100000:0.0:1789760769.058626:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740642173010 time 740708436844 state 0x2 ref 0
00000100:00100000:2.0:1789760769.062739:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760769.062806:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521014528
00000100:00100000:1.0:1789760769.062815:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521014528
00000100:00100000:1.0:1789760769.062862:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740642173010 time 740708436844 state 0x0 ref 1
00000100:00100000:1.0:1789760769.062874:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740708697260 time 740708436844 state 0x1 ref 1
00000100:00100000:1.0:1789760769.062895:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740708697260 time 740749578967 state 0x0 ref 1
00000100:00100000:1.0:1789760769.062903:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521014528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760769.062945:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24084480, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:1.0:1789760769.062954:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.062968:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:1.0:1789760769.063011:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760769.063019:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.063033:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.096857:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973200 is committed
00002000:00010000:3.0:1789760769.096956:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24084480 -> 24088576
00010000:00010000:3.0:1789760769.096972:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.096983:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.096992:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.097007:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760769.097012:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.097021:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.097038:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.097046:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d3a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24084480->24088575] (req 24084480->24088575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760769.097203:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521014528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34295us (34469us total) trans 4294973200 rc 0/0
00000100:00100000:3.0:1789760769.097214:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5913
00000100:00100000:3.0:1789760769.097224:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740708697260 time 740749578967 state 0x2 ref 0
00000100:00100000:3.0:1789760769.107382:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.107463:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521014656
00000100:00100000:0.0:1789760769.107473:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521014656
00000100:00100000:0.0:1789760769.107529:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740708697260 time 740749578967 state 0x0 ref 1
00000100:00100000:0.0:1789760769.107553:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740749839383 time 740749578967 state 0x1 ref 1
00000100:00100000:0.0:1789760769.107586:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740749839383 time 740794268440 state 0x0 ref 1
00000100:00100000:0.0:1789760769.107599:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521014656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.107667:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24088576, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:0.0:1789760769.107677:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.107694:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:0.0:1789760769.107699:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.107705:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.107720:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760769.167942:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24088576 -> 24092672
00010000:00010000:0.0:1789760769.167966:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.167979:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.167987:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.167995:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.168000:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.168009:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.168029:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.168037:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d3b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24088576->24092671] (req 24088576->24092671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.168142:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521014656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60539us (60766us total) trans 4294973201 rc 0/0
00000100:00100000:0.0:1789760769.168153:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5914
00000100:00100000:0.0:1789760769.168163:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740749839383 time 740794268440 state 0x2 ref 0
00000001:00080000:0.0:1789760769.168204:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973201 is committed
00000100:00100000:0.0:1789760769.174156:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760769.174352:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521014784
00000100:00100000:3.0:1789760769.174363:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521014784
00000100:00100000:3.0:1789760769.174420:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740749839383 time 740794268440 state 0x0 ref 1
00000100:00100000:3.0:1789760769.174436:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740794528856 time 740794268440 state 0x1 ref 1
00000100:00100000:3.0:1789760769.174470:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740794528856 time 740861152104 state 0x0 ref 1
00000100:00100000:3.0:1789760769.174492:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521014784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760769.174550:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24092672, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:3.0:1789760769.174560:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.174576:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760769.174580:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760769.174586:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.174600:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760769.223667:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24092672 -> 24096768
00010000:00010000:3.0:1789760769.223686:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.223700:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.223709:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.223717:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760769.223722:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.223733:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.223755:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.223763:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24092672->24096767] (req 24092672->24096767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.223881:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973202 is committed
00000100:00100000:3.0:1789760769.224036:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521014784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49542us (49886us total) trans 4294973202 rc 0/0
00000100:00100000:3.0:1789760769.224047:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5915
00000100:00100000:3.0:1789760769.224057:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740794528856 time 740861152104 state 0x2 ref 0
00000100:00100000:3.0:1789760769.229103:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.229207:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521014912
00000100:00100000:0.0:1789760769.229218:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521014912
00000100:00100000:0.0:1789760769.229286:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740794528856 time 740861152104 state 0x0 ref 1
00000100:00100000:0.0:1789760769.229302:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740861412520 time 740861152104 state 0x1 ref 1
00000100:00100000:0.0:1789760769.229357:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740861412520 time 740916038759 state 0x0 ref 1
00000100:00100000:0.0:1789760769.229369:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521014912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.229419:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24096768, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:0.0:1789760769.229428:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.229444:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:0.0:1789760769.229449:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.229456:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.229471:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760769.273785:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973203 is committed
00002000:00010000:0.0:1789760769.273898:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24096768 -> 24100864
00010000:00010000:0.0:1789760769.273914:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.273928:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.273937:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.273945:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.273950:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.273958:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.273978:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.273986:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24096768->24100863] (req 24096768->24100863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.274184:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521014912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44812us (45086us total) trans 4294973203 rc 0/0
00000100:00100000:0.0:1789760769.274196:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5916
00000100:00100000:0.0:1789760769.274205:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740861412520 time 740916038759 state 0x2 ref 0
00000100:00100000:0.0:1789760769.277983:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760769.278811:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521015040
00000100:00100000:1.0:1789760769.278824:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521015040
00000100:00100000:1.0:1789760769.278884:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740861412520 time 740916038759 state 0x0 ref 1
00000100:00100000:1.0:1789760769.278902:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740916299175 time 740916038759 state 0x1 ref 1
00000100:00100000:1.0:1789760769.278983:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740916299175 time 740965663910 state 0x0 ref 1
00000100:00100000:1.0:1789760769.278997:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521015040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760769.279056:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24100864, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:1.0:1789760769.279078:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.279096:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:1.0:1789760769.279100:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760769.279106:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.279121:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760769.307014:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973204 is committed
00002000:00010000:0.0:1789760769.307436:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24100864 -> 24104960
00010000:00010000:0.0:1789760769.307454:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.307469:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.307479:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.307487:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.307492:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.307507:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.307529:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.307546:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d3c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24100864->24104959] (req 24100864->24104959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.307731:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521015040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28730us (29751us total) trans 4294973204 rc 0/0
00000100:00100000:0.0:1789760769.307745:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5917
00000100:00100000:0.0:1789760769.307756:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740916299175 time 740965663910 state 0x2 ref 0
00000100:00100000:0.0:1789760769.311576:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760769.311679:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521015168
00000100:00100000:3.0:1789760769.311691:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521015168
00000100:00100000:3.0:1789760769.311752:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740916299175 time 740965663910 state 0x0 ref 1
00000100:00100000:3.0:1789760769.311768:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740965924326 time 740965663910 state 0x1 ref 1
00000100:00100000:3.0:1789760769.311833:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740965924326 time 740998514302 state 0x0 ref 1
00000100:00100000:3.0:1789760769.311847:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521015168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760769.311908:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24104960, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:3.0:1789760769.311919:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.311937:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=740s v=(0 0)
00010000:00010000:3.0:1789760769.311941:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760769.311948:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.311962:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760769.341932:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24104960 -> 24109056
00010000:00010000:3.0:1789760769.341953:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.341966:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.341974:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.341980:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760769.341985:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.341995:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.342016:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.342024:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24104960->24109055] (req 24104960->24109055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760769.342133:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521015168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30284us (30566us total) trans 4294973205 rc 0/0
00000100:00100000:3.0:1789760769.342143:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5918
00000100:00100000:3.0:1789760769.342152:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740965924326 time 740998514302 state 0x2 ref 0
00000001:00080000:1.0:1789760769.342355:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973205 is committed
00000100:00100000:3.0:1789760769.345211:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760769.345358:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521015296
00000100:00100000:1.0:1789760769.345367:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521015296
00000100:00100000:1.0:1789760769.345418:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740965924326 time 740998514302 state 0x0 ref 1
00000100:00100000:1.0:1789760769.345433:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740998774718 time 740998514302 state 0x1 ref 1
00000100:00100000:1.0:1789760769.345465:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740998774718 time 741032147842 state 0x0 ref 1
00000100:00100000:1.0:1789760769.345477:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521015296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760769.345522:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24109056, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:1.0:1789760769.345541:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.345561:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:1.0:1789760769.345565:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760769.345572:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.345586:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760769.375879:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973206 is committed
00002000:00010000:3.0:1789760769.375994:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24109056 -> 24113152
00010000:00010000:3.0:1789760769.376012:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.376026:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.376035:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.376043:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760769.376048:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.376130:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.376153:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.376170:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d3d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24109056->24113151] (req 24109056->24113151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760769.376284:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521015296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30802us (31074us total) trans 4294973206 rc 0/0
00000100:00100000:3.0:1789760769.376296:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5919
00000100:00100000:3.0:1789760769.376306:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740998774718 time 741032147842 state 0x2 ref 0
00000100:00100000:2.0:1789760769.380155:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760769.380365:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521015424
00000100:00100000:3.0:1789760769.380376:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521015424
00000100:00100000:3.0:1789760769.380431:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 740998774718 time 741032147842 state 0x0 ref 1
00000100:00100000:3.0:1789760769.380447:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741032408258 time 741032147842 state 0x1 ref 1
00000100:00100000:3.0:1789760769.380474:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741032408258 time 741067156289 state 0x0 ref 1
00000100:00100000:3.0:1789760769.380487:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521015424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760769.380546:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24113152, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:3.0:1789760769.380556:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.380573:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:3.0:1789760769.380578:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760769.380584:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.380598:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760769.415828:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973207 is committed
00002000:00010000:0.0:1789760769.415926:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24113152 -> 24117248
00010000:00010000:0.0:1789760769.415941:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.415956:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.415966:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.415980:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.415985:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.415994:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.416013:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.416021:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d3da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24113152->24117247] (req 24113152->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.416253:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521015424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35763us (36102us total) trans 4294973207 rc 0/0
00000100:00100000:0.0:1789760769.416265:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5920
00000100:00100000:0.0:1789760769.416274:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741032408258 time 741067156289 state 0x2 ref 0
00000100:00100000:1.0:1789760769.419631:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760769.419733:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521015552
00000100:00100000:2.0:1789760769.419743:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521015552
00000100:00100000:2.0:1789760769.419801:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741032408258 time 741067156289 state 0x0 ref 1
00000100:00100000:2.0:1789760769.419817:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741067416705 time 741067156289 state 0x1 ref 1
00000100:00100000:2.0:1789760769.419881:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741067416705 time 741106561922 state 0x0 ref 1
00000100:00100000:2.0:1789760769.419894:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521015552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760769.419956:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24117248, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xb807
00010000:00010000:2.0:1789760769.419966:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.419985:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:2.0:1789760769.419989:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760769.419996:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.420011:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760769.456335:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973208 is committed
00002000:00010000:2.0:1789760769.456490:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24117248 -> 24121344
00002000:00010000:2.0:1789760769.456495:0:8103:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 47111 -> 49159
00010000:00010000:2.0:1789760769.456508:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.456521:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.456540:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.456549:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760769.456553:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.456564:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.456584:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.456592:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24117248->24121343] (req 24117248->24121343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760769.456729:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521015552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36831us (37102us total) trans 4294973208 rc 0/0
00000100:00100000:2.0:1789760769.456739:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5921
00000100:00100000:2.0:1789760769.456750:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741067416705 time 741106561922 state 0x2 ref 0
00000100:00100000:3.0:1789760769.464592:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760769.464720:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521015680
00000100:00100000:2.0:1789760769.464731:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521015680
00000100:00100000:2.0:1789760769.464786:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741067416705 time 741106561922 state 0x0 ref 1
00000100:00100000:2.0:1789760769.464876:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741106822338 time 741106561922 state 0x1 ref 1
00000100:00100000:2.0:1789760769.464957:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741106822338 time 741151638365 state 0x0 ref 1
00000100:00100000:2.0:1789760769.464970:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521015680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760769.465024:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24121344, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:2.0:1789760769.465033:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.465050:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:2.0:1789760769.465054:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760769.465061:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.465076:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760769.514424:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24121344 -> 24125440
00010000:00010000:3.0:1789760769.514446:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.514459:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.514468:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.514476:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760769.514482:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.514491:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.514514:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.514521:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d3e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24121344->24125439] (req 24121344->24125439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760769.514627:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521015680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49654us (50041us total) trans 4294973209 rc 0/0
00000100:00100000:3.0:1789760769.514637:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5922
00000100:00100000:3.0:1789760769.514647:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741106822338 time 741151638365 state 0x2 ref 0
00000001:00080000:0.0:1789760769.517728:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973209 is committed
00000100:00100000:0.0:1789760769.519306:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760769.519489:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521015808
00000100:00100000:3.0:1789760769.519500:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521015808
00000100:00100000:3.0:1789760769.519564:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741106822338 time 741151638365 state 0x0 ref 1
00000100:00100000:3.0:1789760769.519579:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741151898781 time 741151638365 state 0x1 ref 1
00000100:00100000:3.0:1789760769.519613:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741151898781 time 741206294582 state 0x0 ref 1
00000100:00100000:3.0:1789760769.519627:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521015808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760769.519679:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24125440, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:3.0:1789760769.519689:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.519706:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:3.0:1789760769.519711:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760769.519718:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.519733:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760769.553553:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973210 is committed
00002000:00010000:0.0:1789760769.553649:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24125440 -> 24129536
00010000:00010000:0.0:1789760769.553665:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.553678:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.553688:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.553695:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.553700:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.553709:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.553727:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.553734:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d3ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24125440->24129535] (req 24125440->24129535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.553839:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521015808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34209us (34538us total) trans 4294973210 rc 0/0
00000100:00100000:0.0:1789760769.553850:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5923
00000100:00100000:0.0:1789760769.553861:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741151898781 time 741206294582 state 0x2 ref 0
00000100:00100000:2.0:1789760769.560465:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.561009:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521015936
00000100:00100000:0.0:1789760769.561020:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521015936
00000100:00100000:0.0:1789760769.561134:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741151898781 time 741206294582 state 0x0 ref 1
00000100:00100000:0.0:1789760769.561149:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741206554998 time 741206294582 state 0x1 ref 1
00000100:00100000:0.0:1789760769.561270:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741206554998 time 741247950960 state 0x0 ref 1
00000100:00100000:0.0:1789760769.561284:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521015936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.561377:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24129536, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:0.0:1789760769.561387:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.561403:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:0.0:1789760769.561407:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.561414:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.561428:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.593413:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760769.594256:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973211 is committed
00002000:00010000:0.0:1789760769.594382:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24129536 -> 24133632
00010000:00010000:0.0:1789760769.594398:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.594411:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.594420:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.594427:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.594433:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.594443:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.594463:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.594470:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d3f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24129536->24133631] (req 24129536->24133631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.594576:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521015936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33289us (34115us total) trans 4294973211 rc 0/0
00000100:00100000:0.0:1789760769.594586:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5924
00000100:00100000:0.0:1789760769.594596:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741206554998 time 741247950960 state 0x2 ref 0
00000100:00100000:1.0:1789760769.598627:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760769.598723:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521016064
00000100:00100000:2.0:1789760769.598732:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521016064
00000100:00100000:2.0:1789760769.598781:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741206554998 time 741247950960 state 0x0 ref 1
00000100:00100000:2.0:1789760769.598798:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741248211376 time 741247950960 state 0x1 ref 1
00000100:00100000:2.0:1789760769.598919:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741248211376 time 741285600400 state 0x0 ref 1
00000100:00100000:2.0:1789760769.598932:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521016064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760769.598976:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24133632, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:2.0:1789760769.598986:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.599002:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:2.0:1789760769.599006:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760769.599012:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.599025:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760769.632509:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24133632 -> 24137728
00010000:00010000:0.0:1789760769.632538:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.632554:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.632564:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.632578:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.632583:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.632593:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.632610:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.632618:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d3fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24133632->24137727] (req 24133632->24137727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.632712:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521016064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33776us (34087us total) trans 4294973212 rc 0/0
00000100:00100000:0.0:1789760769.632722:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5925
00000100:00100000:0.0:1789760769.632731:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741248211376 time 741285600400 state 0x2 ref 0
00000001:00080000:1.0:1789760769.632830:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973212 is committed
00000100:00100000:0.0:1789760769.636407:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760769.636513:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521016192
00000100:00100000:3.0:1789760769.636523:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521016192
00000100:00100000:3.0:1789760769.636585:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741248211376 time 741285600400 state 0x0 ref 1
00000100:00100000:3.0:1789760769.636602:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741285860816 time 741285600400 state 0x1 ref 1
00000100:00100000:3.0:1789760769.636629:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741285860816 time 741323311976 state 0x0 ref 1
00000100:00100000:3.0:1789760769.636641:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521016192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760769.636688:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24137728, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:3.0:1789760769.636698:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.636713:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:3.0:1789760769.636718:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760769.636724:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.636739:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.669988:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973213 is committed
00002000:00010000:2.0:1789760769.670099:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24137728 -> 24141824
00010000:00010000:2.0:1789760769.670115:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.670128:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.670135:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.670147:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760769.670151:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.670282:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.670306:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.670334:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d404 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24137728->24141823] (req 24137728->24141823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760769.670468:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521016192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33824us (34067us total) trans 4294973213 rc 0/0
00000100:00100000:2.0:1789760769.670478:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5926
00000100:00100000:2.0:1789760769.670488:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741285860816 time 741323311976 state 0x2 ref 0
00000100:00100000:3.0:1789760769.675821:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.676364:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521016320
00000100:00100000:0.0:1789760769.676374:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521016320
00000100:00100000:0.0:1789760769.676426:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741285860816 time 741323311976 state 0x0 ref 1
00000100:00100000:0.0:1789760769.676442:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741323572392 time 741323311976 state 0x1 ref 1
00000100:00100000:0.0:1789760769.676472:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741323572392 time 741363154658 state 0x0 ref 1
00000100:00100000:0.0:1789760769.676483:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521016320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.676540:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24141824, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:0.0:1789760769.676549:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.676565:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:0.0:1789760769.676569:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.676576:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.676591:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.718506:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973214 is committed
00002000:00010000:1.0:1789760769.719374:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24141824 -> 24145920
00010000:00010000:1.0:1789760769.719391:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.719403:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.719412:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.719418:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760769.719422:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.719431:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.719449:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760769.719456:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60d40b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24141824->24145919] (req 24141824->24145919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760769.719554:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521016320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43066us (43746us total) trans 4294973214 rc 0/0
00000100:00100000:1.0:1789760769.719564:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5927
00000100:00100000:1.0:1789760769.719574:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741323572392 time 741363154658 state 0x2 ref 0
00000100:00100000:1.0:1789760769.722936:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.723844:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521016448
00000100:00100000:0.0:1789760769.723856:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521016448
00000100:00100000:0.0:1789760769.723915:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741323572392 time 741363154658 state 0x0 ref 1
00000100:00100000:0.0:1789760769.723931:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741363415074 time 741363154658 state 0x1 ref 1
00000100:00100000:0.0:1789760769.723964:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741363415074 time 741410647294 state 0x0 ref 1
00000100:00100000:0.0:1789760769.723976:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521016448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.724029:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24145920, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:0.0:1789760769.724038:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.724053:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:0.0:1789760769.724059:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.724065:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.724080:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.759295:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973215 is committed
00002000:00010000:0.0:1789760769.759384:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24145920 -> 24150016
00010000:00010000:0.0:1789760769.759401:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.759416:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.759425:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.759432:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.759436:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.759450:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.759469:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.759476:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d412 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24145920->24150015] (req 24145920->24150015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.759568:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521016448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35589us (36636us total) trans 4294973215 rc 0/0
00000100:00100000:0.0:1789760769.759579:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5928
00000100:00100000:0.0:1789760769.759588:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741363415074 time 741410647294 state 0x2 ref 0
00000100:00100000:0.0:1789760769.763807:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760769.764050:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521016576
00000100:00100000:2.0:1789760769.764066:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521016576
00000100:00100000:2.0:1789760769.764120:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741363415074 time 741410647294 state 0x0 ref 1
00000100:00100000:2.0:1789760769.764135:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741410907710 time 741410647294 state 0x1 ref 1
00000100:00100000:2.0:1789760769.764289:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741410907710 time 741450844391 state 0x0 ref 1
00000100:00100000:2.0:1789760769.764308:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521016576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760769.764387:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24150016, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:2.0:1789760769.764396:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.764411:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:2.0:1789760769.764416:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760769.764424:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.764437:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760769.791824:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973216 is committed
00002000:00010000:3.0:1789760769.793503:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24150016 -> 24154112
00010000:00010000:3.0:1789760769.793525:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.793548:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.793557:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.793564:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760769.793569:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.793578:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.793599:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.793607:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d419 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24150016->24154111] (req 24150016->24154111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760769.793713:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521016576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29402us (29908us total) trans 4294973216 rc 0/0
00000100:00100000:3.0:1789760769.793724:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5929
00000100:00100000:3.0:1789760769.793734:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741410907710 time 741450844391 state 0x2 ref 0
00000100:00100000:0.0:1789760769.797559:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760769.797657:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521016704
00000100:00100000:2.0:1789760769.797667:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521016704
00000100:00100000:2.0:1789760769.797719:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741410907710 time 741450844391 state 0x0 ref 1
00000100:00100000:2.0:1789760769.797733:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741451104807 time 741450844391 state 0x1 ref 1
00000100:00100000:2.0:1789760769.797801:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741451104807 time 741484482567 state 0x0 ref 1
00000100:00100000:2.0:1789760769.797813:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521016704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760769.797860:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24154112, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:2.0:1789760769.797869:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.797892:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:2.0:1789760769.797897:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760769.797904:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760769.797917:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760769.827565:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24154112 -> 24158208
00010000:00010000:0.0:1789760769.827585:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.827598:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.827617:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.827632:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.827637:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.827647:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.827666:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.827674:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d420 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24154112->24158207] (req 24154112->24158207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.827773:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521016704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29954us (30216us total) trans 4294973217 rc 0/0
00000100:00100000:0.0:1789760769.827783:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5930
00000100:00100000:0.0:1789760769.827792:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741451104807 time 741484482567 state 0x2 ref 0
00000001:00080000:1.0:1789760769.830998:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973217 is committed
00000100:00100000:1.0:1789760769.832026:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.832222:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521016832
00000100:00100000:0.0:1789760769.832232:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521016832
00000100:00100000:0.0:1789760769.832291:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741451104807 time 741484482567 state 0x0 ref 1
00000100:00100000:0.0:1789760769.832307:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741484742983 time 741484482567 state 0x1 ref 1
00000100:00100000:0.0:1789760769.832444:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741484742983 time 741519126038 state 0x0 ref 1
00000100:00100000:0.0:1789760769.832461:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521016832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.832508:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24158208, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:0.0:1789760769.832517:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.832543:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:0.0:1789760769.832548:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.832556:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.832570:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.860990:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973218 is committed
00002000:00010000:0.0:1789760769.861073:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24158208 -> 24162304
00010000:00010000:0.0:1789760769.861087:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.861100:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.861110:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.861117:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.861122:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.861132:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.861153:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.861310:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d427 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24158208->24162303] (req 24158208->24162303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.861431:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521016832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28968us (29406us total) trans 4294973218 rc 0/0
00000100:00100000:0.0:1789760769.861442:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5931
00000100:00100000:0.0:1789760769.861452:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741484742983 time 741519126038 state 0x2 ref 0
00000100:00100000:0.0:1789760769.864822:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760769.864968:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521016960
00000100:00100000:3.0:1789760769.864979:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521016960
00000100:00100000:3.0:1789760769.865041:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741484742983 time 741519126038 state 0x0 ref 1
00000100:00100000:3.0:1789760769.865056:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741519386454 time 741519126038 state 0x1 ref 1
00000100:00100000:3.0:1789760769.865094:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741519386454 time 741551776539 state 0x0 ref 1
00000100:00100000:3.0:1789760769.865107:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521016960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760769.865258:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24162304, mtime: 0x6aad9502, atime: 0x0, ctime: 0x6aad9502, blocks: 0xc007
00010000:00010000:3.0:1789760769.865270:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.865286:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:3.0:1789760769.865290:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760769.865296:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.865310:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760769.893914:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973219 is committed
00002000:00010000:3.0:1789760769.894035:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24162304 -> 24166400
00002000:00010000:3.0:1789760769.894040:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760770 -> 1789760771
00002000:00010000:3.0:1789760769.894044:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760770 -> 1789760771
00010000:00010000:3.0:1789760769.894069:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.894082:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.894091:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.894098:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760769.894104:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.894113:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.894131:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.894139:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d42e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24162304->24166399] (req 24162304->24166399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760769.894298:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521016960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29188us (29484us total) trans 4294973219 rc 0/0
00000100:00100000:3.0:1789760769.894309:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5932
00000100:00100000:3.0:1789760769.894349:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741519386454 time 741551776539 state 0x2 ref 0
00000100:00100000:3.0:1789760769.897721:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.898033:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521017088
00000100:00100000:0.0:1789760769.898043:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521017088
00000100:00100000:0.0:1789760769.898107:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741519386454 time 741551776539 state 0x0 ref 1
00000100:00100000:0.0:1789760769.898122:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741552036955 time 741551776539 state 0x1 ref 1
00000100:00100000:0.0:1789760769.898157:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741552036955 time 741584839242 state 0x0 ref 1
00000100:00100000:0.0:1789760769.898177:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521017088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.898231:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24166400, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760769.898242:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.898258:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:0.0:1789760769.898263:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.898269:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.898285:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760769.922247:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24166400 -> 24170496
00010000:00010000:0.0:1789760769.922267:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.922280:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.922289:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.922297:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.922302:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.922330:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.922350:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.922359:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d435 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24166400->24170495] (req 24166400->24170495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.922485:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521017088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24304us (24769us total) trans 4294973220 rc 0/0
00000100:00100000:0.0:1789760769.922496:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5933
00000100:00100000:0.0:1789760769.922505:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741552036955 time 741584839242 state 0x2 ref 0
00000001:00080000:0.0:1789760769.922549:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973220 is committed
00000100:00100000:0.0:1789760769.925640:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760769.925727:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521017216
00000100:00100000:3.0:1789760769.925738:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521017216
00000100:00100000:3.0:1789760769.925796:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741552036955 time 741584839242 state 0x0 ref 1
00000100:00100000:3.0:1789760769.925810:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741585099658 time 741584839242 state 0x1 ref 1
00000100:00100000:3.0:1789760769.925839:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741585099658 time 741612522413 state 0x0 ref 1
00000100:00100000:3.0:1789760769.925851:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521017216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760769.925897:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24170496, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:3.0:1789760769.925906:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.925921:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:3.0:1789760769.925925:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760769.925931:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760769.925945:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760769.960043:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24170496 -> 24174592
00010000:00010000:0.0:1789760769.960063:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.960075:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.960082:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.960088:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760769.960092:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.960100:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.960118:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.960125:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d43c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24170496->24174591] (req 24170496->24174591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760769.960262:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521017216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34408us (34625us total) trans 4294973221 rc 0/0
00000100:00100000:0.0:1789760769.960274:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5934
00000100:00100000:0.0:1789760769.960284:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741585099658 time 741612522413 state 0x2 ref 0
00000001:00080000:0.0:1789760769.960349:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973221 is committed
00000100:00100000:1.0:1789760769.976470:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760769.976590:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521017344
00000100:00100000:0.0:1789760769.976599:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521017344
00000100:00100000:0.0:1789760769.976650:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741585099658 time 741612522413 state 0x0 ref 1
00000100:00100000:0.0:1789760769.976675:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741612782829 time 741612522413 state 0x1 ref 1
00000100:00100000:0.0:1789760769.976710:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741612782829 time 741663392039 state 0x0 ref 1
00000100:00100000:0.0:1789760769.976721:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521017344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760769.976770:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24174592, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760769.976779:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.976793:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:0.0:1789760769.976798:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760769.976804:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760769.976817:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760770.007008:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973222 is committed
00002000:00010000:0.0:1789760770.007601:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24174592 -> 24178688
00010000:00010000:0.0:1789760770.007617:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.007630:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.007640:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.007648:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.007653:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.007663:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.007690:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.007951:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d443 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24174592->24178687] (req 24174592->24178687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.008065:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521017344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31341us (31602us total) trans 4294973222 rc 0/0
00000100:00100000:0.0:1789760770.008078:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5935
00000100:00100000:0.0:1789760770.008088:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741612782829 time 741663392039 state 0x2 ref 0
00000100:00100000:2.0:1789760770.013660:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.013793:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521017472
00000100:00100000:0.0:1789760770.013803:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521017472
00000100:00100000:0.0:1789760770.013872:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741612782829 time 741663392039 state 0x0 ref 1
00000100:00100000:0.0:1789760770.013887:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741663652455 time 741663392039 state 0x1 ref 1
00000100:00100000:0.0:1789760770.013920:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741663652455 time 741700601426 state 0x0 ref 1
00000100:00100000:0.0:1789760770.013933:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521017472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.013979:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24178688, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760770.013989:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.014005:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:0.0:1789760770.014010:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.014016:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.014030:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:2.0:1789760770.014574:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760770.059014:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973223 is committed
00002000:00010000:0.0:1789760770.059119:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24178688 -> 24182784
00010000:00010000:0.0:1789760770.059135:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.059148:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.059156:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.059163:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.059168:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.059176:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.059196:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.059203:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d44a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24178688->24182783] (req 24178688->24182783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760770.059827:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521017472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45888us (46169us total) trans 4294973223 rc 0/0
00000100:00100000:1.0:1789760770.059840:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5936
00000100:00100000:1.0:1789760770.059850:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741663652455 time 741700601426 state 0x2 ref 0
00000100:00100000:1.0:1789760770.070720:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760770.071027:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521017600
00000100:00100000:2.0:1789760770.071038:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521017600
00000100:00100000:2.0:1789760770.071096:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741663652455 time 741700601426 state 0x0 ref 1
00000100:00100000:2.0:1789760770.071111:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741700861842 time 741700601426 state 0x1 ref 1
00000100:00100000:2.0:1789760770.071251:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741700861842 time 741757932089 state 0x0 ref 1
00000100:00100000:2.0:1789760770.071275:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521017600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760770.071849:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24182784, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:1.0:1789760770.071861:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.071877:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:1.0:1789760770.071882:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760770.071889:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.071903:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760770.111255:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973224 is committed
00002000:00010000:1.0:1789760770.111720:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24182784 -> 24186880
00010000:00010000:1.0:1789760770.111736:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.111750:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.111760:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.111768:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760770.111773:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.111784:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.111804:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.111812:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d451 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24182784->24186879] (req 24182784->24186879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760770.111901:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521017600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40624us (41187us total) trans 4294973224 rc 0/0
00000100:00100000:1.0:1789760770.111912:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5937
00000100:00100000:1.0:1789760770.111921:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741700861842 time 741757932089 state 0x2 ref 0
00000100:00100000:0.0:1789760770.115887:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760770.115969:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521017728
00000100:00100000:3.0:1789760770.115979:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521017728
00000100:00100000:3.0:1789760770.116031:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741700861842 time 741757932089 state 0x0 ref 1
00000100:00100000:3.0:1789760770.116046:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741758192505 time 741757932089 state 0x1 ref 1
00000100:00100000:3.0:1789760770.116083:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741758192505 time 741802765738 state 0x0 ref 1
00000100:00100000:3.0:1789760770.116096:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521017728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760770.116140:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24186880, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:3.0:1789760770.116149:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.116165:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:3.0:1789760770.116170:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760770.116176:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.116189:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760770.146950:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973225 is committed
00002000:00010000:3.0:1789760770.147044:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24186880 -> 24190976
00010000:00010000:3.0:1789760770.147181:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.147195:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.147208:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.147216:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760770.147222:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.147231:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.147251:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.147259:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d458 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24186880->24190975] (req 24186880->24190975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760770.147474:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521017728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31375us (31592us total) trans 4294973225 rc 0/0
00000100:00100000:3.0:1789760770.147484:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5938
00000100:00100000:3.0:1789760770.147494:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741758192505 time 741802765738 state 0x2 ref 0
00000100:00100000:2.0:1789760770.152424:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.152521:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521017856
00000100:00100000:0.0:1789760770.152542:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521017856
00000100:00100000:0.0:1789760770.152597:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741758192505 time 741802765738 state 0x0 ref 1
00000100:00100000:0.0:1789760770.152687:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741803026154 time 741802765738 state 0x1 ref 1
00000100:00100000:0.0:1789760770.152765:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741803026154 time 741839446435 state 0x0 ref 1
00000100:00100000:0.0:1789760770.152781:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521017856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.152835:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24190976, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760770.152844:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.152861:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:0.0:1789760770.152866:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.152873:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.152888:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760770.183682:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973226 is committed
00002000:00010000:0.0:1789760770.183780:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24190976 -> 24195072
00010000:00010000:0.0:1789760770.183796:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.183810:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.183821:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.183828:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.183833:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.183842:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.183862:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.183869:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d45f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24190976->24195071] (req 24190976->24195071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.183956:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521017856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31175us (31536us total) trans 4294973226 rc 0/0
00000100:00100000:0.0:1789760770.183967:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5939
00000100:00100000:0.0:1789760770.183977:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741803026154 time 741839446435 state 0x2 ref 0
00000100:00100000:2.0:1789760770.189753:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760770.189880:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521017984
00000100:00100000:1.0:1789760770.189890:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521017984
00000100:00100000:1.0:1789760770.189939:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741803026154 time 741839446435 state 0x0 ref 1
00000100:00100000:1.0:1789760770.189954:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741839706851 time 741839446435 state 0x1 ref 1
00000100:00100000:1.0:1789760770.190023:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741839706851 time 741876705404 state 0x0 ref 1
00000100:00100000:1.0:1789760770.190036:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521017984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760770.190080:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24195072, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:1.0:1789760770.190088:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.190112:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:1.0:1789760770.190117:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760770.190123:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.190138:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760770.234659:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973227 is committed
00002000:00010000:0.0:1789760770.235024:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24195072 -> 24199168
00010000:00010000:0.0:1789760770.235042:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.235110:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.235120:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.235129:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.235134:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.235144:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.235162:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.235171:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d466 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24195072->24199167] (req 24195072->24199167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.235270:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521017984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45232us (45522us total) trans 4294973227 rc 0/0
00000100:00100000:0.0:1789760770.235281:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5940
00000100:00100000:0.0:1789760770.235291:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741839706851 time 741876705404 state 0x2 ref 0
00000100:00100000:2.0:1789760770.243269:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760770.243480:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521018112
00000100:00100000:1.0:1789760770.243491:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521018112
00000100:00100000:1.0:1789760770.243553:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741839706851 time 741876705404 state 0x0 ref 1
00000100:00100000:1.0:1789760770.243567:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741876965820 time 741876705404 state 0x1 ref 1
00000100:00100000:1.0:1789760770.243603:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741876965820 time 741930285491 state 0x0 ref 1
00000100:00100000:1.0:1789760770.243616:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521018112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760770.243661:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24199168, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:1.0:1789760770.243671:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.243686:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:1.0:1789760770.243691:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760770.243698:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.243711:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760770.288787:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973228 is committed
00002000:00010000:1.0:1789760770.288945:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24199168 -> 24203264
00010000:00010000:1.0:1789760770.288960:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.288973:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.288983:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.288991:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760770.288995:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.289004:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.289024:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.289032:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d46d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24199168->24203263] (req 24199168->24203263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760770.289228:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521018112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45609us (45965us total) trans 4294973228 rc 0/0
00000100:00100000:1.0:1789760770.289723:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5941
00000100:00100000:1.0:1789760770.289733:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741876965820 time 741930285491 state 0x2 ref 0
00000100:00100000:2.0:1789760770.295983:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760770.296166:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521018240
00000100:00100000:3.0:1789760770.296176:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521018240
00000100:00100000:3.0:1789760770.296226:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741876965820 time 741930285491 state 0x0 ref 1
00000100:00100000:3.0:1789760770.296306:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741930545907 time 741930285491 state 0x1 ref 1
00000100:00100000:3.0:1789760770.296394:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741930545907 time 741983075356 state 0x0 ref 1
00000100:00100000:3.0:1789760770.296408:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521018240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760770.296453:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24203264, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:3.0:1789760770.296462:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.296478:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=741s v=(0 0)
00010000:00010000:3.0:1789760770.296482:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760770.296488:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.296501:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760770.335441:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973229 is committed
00002000:00010000:0.0:1789760770.335673:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24203264 -> 24207360
00010000:00010000:0.0:1789760770.335688:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.335701:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.335709:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.335717:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.335721:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.335730:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.335752:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.335761:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d474 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24203264->24207359] (req 24203264->24207359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.335937:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521018240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39527us (39958us total) trans 4294973229 rc 0/0
00000100:00100000:0.0:1789760770.335948:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5942
00000100:00100000:0.0:1789760770.335958:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741930545907 time 741983075356 state 0x2 ref 0
00000100:00100000:2.0:1789760770.340673:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.340743:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521018368
00000100:00100000:0.0:1789760770.340753:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521018368
00000100:00100000:0.0:1789760770.340806:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741930545907 time 741983075356 state 0x0 ref 1
00000100:00100000:0.0:1789760770.340820:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741983335772 time 741983075356 state 0x1 ref 1
00000100:00100000:0.0:1789760770.340850:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741983335772 time 742027533281 state 0x0 ref 1
00000100:00100000:0.0:1789760770.340862:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521018368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.340918:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24207360, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760770.340927:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.340942:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760770.340947:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.340952:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.340965:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760770.386198:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24207360 -> 24211456
00010000:00010000:0.0:1789760770.386218:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760770.386219:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973230 is committed
00010000:00010000:0.0:1789760770.386236:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.386256:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.386264:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.386269:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.386277:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.386296:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.386303:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d47b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24207360->24211455] (req 24207360->24211455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.386427:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521018368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45561us (45759us total) trans 4294973230 rc 0/0
00000100:00100000:0.0:1789760770.386438:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5943
00000100:00100000:0.0:1789760770.386446:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741983335772 time 742027533281 state 0x2 ref 0
00000100:00100000:2.0:1789760770.389931:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.390056:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521018496
00000100:00100000:0.0:1789760770.390067:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521018496
00000100:00100000:0.0:1789760770.390130:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 741983335772 time 742027533281 state 0x0 ref 1
00000100:00100000:0.0:1789760770.390144:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742027793697 time 742027533281 state 0x1 ref 1
00000100:00100000:0.0:1789760770.390177:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742027793697 time 742076859567 state 0x0 ref 1
00000100:00100000:0.0:1789760770.390189:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521018496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.390237:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24211456, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760770.390246:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.390262:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760770.390266:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.390272:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.390284:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760770.426760:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24211456 -> 24215552
00010000:00010000:1.0:1789760770.426780:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.426795:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.426805:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.426813:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760770.426818:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.426828:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.426848:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.426856:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d482 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24211456->24215551] (req 24211456->24215551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760770.426947:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521018496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36754us (37020us total) trans 4294973231 rc 0/0
00000100:00100000:1.0:1789760770.426957:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5944
00000100:00100000:1.0:1789760770.426965:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742027793697 time 742076859567 state 0x2 ref 0
00000001:00080000:0.0:1789760770.427593:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973231 is committed
00000100:00100000:2.0:1789760770.431747:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760770.436340:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521018624
00000100:00100000:1.0:1789760770.436355:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521018624
00000100:00100000:1.0:1789760770.436416:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742027793697 time 742076859567 state 0x0 ref 1
00000100:00100000:1.0:1789760770.436431:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742077119983 time 742076859567 state 0x1 ref 1
00000100:00100000:1.0:1789760770.436749:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742077119983 time 742123430099 state 0x0 ref 1
00000100:00100000:1.0:1789760770.436763:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521018624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760770.436810:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24215552, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:1.0:1789760770.436819:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.436835:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:1.0:1789760770.436839:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760770.436845:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.436858:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760770.500467:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24215552 -> 24219648
00010000:00010000:1.0:1789760770.500487:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.500500:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.500509:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.500517:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760770.500530:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.500540:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.500558:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.500566:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d489 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24215552->24219647] (req 24215552->24219647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760770.500646:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521018624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63881us (68903us total) trans 4294973232 rc 0/0
00000100:00100000:1.0:1789760770.500659:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5945
00000100:00100000:1.0:1789760770.500669:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742077119983 time 742123430099 state 0x2 ref 0
00000001:00080000:0.0:1789760770.504395:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973232 is committed
00000100:00100000:1.0:1789760770.505561:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.505858:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521018752
00000100:00100000:0.0:1789760770.505868:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521018752
00000100:00100000:0.0:1789760770.505923:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742077119983 time 742123430099 state 0x0 ref 1
00000100:00100000:0.0:1789760770.505937:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742123690515 time 742123430099 state 0x1 ref 1
00000100:00100000:0.0:1789760770.505971:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742123690515 time 742192653815 state 0x0 ref 1
00000100:00100000:0.0:1789760770.505984:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521018752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.506031:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24219648, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760770.506040:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.506066:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760770.506072:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.506212:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.506230:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760770.542856:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973233 is committed
00002000:00010000:0.0:1789760770.543031:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24219648 -> 24223744
00010000:00010000:0.0:1789760770.543043:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.544194:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.544206:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.544214:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.544220:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.544230:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.544250:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.544257:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d490 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24219648->24223743] (req 24219648->24223743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.544399:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521018752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38412us (38837us total) trans 4294973233 rc 0/0
00000100:00100000:0.0:1789760770.544409:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5946
00000100:00100000:0.0:1789760770.544418:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742123690515 time 742192653815 state 0x2 ref 0
00000100:00100000:2.0:1789760770.553358:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.553450:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521018880
00000100:00100000:0.0:1789760770.553468:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521018880
00000100:00100000:0.0:1789760770.553531:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742123690515 time 742192653815 state 0x0 ref 1
00000100:00100000:0.0:1789760770.553547:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742192914231 time 742192653815 state 0x1 ref 1
00000100:00100000:0.0:1789760770.553575:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742192914231 time 742240257232 state 0x0 ref 1
00000100:00100000:0.0:1789760770.553586:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521018880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.553634:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24223744, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760770.553644:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.553660:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760770.553674:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.553681:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.553695:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760770.617535:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760770.641400:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973234 is committed
00002000:00010000:1.0:1789760770.641622:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24223744 -> 24227840
00010000:00010000:1.0:1789760770.641637:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.641649:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.641658:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.641664:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760770.641668:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.641677:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.641697:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.641704:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d497 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24223744->24227839] (req 24223744->24227839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760770.641834:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521018880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 88244us (88523us total) trans 4294973234 rc 0/0
00000100:00100000:1.0:1789760770.641844:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5947
00000100:00100000:1.0:1789760770.641853:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742192914231 time 742240257232 state 0x2 ref 0
00000100:00100000:3.0:1789760770.646272:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760770.648961:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521019008
00000100:00100000:1.0:1789760770.648976:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521019008
00000100:00100000:1.0:1789760770.649041:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742192914231 time 742240257232 state 0x0 ref 1
00000100:00100000:1.0:1789760770.649070:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742240517648 time 742240257232 state 0x1 ref 1
00000100:00100000:1.0:1789760770.649098:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742240517648 time 742335780673 state 0x0 ref 1
00000100:00100000:1.0:1789760770.649110:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521019008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760770.649161:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24227840, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:1.0:1789760770.649170:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.649188:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:1.0:1789760770.649192:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760770.649198:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.649210:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760770.684695:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:3.0:1789760770.684951:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548766336:0@lo:41:osp-pre-0-1.0
00000100:00100000:3.0:1789760770.685014:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760770.685220:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548766336
00000100:00100000:2.0:1789760770.685228:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548766336
00000100:00100000:2.0:1789760770.685302:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449
00000100:00100000:2.0:1789760770.685334:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548766336:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1789760770.685369:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:2.0:1789760770.685423:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548766336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (408us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760770.685430:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449
00000100:00100000:3.0:1789760770.685667:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548766336:0@lo:41:osp-pre-0-1.0
00000001:00080000:2.0:1789760770.689981:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973235 is committed
00002000:00010000:0.0:1789760770.690292:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24227840 -> 24231936
00010000:00010000:0.0:1789760770.690307:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.690347:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.690357:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.690365:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.690370:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.690380:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.690406:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.690415:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d49e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24227840->24231935] (req 24227840->24231935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.690496:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521019008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41383us (44227us total) trans 4294973235 rc 0/0
00000100:00100000:0.0:1789760770.690506:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5948
00000100:00100000:0.0:1789760770.690516:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742240517648 time 742335780673 state 0x2 ref 0
00000100:00100000:2.0:1789760770.693720:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760770.693803:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521019136
00000100:00100000:3.0:1789760770.693812:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521019136
00000100:00100000:3.0:1789760770.693873:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742240517648 time 742335780673 state 0x0 ref 1
00000100:00100000:3.0:1789760770.693889:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742336041089 time 742335780673 state 0x1 ref 1
00000100:00100000:3.0:1789760770.693918:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742336041089 time 742380600526 state 0x0 ref 1
00000100:00100000:3.0:1789760770.693929:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521019136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760770.693972:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24231936, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:3.0:1789760770.693981:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.693996:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:3.0:1789760770.694000:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760770.694014:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.694028:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760770.723741:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24231936 -> 24236032
00010000:00010000:3.0:1789760770.723761:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.723773:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.723781:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.723789:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760770.723794:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.723802:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.723821:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.723827:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24231936->24236031] (req 24231936->24236031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760770.723923:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521019136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29990us (30208us total) trans 4294973236 rc 0/0
00000100:00100000:3.0:1789760770.723933:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5949
00000100:00100000:3.0:1789760770.723942:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742336041089 time 742380600526 state 0x2 ref 0
00000001:00080000:0.0:1789760770.727238:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973236 is committed
00000100:00100000:2.0:1789760770.728408:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.728772:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521019264
00000100:00100000:0.0:1789760770.728781:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521019264
00000100:00100000:0.0:1789760770.728828:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742336041089 time 742380600526 state 0x0 ref 1
00000100:00100000:0.0:1789760770.728843:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742380860942 time 742380600526 state 0x1 ref 1
00000100:00100000:0.0:1789760770.728874:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742380860942 time 742415556816 state 0x0 ref 1
00000100:00100000:0.0:1789760770.728885:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521019264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.728927:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24236032, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760770.728936:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.728957:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760770.728961:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.728967:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.728981:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760770.755451:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24236032 -> 24240128
00010000:00010000:3.0:1789760770.755469:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.755482:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.755498:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.755506:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760770.755511:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.755529:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.755548:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.755556:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60d4ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24236032->24240127] (req 24236032->24240127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760770.755647:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521019264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26757us (27239us total) trans 4294973237 rc 0/0
00000100:00100000:3.0:1789760770.755657:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5950
00000100:00100000:3.0:1789760770.755667:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742380860942 time 742415556816 state 0x2 ref 0
00000001:00080000:2.0:1789760770.756528:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973237 is committed
00000100:00100000:2.0:1789760770.766820:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760770.770308:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521019392
00000100:00100000:1.0:1789760770.770337:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521019392
00000100:00100000:1.0:1789760770.770473:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742380860942 time 742415556816 state 0x0 ref 1
00000100:00100000:1.0:1789760770.770491:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742415817232 time 742415556816 state 0x1 ref 1
00000100:00100000:3.0:1789760770.771883:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742415817232 time 742458556301 state 0x0 ref 1
00000100:00100000:3.0:1789760770.771909:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521019392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760770.771964:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24240128, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:3.0:1789760770.771974:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.772064:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:3.0:1789760770.772068:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760770.772075:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.772089:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760770.799970:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973238 is committed
00002000:00010000:0.0:1789760770.800046:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24240128 -> 24244224
00010000:00010000:0.0:1789760770.800114:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.800128:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.800139:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.800147:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.800152:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.800161:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.800179:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.800188:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d4b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24240128->24244223] (req 24240128->24244223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.800385:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521019392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28411us (33499us total) trans 4294973238 rc 0/0
00000100:00100000:0.0:1789760770.800397:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5951
00000100:00100000:0.0:1789760770.800405:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742415817232 time 742458556301 state 0x2 ref 0
00000100:00100000:0.0:1789760770.810598:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760770.810707:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521019520
00000100:00100000:1.0:1789760770.810718:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521019520
00000100:00100000:1.0:1789760770.810768:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742415817232 time 742458556301 state 0x0 ref 1
00000100:00100000:1.0:1789760770.810784:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742458816717 time 742458556301 state 0x1 ref 1
00000100:00100000:1.0:1789760770.810813:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742458816717 time 742497495739 state 0x0 ref 1
00000100:00100000:1.0:1789760770.810826:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521019520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760770.810870:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24244224, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:1.0:1789760770.810879:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.810894:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:1.0:1789760770.810899:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760770.810906:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760770.810921:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760770.845965:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973239 is committed
00002000:00010000:0.0:1789760770.846073:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24244224 -> 24248320
00010000:00010000:0.0:1789760770.846089:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.846102:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.846111:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.846119:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.846123:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.846132:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.846279:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.846289:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d4ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24244224->24248319] (req 24244224->24248319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.846418:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521019520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35588us (35823us total) trans 4294973239 rc 0/0
00000100:00100000:0.0:1789760770.846428:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5952
00000100:00100000:0.0:1789760770.846438:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742458816717 time 742497495739 state 0x2 ref 0
00000100:00100000:2.0:1789760770.850682:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.850778:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521019648
00000100:00100000:0.0:1789760770.850787:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521019648
00000100:00100000:0.0:1789760770.850840:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742458816717 time 742497495739 state 0x0 ref 1
00000100:00100000:0.0:1789760770.850856:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742497756155 time 742497495739 state 0x1 ref 1
00000100:00100000:0.0:1789760770.850922:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742497756155 time 742537603754 state 0x0 ref 1
00000100:00100000:0.0:1789760770.850935:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521019648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.850982:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24248320, mtime: 0x6aad9503, atime: 0x0, ctime: 0x6aad9503, blocks: 0xc007
00010000:00010000:0.0:1789760770.850991:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.851007:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760770.851012:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.851018:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.851030:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760770.884623:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24248320 -> 24252416
00002000:00010000:2.0:1789760770.884634:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760771 -> 1789760772
00002000:00010000:2.0:1789760770.884637:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760771 -> 1789760772
00010000:00010000:2.0:1789760770.884649:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760770.884662:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760770.884677:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760770.884684:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760770.884688:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760770.884698:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760770.884718:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760770.884727:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d4c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24248320->24252415] (req 24248320->24252415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760770.884819:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521019648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33882us (34141us total) trans 4294973240 rc 0/0
00000100:00100000:2.0:1789760770.884830:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5953
00000100:00100000:2.0:1789760770.884839:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742497756155 time 742537603754 state 0x2 ref 0
00000001:00080000:3.0:1789760770.885875:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973240 is committed
00000100:00100000:1.0:1789760770.888146:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760770.888340:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521019776
00000100:00100000:3.0:1789760770.888349:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521019776
00000100:00100000:3.0:1789760770.888400:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742497756155 time 742537603754 state 0x0 ref 1
00000100:00100000:3.0:1789760770.888415:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742537864170 time 742537603754 state 0x1 ref 1
00000100:00100000:3.0:1789760770.888442:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742537864170 time 742575124807 state 0x0 ref 1
00000100:00100000:3.0:1789760770.888455:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521019776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760770.888504:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24252416, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760770.888512:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.888543:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:3.0:1789760770.888548:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760770.888555:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.888567:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760770.941426:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24252416 -> 24256512
00010000:00010000:0.0:1789760770.941446:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.941459:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.941467:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.941476:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.941481:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.941491:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.941509:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.941517:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d4c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24252416->24256511] (req 24252416->24256511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.941616:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521019776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53158us (53474us total) trans 4294973241 rc 0/0
00000100:00100000:0.0:1789760770.941626:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5954
00000100:00100000:0.0:1789760770.941635:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742537864170 time 742575124807 state 0x2 ref 0
00000001:00080000:3.0:1789760770.941794:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973241 is committed
00000100:00100000:0.0:1789760770.945304:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760770.945502:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521019904
00000100:00100000:3.0:1789760770.945513:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521019904
00000100:00100000:3.0:1789760770.945580:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742537864170 time 742575124807 state 0x0 ref 1
00000100:00100000:3.0:1789760770.945595:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742575385223 time 742575124807 state 0x1 ref 1
00000100:00100000:3.0:1789760770.945677:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742575385223 time 742632358466 state 0x0 ref 1
00000100:00100000:3.0:1789760770.945690:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521019904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760770.945816:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24256512, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760770.945825:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.945842:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:3.0:1789760770.945846:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760770.945853:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760770.945872:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760770.979135:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973242 is committed
00002000:00010000:0.0:1789760770.979333:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24256512 -> 24260608
00010000:00010000:0.0:1789760770.979349:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.979362:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.979372:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.979381:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760770.979386:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.979395:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.979415:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.979427:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d4cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24256512->24260607] (req 24256512->24260607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760770.979530:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521019904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33828us (34221us total) trans 4294973242 rc 0/0
00000100:00100000:0.0:1789760770.979539:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5955
00000100:00100000:0.0:1789760770.979550:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742575385223 time 742632358466 state 0x2 ref 0
00000100:00100000:2.0:1789760770.987579:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760770.987774:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521020032
00000100:00100000:0.0:1789760770.987784:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521020032
00000100:00100000:0.0:1789760770.987838:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742575385223 time 742632358466 state 0x0 ref 1
00000100:00100000:0.0:1789760770.987850:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742632618882 time 742632358466 state 0x1 ref 1
00000100:00100000:0.0:1789760770.987910:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742632618882 time 742674592159 state 0x0 ref 1
00000100:00100000:0.0:1789760770.987922:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521020032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760770.987967:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24260608, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:0.0:1789760770.987975:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.987992:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760770.987996:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760770.988002:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760770.988020:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760771.040017:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973243 is committed
00002000:00010000:0.0:1789760771.040291:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24260608 -> 24264704
00010000:00010000:0.0:1789760771.040308:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.040348:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.040358:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.040365:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760771.040370:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.040379:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.040399:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.040408:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24260608->24264703] (req 24260608->24264703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760771.040503:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521020032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52578us (52929us total) trans 4294973243 rc 0/0
00000100:00100000:0.0:1789760771.040515:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5956
00000100:00100000:0.0:1789760771.040534:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742632618882 time 742674592159 state 0x2 ref 0
00000100:00100000:1.0:1789760771.044820:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760771.045433:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521020160
00000100:00100000:2.0:1789760771.045444:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521020160
00000100:00100000:2.0:1789760771.045499:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742632618882 time 742674592159 state 0x0 ref 1
00000100:00100000:2.0:1789760771.045528:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742674852575 time 742674592159 state 0x1 ref 1
00000100:00100000:2.0:1789760771.045559:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742674852575 time 742732241143 state 0x0 ref 1
00000100:00100000:2.0:1789760771.045571:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521020160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760771.045617:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24264704, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:2.0:1789760771.045627:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.045643:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:2.0:1789760771.045648:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760771.045654:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.045667:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760771.084844:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973244 is committed
00002000:00010000:3.0:1789760771.084940:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24264704 -> 24268800
00010000:00010000:3.0:1789760771.084954:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.084968:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.084978:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.084986:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760771.084991:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.085000:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.085021:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.085029:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d4dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24264704->24268799] (req 24264704->24268799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760771.085130:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521020160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39557us (40316us total) trans 4294973244 rc 0/0
00000100:00100000:3.0:1789760771.085140:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5957
00000100:00100000:3.0:1789760771.085150:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742674852575 time 742732241143 state 0x2 ref 0
00000100:00100000:2.0:1789760771.089364:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760771.089459:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521020288
00000100:00100000:3.0:1789760771.089468:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521020288
00000100:00100000:3.0:1789760771.089531:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742674852575 time 742732241143 state 0x0 ref 1
00000100:00100000:3.0:1789760771.089546:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742732501559 time 742732241143 state 0x1 ref 1
00000100:00100000:3.0:1789760771.089566:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742732501559 time 742776249759 state 0x0 ref 1
00000100:00100000:3.0:1789760771.089578:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521020288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760771.089625:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24268800, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760771.089634:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.089650:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:3.0:1789760771.089655:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760771.089662:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.089676:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760771.116423:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973245 is committed
00002000:00010000:1.0:1789760771.116547:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24268800 -> 24272896
00010000:00010000:1.0:1789760771.116563:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.116575:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.116585:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.116592:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760771.116597:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.116606:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.116625:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.116634:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d4e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24268800->24272895] (req 24268800->24272895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760771.116731:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521020288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27150us (27372us total) trans 4294973245 rc 0/0
00000100:00100000:1.0:1789760771.116742:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5958
00000100:00100000:1.0:1789760771.116751:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742732501559 time 742776249759 state 0x2 ref 0
00000100:00100000:1.0:1789760771.122373:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.122493:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521020416
00000100:00100000:0.0:1789760771.122504:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521020416
00000100:00100000:0.0:1789760771.122567:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742732501559 time 742776249759 state 0x0 ref 1
00000100:00100000:0.0:1789760771.122980:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742776510175 time 742776249759 state 0x1 ref 1
00000100:00100000:0.0:1789760771.123018:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742776510175 time 742809700517 state 0x0 ref 1
00000100:00100000:0.0:1789760771.123033:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521020416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760771.123090:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24272896, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:0.0:1789760771.123099:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.123115:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760771.123120:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760771.123126:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.123140:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760771.171301:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973246 is committed
00002000:00010000:1.0:1789760771.171631:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24272896 -> 24276992
00010000:00010000:1.0:1789760771.171648:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.171661:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.171671:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.171678:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760771.171683:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.171691:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.171711:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.171724:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d4eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24272896->24276991] (req 24272896->24276991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760771.171854:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521020416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48819us (49486us total) trans 4294973246 rc 0/0
00000100:00100000:1.0:1789760771.171864:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5959
00000100:00100000:1.0:1789760771.171873:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742776510175 time 742809700517 state 0x2 ref 0
00000100:00100000:2.0:1789760771.187990:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.188093:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521020544
00000100:00100000:0.0:1789760771.188103:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521020544
00000100:00100000:0.0:1789760771.188156:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742776510175 time 742809700517 state 0x0 ref 1
00000100:00100000:0.0:1789760771.188171:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742809960933 time 742809700517 state 0x1 ref 1
00000100:00100000:0.0:1789760771.188248:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742809960933 time 742874930075 state 0x0 ref 1
00000100:00100000:0.0:1789760771.188260:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521020544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760771.188308:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24276992, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:0.0:1789760771.188357:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.188372:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:0.0:1789760771.188376:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760771.188382:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.188396:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760771.264818:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973247 is committed
00002000:00010000:0.0:1789760771.264916:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24276992 -> 24281088
00010000:00010000:0.0:1789760771.264932:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.264952:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.264962:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.264969:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760771.264975:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.264985:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.265005:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.265012:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d4f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24276992->24281087] (req 24276992->24281087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760771.265205:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521020544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 76941us (77220us total) trans 4294973247 rc 0/0
00000100:00100000:0.0:1789760771.265216:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5960
00000100:00100000:0.0:1789760771.265225:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742809960933 time 742874930075 state 0x2 ref 0
00000100:00100000:2.0:1789760771.274367:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760771.276772:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521020672
00000100:00100000:3.0:1789760771.276786:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521020672
00000100:00100000:3.0:1789760771.276852:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742809960933 time 742874930075 state 0x0 ref 1
00000100:00100000:3.0:1789760771.276869:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742875190491 time 742874930075 state 0x1 ref 1
00000100:00100000:3.0:1789760771.276907:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742875190491 time 742963589007 state 0x0 ref 1
00000100:00100000:3.0:1789760771.276921:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521020672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760771.276973:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24281088, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760771.276983:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.276999:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=742s v=(0 0)
00010000:00010000:3.0:1789760771.277004:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760771.277011:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.277025:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760771.360777:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973248 is committed
00002000:00010000:1.0:1789760771.360952:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24281088 -> 24285184
00010000:00010000:1.0:1789760771.360968:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.360980:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.360990:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.360997:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760771.361002:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.361010:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.361036:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.361054:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d4f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24281088->24285183] (req 24281088->24285183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760771.361144:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521020672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 84222us (86829us total) trans 4294973248 rc 0/0
00000100:00100000:1.0:1789760771.361154:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5961
00000100:00100000:1.0:1789760771.361163:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742875190491 time 742963589007 state 0x2 ref 0
00000100:00100000:1.0:1789760771.367458:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760771.367554:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521020800
00000100:00100000:3.0:1789760771.367564:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521020800
00000100:00100000:3.0:1789760771.367631:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742875190491 time 742963589007 state 0x0 ref 1
00000100:00100000:3.0:1789760771.367645:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742963849423 time 742963589007 state 0x1 ref 1
00000100:00100000:3.0:1789760771.367672:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742963849423 time 743054355564 state 0x0 ref 1
00000100:00100000:3.0:1789760771.367683:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521020800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760771.367733:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24285184, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760771.367742:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.367759:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760771.367763:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760771.367769:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.367784:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760771.411449:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973249 is committed
00002000:00010000:2.0:1789760771.411672:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24285184 -> 24289280
00010000:00010000:2.0:1789760771.411687:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.411701:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.411710:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.411717:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760771.411723:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.411732:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.411751:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.411759:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d500 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24285184->24289279] (req 24285184->24289279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760771.411856:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521020800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44169us (44404us total) trans 4294973249 rc 0/0
00000100:00100000:2.0:1789760771.411866:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5962
00000100:00100000:2.0:1789760771.411875:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742963849423 time 743054355564 state 0x2 ref 0
00000100:00100000:3.0:1789760771.424219:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760771.424683:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521020928
00000100:00100000:1.0:1789760771.424692:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521020928
00000100:00100000:1.0:1789760771.424747:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 742963849423 time 743054355564 state 0x0 ref 1
00000100:00100000:1.0:1789760771.424764:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743054615980 time 743054355564 state 0x1 ref 1
00000100:00100000:1.0:1789760771.424798:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743054615980 time 743111480578 state 0x0 ref 1
00000100:00100000:1.0:1789760771.424811:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521020928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760771.424863:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24289280, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:1.0:1789760771.424873:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.424894:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:1.0:1789760771.424899:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760771.424905:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.424919:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760771.472816:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973250 is committed
00002000:00010000:3.0:1789760771.473004:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24289280 -> 24293376
00010000:00010000:3.0:1789760771.473021:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.473033:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.473048:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.473056:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760771.473060:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.473068:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.473088:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.473096:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d507 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24289280->24293375] (req 24289280->24293375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760771.473473:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521020928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48658us (49258us total) trans 4294973250 rc 0/0
00000100:00100000:3.0:1789760771.473484:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5963
00000100:00100000:3.0:1789760771.473494:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743054615980 time 743111480578 state 0x2 ref 0
00000100:00100000:1.0:1789760771.478752:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.478882:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521021056
00000100:00100000:0.0:1789760771.478892:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521021056
00000100:00100000:0.0:1789760771.478950:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743054615980 time 743111480578 state 0x0 ref 1
00000100:00100000:0.0:1789760771.478967:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743111740994 time 743111480578 state 0x1 ref 1
00000100:00100000:0.0:1789760771.479056:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743111740994 time 743165738248 state 0x0 ref 1
00000100:00100000:0.0:1789760771.479080:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521021056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760771.479125:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24293376, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:0.0:1789760771.479135:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.479151:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:0.0:1789760771.479155:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760771.479162:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.479177:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760771.539106:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24293376 -> 24297472
00010000:00010000:3.0:1789760771.539126:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.539154:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.539164:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.539183:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760771.539188:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.539198:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.539219:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.539227:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60d50e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24293376->24297471] (req 24293376->24297471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760771.539360:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521021056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60287us (60612us total) trans 4294973251 rc 0/0
00000100:00100000:3.0:1789760771.539372:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5964
00000100:00100000:3.0:1789760771.539382:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743111740994 time 743165738248 state 0x2 ref 0
00000001:00080000:2.0:1789760771.539431:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973251 is committed
00000100:00100000:1.0:1789760771.542972:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760771.543032:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521021184
00000100:00100000:3.0:1789760771.543039:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521021184
00000100:00100000:3.0:1789760771.543163:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743111740994 time 743165738248 state 0x0 ref 1
00000100:00100000:3.0:1789760771.543180:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743165998664 time 743165738248 state 0x1 ref 1
00000100:00100000:3.0:1789760771.543339:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743165998664 time 743229997577 state 0x0 ref 1
00000100:00100000:3.0:1789760771.543355:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521021184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760771.543404:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24297472, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760771.543413:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.543428:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760771.543432:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760771.543438:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.543452:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760771.583000:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973252 is committed
00002000:00010000:2.0:1789760771.585807:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24297472 -> 24301568
00010000:00010000:2.0:1789760771.585827:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.585841:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.585851:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.585858:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760771.585863:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.585872:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.585891:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.585899:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d515 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24297472->24301567] (req 24297472->24301567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760771.586007:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521021184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42650us (43038us total) trans 4294973252 rc 0/0
00000100:00100000:2.0:1789760771.586017:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5965
00000100:00100000:2.0:1789760771.586027:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743165998664 time 743229997577 state 0x2 ref 0
00000100:00100000:0.0:1789760771.591908:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760771.591982:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521021312
00000100:00100000:2.0:1789760771.591992:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521021312
00000100:00100000:2.0:1789760771.592044:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743165998664 time 743229997577 state 0x0 ref 1
00000100:00100000:2.0:1789760771.592069:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743230257993 time 743229997577 state 0x1 ref 1
00000100:00100000:2.0:1789760771.592096:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743230257993 time 743278778827 state 0x0 ref 1
00000100:00100000:2.0:1789760771.592108:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521021312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760771.592164:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24301568, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:2.0:1789760771.592174:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.592189:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:2.0:1789760771.592194:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760771.592200:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.592214:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760771.630066:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973253 is committed
00002000:00010000:3.0:1789760771.630230:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24301568 -> 24305664
00010000:00010000:3.0:1789760771.630246:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.630260:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.630277:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.630287:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760771.630292:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.630302:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.630354:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.630363:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d51c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24301568->24305663] (req 24301568->24305663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760771.630464:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521021312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38354us (38561us total) trans 4294973253 rc 0/0
00000100:00100000:3.0:1789760771.630474:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5966
00000100:00100000:3.0:1789760771.630483:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743230257993 time 743278778827 state 0x2 ref 0
00000100:00100000:0.0:1789760771.635112:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760771.635716:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521021440
00000100:00100000:1.0:1789760771.635727:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521021440
00000100:00100000:1.0:1789760771.635781:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743230257993 time 743278778827 state 0x0 ref 1
00000100:00100000:1.0:1789760771.635796:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743279039243 time 743278778827 state 0x1 ref 1
00000100:00100000:1.0:1789760771.635821:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743279039243 time 743322504170 state 0x0 ref 1
00000100:00100000:1.0:1789760771.635832:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521021440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760771.635880:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24305664, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:1.0:1789760771.635889:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.635904:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:1.0:1789760771.635909:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760771.635915:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760771.635928:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.643718:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760771.673267:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973254 is committed
00002000:00010000:3.0:1789760771.673374:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24305664 -> 24309760
00010000:00010000:3.0:1789760771.673390:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.673410:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.673420:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.673429:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760771.673434:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.673444:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.673462:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.673469:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d523 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24305664->24309759] (req 24305664->24309759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760771.673576:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521021440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37736us (38464us total) trans 4294973254 rc 0/0
00000100:00100000:3.0:1789760771.673587:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5967
00000100:00100000:3.0:1789760771.673597:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743279039243 time 743322504170 state 0x2 ref 0
00000100:00100000:2.0:1789760771.677825:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760771.677900:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521021568
00000100:00100000:3.0:1789760771.677910:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521021568
00000100:00100000:3.0:1789760771.677965:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743279039243 time 743322504170 state 0x0 ref 1
00000100:00100000:3.0:1789760771.677981:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743322764586 time 743322504170 state 0x1 ref 1
00000100:00100000:3.0:1789760771.678012:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743322764586 time 743364694113 state 0x0 ref 1
00000100:00100000:3.0:1789760771.678024:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521021568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760771.678083:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24309760, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760771.678092:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.678109:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760771.678113:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760771.678119:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.678134:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760771.705962:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:1.0:1789760771.705982:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd9df6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548766464:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1789760771.706105:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760771.706300:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548766464
00000100:00100000:0.0:1789760771.706309:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548766464
00000100:00100000:0.0:1789760771.706378:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450
00000100:00100000:0.0:1789760771.706388:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548766464:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:0.0:1789760771.706428:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:0.0:1789760771.706488:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548766464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (382us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760771.706495:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450
00000100:00100000:1.0:1789760771.706860:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd9df6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548766464:0@lo:41:osp-pre-1-0.0
00002000:00010000:3.0:1789760771.714547:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24309760 -> 24313856
00010000:00010000:3.0:1789760771.714566:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.714579:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.714595:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.714603:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760771.714608:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.714617:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.714636:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.714644:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d52a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24309760->24313855] (req 24309760->24313855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760771.714737:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521021568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36711us (36917us total) trans 4294973255 rc 0/0
00000100:00100000:3.0:1789760771.714748:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5968
00000100:00100000:3.0:1789760771.714758:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743322764586 time 743364694113 state 0x2 ref 0
00000001:00080000:1.0:1789760771.715559:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973255 is committed
00000100:00100000:0.0:1789760771.720453:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760771.720776:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521021696
00000100:00100000:2.0:1789760771.720786:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521021696
00000100:00100000:2.0:1789760771.720836:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743322764586 time 743364694113 state 0x0 ref 1
00000100:00100000:2.0:1789760771.720851:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743364954529 time 743364694113 state 0x1 ref 1
00000100:00100000:2.0:1789760771.720884:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743364954529 time 743407566481 state 0x0 ref 1
00000100:00100000:2.0:1789760771.720897:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521021696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760771.720944:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24313856, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:2.0:1789760771.720953:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.720969:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:2.0:1789760771.720974:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760771.720980:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.720995:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760771.757820:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973256 is committed
00002000:00010000:2.0:1789760771.757899:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24313856 -> 24317952
00010000:00010000:2.0:1789760771.757914:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.757928:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.757938:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.757947:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760771.757952:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.757962:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.757981:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.757989:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d531 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24313856->24317951] (req 24313856->24317951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760771.758233:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521021696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37334us (37786us total) trans 4294973256 rc 0/0
00000100:00100000:2.0:1789760771.758245:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5969
00000100:00100000:2.0:1789760771.758254:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743364954529 time 743407566481 state 0x2 ref 0
00000100:00100000:0.0:1789760771.762981:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760771.763117:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521021824
00000100:00100000:2.0:1789760771.763127:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521021824
00000100:00100000:2.0:1789760771.763289:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743364954529 time 743407566481 state 0x0 ref 1
00000100:00100000:2.0:1789760771.763305:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743407826897 time 743407566481 state 0x1 ref 1
00000100:00100000:2.0:1789760771.763394:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743407826897 time 743450075059 state 0x0 ref 1
00000100:00100000:2.0:1789760771.763407:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521021824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760771.763454:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24317952, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:2.0:1789760771.763464:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.763480:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:2.0:1789760771.763484:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760771.763490:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.763504:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760771.803224:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24317952 -> 24322048
00010000:00010000:3.0:1789760771.803245:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.803265:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.803275:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.803282:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760771.803287:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.803296:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.803351:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.803361:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d538 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24317952->24322047] (req 24317952->24322047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760771.803579:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521021824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40169us (40605us total) trans 4294973257 rc 0/0
00000100:00100000:3.0:1789760771.803590:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5970
00000100:00100000:3.0:1789760771.803599:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743407826897 time 743450075059 state 0x2 ref 0
00000001:00080000:0.0:1789760771.804857:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973257 is committed
00000100:00100000:1.0:1789760771.806986:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760771.807141:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521021952
00000100:00100000:3.0:1789760771.807150:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521021952
00000100:00100000:3.0:1789760771.807203:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743407826897 time 743450075059 state 0x0 ref 1
00000100:00100000:3.0:1789760771.807218:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743450335475 time 743450075059 state 0x1 ref 1
00000100:00100000:3.0:1789760771.807256:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743450335475 time 743493939463 state 0x0 ref 1
00000100:00100000:3.0:1789760771.807268:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521021952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760771.807340:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24322048, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760771.807349:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.807373:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760771.807378:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760771.807384:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.807399:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760771.838933:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24322048 -> 24326144
00010000:00010000:3.0:1789760771.838952:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.838966:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.838980:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.838987:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760771.838992:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.838999:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.839018:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.839025:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d53f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24322048->24326143] (req 24322048->24326143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760771.839116:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521021952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31845us (32132us total) trans 4294973258 rc 0/0
00000100:00100000:3.0:1789760771.839127:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5971
00000100:00100000:3.0:1789760771.839136:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743450335475 time 743493939463 state 0x2 ref 0
00000001:00080000:1.0:1789760771.839257:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973258 is committed
00000100:00100000:2.0:1789760771.844901:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760771.844950:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521022080
00000100:00100000:3.0:1789760771.844959:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521022080
00000100:00100000:3.0:1789760771.845012:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743450335475 time 743493939463 state 0x0 ref 1
00000100:00100000:3.0:1789760771.845027:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743494199879 time 743493939463 state 0x1 ref 1
00000100:00100000:3.0:1789760771.845065:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743494199879 time 743531748146 state 0x0 ref 1
00000100:00100000:3.0:1789760771.845079:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521022080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760771.845132:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24326144, mtime: 0x6aad9504, atime: 0x0, ctime: 0x6aad9504, blocks: 0xc007
00010000:00010000:3.0:1789760771.845152:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.845168:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760771.845173:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760771.845179:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.845192:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760771.873982:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973259 is committed
00002000:00010000:0.0:1789760771.874092:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24326144 -> 24330240
00002000:00010000:0.0:1789760771.874097:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760772 -> 1789760773
00002000:00010000:0.0:1789760771.874099:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760772 -> 1789760773
00010000:00010000:0.0:1789760771.874114:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.874127:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.874137:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.874145:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760771.874150:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.874160:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.874179:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.874188:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d546 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24326144->24330239] (req 24326144->24330239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760771.874352:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521022080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29236us (29422us total) trans 4294973259 rc 0/0
00000100:00100000:0.0:1789760771.874363:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5972
00000100:00100000:0.0:1789760771.874372:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743494199879 time 743531748146 state 0x2 ref 0
00000100:00100000:0.0:1789760771.881497:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760771.885249:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521022208
00000100:00100000:2.0:1789760771.885264:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521022208
00000100:00100000:0.0:1789760771.885785:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743494199879 time 743531748146 state 0x0 ref 1
00000100:00100000:0.0:1789760771.885802:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743532008562 time 743531748146 state 0x1 ref 1
00000100:00100000:0.0:1789760771.885885:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743532008562 time 743572567077 state 0x0 ref 1
00000100:00100000:0.0:1789760771.885910:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521022208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760771.885960:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24330240, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:0.0:1789760771.885969:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.885984:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:0.0:1789760771.885989:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760771.885996:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.886015:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760771.908574:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973260 is committed
00002000:00010000:0.0:1789760771.908803:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24330240 -> 24334336
00010000:00010000:0.0:1789760771.908817:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.908828:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.908837:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.908843:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760771.908848:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.908856:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.908875:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.908883:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d54d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24330240->24334335] (req 24330240->24334335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760771.908976:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521022208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23064us (27483us total) trans 4294973260 rc 0/0
00000100:00100000:0.0:1789760771.908986:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5973
00000100:00100000:0.0:1789760771.908996:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743532008562 time 743572567077 state 0x2 ref 0
00000100:00100000:1.0:1789760771.913070:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760771.913169:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521022336
00000100:00100000:2.0:1789760771.913180:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521022336
00000100:00100000:2.0:1789760771.913232:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743532008562 time 743572567077 state 0x0 ref 1
00000100:00100000:2.0:1789760771.913248:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743572827493 time 743572567077 state 0x1 ref 1
00000100:00100000:2.0:1789760771.913277:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743572827493 time 743599959374 state 0x0 ref 1
00000100:00100000:2.0:1789760771.913290:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521022336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760771.913381:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24334336, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:2.0:1789760771.913390:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.913406:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:2.0:1789760771.913410:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760771.913416:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.913430:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760771.934397:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.934429:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.934466:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.934495:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.934528:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.934553:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521022592
00000100:00100000:0.0:1789760771.934562:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521022592
00000100:00100000:0.0:1789760771.934617:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521022848
00000100:00100000:0.0:1789760771.934620:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521022848
00000100:00100000:0.0:1789760771.934636:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521022720
00000100:00100000:0.0:1789760771.934639:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521022720
00000100:00100000:0.0:1789760771.934652:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521022976
00000100:00100000:0.0:1789760771.934655:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521022976
00000100:00100000:0.0:1789760771.934673:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 933
00000100:00100000:0.0:1789760771.934684:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2405:x1876699521022592:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760771.934759:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2405:x1876699521022592:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (370us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760771.934766:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 933
00000100:00100000:0.0:1789760771.934785:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 934
00000100:00100000:0.0:1789760771.934791:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699521022848:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760771.934817:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699521022848:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760771.934824:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 934
00000100:00100000:0.0:1789760771.934836:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 935
00000100:00100000:0.0:1789760771.934841:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521022720:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760771.934861:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521022720:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 20us (367us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760771.934879:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 935
00000100:00100000:0.0:1789760771.934892:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 936
00000100:00100000:0.0:1789760771.934899:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699521022976:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760771.934921:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2405:x1876699521022976:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760771.934928:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 936
00000100:00100000:2.0:1789760771.935249:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521022464
00000100:00100000:2.0:1789760771.935255:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521022464
00000100:00100000:2.0:1789760771.935361:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 482
00000100:00100000:2.0:1789760771.935433:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd8372c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2405:x1876699521022464:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760771.935461:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd8372c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2405:x1876699521022464:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (994us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760771.935468:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 482
00000100:00080000:2.0:1789760771.935494:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:2.0:1789760771.935499:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00002000:00010000:2.0:1789760771.950018:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24334336 -> 24338432
00010000:00010000:2.0:1789760771.950048:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.950061:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.950071:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.950078:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760771.950084:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.950092:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.950112:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.950118:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d554 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24334336->24338431] (req 24334336->24338431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760771.950376:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521022336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37083us (37309us total) trans 4294973261 rc 0/0
00000100:00100000:2.0:1789760771.950387:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5974
00000100:00100000:2.0:1789760771.950396:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743572827493 time 743599959374 state 0x2 ref 0
00000001:00080000:3.0:1789760771.950481:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973261 is committed
00000100:00100000:1.0:1789760771.954221:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760771.954470:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521023104
00000100:00100000:3.0:1789760771.954480:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521023104
00000100:00100000:3.0:1789760771.954544:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743572827493 time 743599959374 state 0x0 ref 1
00000100:00100000:3.0:1789760771.954559:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743600219790 time 743599959374 state 0x1 ref 1
00000100:00100000:3.0:1789760771.954623:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743600219790 time 743641304516 state 0x0 ref 1
00000100:00100000:3.0:1789760771.954635:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521023104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760771.954683:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24338432, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760771.954691:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.954706:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760771.954711:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760771.954717:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760771.954731:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760771.981290:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973262 is committed
00002000:00010000:2.0:1789760771.981397:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24338432 -> 24342528
00010000:00010000:2.0:1789760771.981412:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.981425:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.981433:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.981445:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760771.981450:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.981460:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.981478:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760771.981486:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d55b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24338432->24342527] (req 24338432->24342527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760771.981687:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521023104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27048us (27471us total) trans 4294973262 rc 0/0
00000100:00100000:2.0:1789760771.981698:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5975
00000100:00100000:2.0:1789760771.981707:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743600219790 time 743641304516 state 0x2 ref 0
00000100:00100000:1.0:1789760771.985576:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760771.985659:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521023232
00000100:00100000:0.0:1789760771.985669:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521023232
00000100:00100000:0.0:1789760771.985726:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743600219790 time 743641304516 state 0x0 ref 1
00000100:00100000:0.0:1789760771.985742:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743641564932 time 743641304516 state 0x1 ref 1
00000100:00100000:0.0:1789760771.985810:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743641564932 time 743672491436 state 0x0 ref 1
00000100:00100000:0.0:1789760771.985825:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521023232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760771.985892:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24342528, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:0.0:1789760771.985902:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.985925:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:0.0:1789760771.985930:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760771.985938:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760771.985952:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760772.015208:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973263 is committed
00002000:00010000:3.0:1789760772.015371:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24342528 -> 24346624
00010000:00010000:3.0:1789760772.015391:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.015405:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.015414:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.015421:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.015426:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.015436:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.015457:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.015465:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d562 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24342528->24346623] (req 24342528->24346623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.015605:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521023232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29778us (30033us total) trans 4294973263 rc 0/0
00000100:00100000:3.0:1789760772.015617:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5976
00000100:00100000:3.0:1789760772.015626:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743641564932 time 743672491436 state 0x2 ref 0
00000100:00100000:0.0:1789760772.019271:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.019400:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521023360
00000100:00100000:2.0:1789760772.019410:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521023360
00000100:00100000:2.0:1789760772.019482:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743641564932 time 743672491436 state 0x0 ref 1
00000100:00100000:2.0:1789760772.019497:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743672751852 time 743672491436 state 0x1 ref 1
00000100:00100000:2.0:1789760772.019533:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743672751852 time 743706215915 state 0x0 ref 1
00000100:00100000:2.0:1789760772.019550:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521023360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760772.019597:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24346624, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:2.0:1789760772.019607:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.019623:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:2.0:1789760772.019628:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760772.019633:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.019646:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760772.020146:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760772.049341:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973264 is committed
00002000:00010000:3.0:1789760772.049492:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24346624 -> 24350720
00010000:00010000:3.0:1789760772.049506:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.049529:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.049538:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.049545:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.049550:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.049565:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.049582:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.049589:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d569 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24346624->24350719] (req 24346624->24350719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.049763:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521023360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30211us (30497us total) trans 4294973264 rc 0/0
00000100:00100000:3.0:1789760772.049774:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5977
00000100:00100000:3.0:1789760772.049782:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743672751852 time 743706215915 state 0x2 ref 0
00000100:00100000:1.0:1789760772.056901:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.058062:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521023488
00000100:00100000:2.0:1789760772.058074:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521023488
00000100:00100000:0.0:1789760772.058205:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743672751852 time 743706215915 state 0x0 ref 1
00000100:00100000:0.0:1789760772.058223:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743706476331 time 743706215915 state 0x1 ref 1
00000100:00100000:0.0:1789760772.058257:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743706476331 time 743744939166 state 0x0 ref 1
00000100:00100000:0.0:1789760772.058270:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521023488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760772.058381:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24350720, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:0.0:1789760772.058390:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.058405:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:0.0:1789760772.058409:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760772.058415:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.058429:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760772.107744:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24350720 -> 24354816
00010000:00010000:3.0:1789760772.107763:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.107776:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.107785:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.107792:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.107798:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.107808:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.107826:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.107834:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d570 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24350720->24354815] (req 24350720->24354815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.107922:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521023488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49651us (51028us total) trans 4294973265 rc 0/0
00000100:00100000:3.0:1789760772.107932:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5978
00000100:00100000:3.0:1789760772.107941:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743706476331 time 743744939166 state 0x2 ref 0
00000001:00080000:1.0:1789760772.108127:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973265 is committed
00000100:00100000:1.0:1789760772.118683:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.118757:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521023616
00000100:00100000:3.0:1789760772.118768:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521023616
00000100:00100000:3.0:1789760772.118822:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743706476331 time 743744939166 state 0x0 ref 1
00000100:00100000:3.0:1789760772.118838:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743745199582 time 743744939166 state 0x1 ref 1
00000100:00100000:3.0:1789760772.118876:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743745199582 time 743805558204 state 0x0 ref 1
00000100:00100000:3.0:1789760772.118889:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521023616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.118935:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24354816, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.118945:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.118961:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760772.118965:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.118971:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.118985:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760772.147601:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973266 is committed
00002000:00010000:3.0:1789760772.147698:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24354816 -> 24358912
00010000:00010000:3.0:1789760772.147713:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.147726:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.147736:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.147744:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.147748:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.147757:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.147781:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.147788:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d577 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24354816->24358911] (req 24354816->24358911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.147882:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521023616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28991us (29203us total) trans 4294973266 rc 0/0
00000100:00100000:3.0:1789760772.147892:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5979
00000100:00100000:3.0:1789760772.147901:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743745199582 time 743805558204 state 0x2 ref 0
00000100:00100000:0.0:1789760772.153233:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.153354:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521023744
00000100:00100000:3.0:1789760772.153365:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521023744
00000100:00100000:3.0:1789760772.153427:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743745199582 time 743805558204 state 0x0 ref 1
00000100:00100000:3.0:1789760772.153460:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743805818620 time 743805558204 state 0x1 ref 1
00000100:00100000:3.0:1789760772.153481:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743805818620 time 743840164756 state 0x0 ref 1
00000100:00100000:3.0:1789760772.153493:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521023744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.153551:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24358912, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.153560:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.153577:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760772.153582:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.153587:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.153600:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760772.176022:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973267 is committed
00002000:00010000:0.0:1789760772.176215:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24358912 -> 24363008
00010000:00010000:0.0:1789760772.176229:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.176353:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.176362:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.176371:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760772.176376:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.176386:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.176464:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.176471:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d57e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24358912->24363007] (req 24358912->24363007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760772.176573:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521023744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23076us (23345us total) trans 4294973267 rc 0/0
00000100:00100000:0.0:1789760772.176584:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5980
00000100:00100000:0.0:1789760772.176594:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743805818620 time 743840164756 state 0x2 ref 0
00000100:00100000:1.0:1789760772.182080:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.183111:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521023872
00000100:00100000:2.0:1789760772.183124:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521023872
00000100:00100000:2.0:1789760772.183186:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743805818620 time 743840164756 state 0x0 ref 1
00000100:00100000:2.0:1789760772.183201:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743840425172 time 743840164756 state 0x1 ref 1
00000100:00100000:2.0:1789760772.183239:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743840425172 time 743869921112 state 0x0 ref 1
00000100:00100000:2.0:1789760772.183252:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521023872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760772.183306:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24363008, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:2.0:1789760772.183393:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.183410:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:2.0:1789760772.183414:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760772.183421:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.183434:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760772.217489:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc892b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548766592:0@lo:13:osp-pre-0-0.0
00000100:00100000:0.0:1789760772.217715:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760772.218695:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789760772.218709:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548766720:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1789760772.218750:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760772.218805:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548766592
00000100:00100000:2.0:1789760772.218812:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548766592
00000100:00100000:2.0:1789760772.218858:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548766720
00000100:00100000:2.0:1789760772.218861:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548766720
00000100:00100000:2.0:1789760772.218876:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382
00000100:00100000:2.0:1789760772.218883:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548766592:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1789760772.218903:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527499264 pending 1703936 free 3833593856 avail 3811573760
00000100:00100000:2.0:1789760772.218945:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548766592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1231us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760772.218952:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382
00000100:00100000:2.0:1789760772.218969:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383
00000100:00100000:2.0:1789760772.218976:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548766720:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1789760772.218989:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527499264 pending 1703936 free 3833593856 avail 3811573760
00000100:00080000:0.0:1789760772.219145:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789760772.219771:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548766720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 793us (1018us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760772.219780:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383
00000100:00100000:2.0:1789760772.219831:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548766720:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1789760772.219848:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc892b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548766592:0@lo:13:osp-pre-0-0.0
00000001:00080000:1.0:1789760772.246370:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973268 is committed
00002000:00010000:0.0:1789760772.246466:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24363008 -> 24367104
00010000:00010000:0.0:1789760772.246483:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.246495:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.246504:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.246522:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760772.246527:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.246536:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.246560:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.246569:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d585 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24363008->24367103] (req 24363008->24367103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760772.246652:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521023872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63400us (64586us total) trans 4294973268 rc 0/0
00000100:00100000:0.0:1789760772.246661:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5981
00000100:00100000:0.0:1789760772.246670:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743840425172 time 743869921112 state 0x2 ref 0
00000100:00100000:1.0:1789760772.255564:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760772.255652:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521024000
00000100:00100000:0.0:1789760772.255662:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521024000
00000100:00100000:0.0:1789760772.255712:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743840425172 time 743869921112 state 0x0 ref 1
00000100:00100000:0.0:1789760772.255727:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743870181528 time 743869921112 state 0x1 ref 1
00000100:00100000:0.0:1789760772.255761:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743870181528 time 743942444521 state 0x0 ref 1
00000100:00100000:0.0:1789760772.255773:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521024000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760772.255821:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24367104, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:0.0:1789760772.255829:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.255843:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:0.0:1789760772.255847:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760772.255853:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.255866:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760772.300962:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973269 is committed
00002000:00010000:3.0:1789760772.301127:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24367104 -> 24371200
00010000:00010000:3.0:1789760772.301142:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.301209:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.301221:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.301229:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.301234:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.301244:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.301263:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.301271:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d58c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24367104->24371199] (req 24367104->24371199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.301505:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521024000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45727us (45946us total) trans 4294973269 rc 0/0
00000100:00100000:3.0:1789760772.301525:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5982
00000100:00100000:3.0:1789760772.301536:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743870181528 time 743942444521 state 0x2 ref 0
00000100:00100000:1.0:1789760772.304757:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.304839:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521024128
00000100:00100000:3.0:1789760772.304848:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521024128
00000100:00100000:3.0:1789760772.304902:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743870181528 time 743942444521 state 0x0 ref 1
00000100:00100000:3.0:1789760772.304917:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743942704937 time 743942444521 state 0x1 ref 1
00000100:00100000:3.0:1789760772.304994:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743942704937 time 743991675680 state 0x0 ref 1
00000100:00100000:3.0:1789760772.305007:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521024128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.305064:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24371200, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.305074:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.305089:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=743s v=(0 0)
00010000:00010000:3.0:1789760772.305093:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.305099:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.305113:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760772.337788:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973270 is committed
00002000:00010000:3.0:1789760772.337928:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24371200 -> 24375296
00010000:00010000:3.0:1789760772.337944:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.337958:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.337968:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.337975:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.337981:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.337990:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.338010:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.338018:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d593 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24371200->24375295] (req 24371200->24375295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.338113:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521024128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33104us (33360us total) trans 4294973270 rc 0/0
00000100:00100000:3.0:1789760772.338128:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5983
00000100:00100000:3.0:1789760772.338137:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743942704937 time 743991675680 state 0x2 ref 0
00000100:00100000:1.0:1789760772.343017:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.343271:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521024256
00000100:00100000:3.0:1789760772.343282:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521024256
00000100:00100000:3.0:1789760772.343369:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743942704937 time 743991675680 state 0x0 ref 1
00000100:00100000:3.0:1789760772.343384:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743991936096 time 743991675680 state 0x1 ref 1
00000100:00100000:3.0:1789760772.343405:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743991936096 time 744030088125 state 0x0 ref 1
00000100:00100000:3.0:1789760772.343417:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521024256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.343465:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24375296, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.343475:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.343490:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:3.0:1789760772.343495:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.343502:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.344498:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760772.391949:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973271 is committed
00002000:00010000:3.0:1789760772.392266:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24375296 -> 24379392
00010000:00010000:3.0:1789760772.392281:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.392294:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.392305:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.392386:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.392391:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.392401:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.392420:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.392429:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d59a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24375296->24379391] (req 24375296->24379391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760772.392627:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521024256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49206us (49613us total) trans 4294973271 rc 0/0
00000100:00100000:2.0:1789760772.392639:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5984
00000100:00100000:2.0:1789760772.392648:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743991936096 time 744030088125 state 0x2 ref 0
00000100:00100000:1.0:1789760772.395949:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760772.396051:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521024384
00000100:00100000:0.0:1789760772.396061:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521024384
00000100:00100000:0.0:1789760772.396116:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 743991936096 time 744030088125 state 0x0 ref 1
00000100:00100000:0.0:1789760772.396132:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744030348541 time 744030088125 state 0x1 ref 1
00000100:00100000:0.0:1789760772.396266:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744030348541 time 744082946220 state 0x0 ref 1
00000100:00100000:0.0:1789760772.396279:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521024384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760772.396462:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24379392, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:0.0:1789760772.396473:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.396488:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:0.0:1789760772.396493:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760772.396499:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.396525:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760772.425536:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24379392 -> 24383488
00010000:00010000:0.0:1789760772.425558:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.425570:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.425579:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.425586:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760772.425592:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760772.425684:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973272 is committed
00010000:00010000:0.0:1789760772.425728:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.425749:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.425756:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24379392->24383487] (req 24379392->24383487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760772.425840:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521024384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29559us (29894us total) trans 4294973272 rc 0/0
00000100:00100000:0.0:1789760772.425860:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5985
00000100:00100000:0.0:1789760772.425870:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744030348541 time 744082946220 state 0x2 ref 0
00000100:00100000:2.0:1789760772.438682:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760772.438765:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521024512
00000100:00100000:0.0:1789760772.438775:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521024512
00000100:00100000:0.0:1789760772.438828:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744030348541 time 744082946220 state 0x0 ref 1
00000100:00100000:0.0:1789760772.438843:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744083206636 time 744082946220 state 0x1 ref 1
00000100:00100000:0.0:1789760772.438907:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744083206636 time 744125588305 state 0x0 ref 1
00000100:00100000:0.0:1789760772.438920:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521024512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760772.438970:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24383488, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:0.0:1789760772.438979:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.438994:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:0.0:1789760772.438999:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760772.439005:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.439020:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760772.473603:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973273 is committed
00002000:00010000:3.0:1789760772.473717:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24383488 -> 24387584
00010000:00010000:3.0:1789760772.473733:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.473745:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.473760:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.473769:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.473773:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.473782:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.473801:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.473810:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d5a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24383488->24387583] (req 24383488->24387583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.473934:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521024512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35010us (35255us total) trans 4294973273 rc 0/0
00000100:00100000:3.0:1789760772.473945:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5986
00000100:00100000:3.0:1789760772.473955:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744083206636 time 744125588305 state 0x2 ref 0
00000100:00100000:1.0:1789760772.479415:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.479559:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521024640
00000100:00100000:3.0:1789760772.479569:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521024640
00000100:00100000:3.0:1789760772.479620:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744083206636 time 744125588305 state 0x0 ref 1
00000100:00100000:3.0:1789760772.479636:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744125848721 time 744125588305 state 0x1 ref 1
00000100:00100000:3.0:1789760772.479704:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744125848721 time 744166385852 state 0x0 ref 1
00000100:00100000:3.0:1789760772.479717:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521024640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.479763:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24387584, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.479777:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.479793:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:3.0:1789760772.479797:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.479802:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.479816:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760772.512150:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973274 is committed
00002000:00010000:3.0:1789760772.512350:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24387584 -> 24391680
00010000:00010000:3.0:1789760772.512367:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.512380:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.512390:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.512398:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.512406:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.512414:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.512432:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.512439:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24387584->24391679] (req 24387584->24391679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.512543:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521024640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32823us (33135us total) trans 4294973274 rc 0/0
00000100:00100000:3.0:1789760772.512554:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5987
00000100:00100000:3.0:1789760772.512564:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744125848721 time 744166385852 state 0x2 ref 0
00000100:00100000:1.0:1789760772.521652:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.524253:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521024768
00000100:00100000:2.0:1789760772.524268:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521024768
00000100:00100000:2.0:1789760772.524344:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744125848721 time 744166385852 state 0x0 ref 1
00000100:00100000:2.0:1789760772.524360:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744166646268 time 744166385852 state 0x1 ref 1
00000100:00100000:2.0:1789760772.524463:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744166646268 time 744211144493 state 0x0 ref 1
00000100:00100000:2.0:1789760772.524477:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521024768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760772.524535:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24391680, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:2.0:1789760772.524544:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.524561:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760772.524566:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760772.524573:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.524588:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760772.556955:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973275 is committed
00002000:00010000:2.0:1789760772.557092:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24391680 -> 24395776
00010000:00010000:2.0:1789760772.557111:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.557124:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.557133:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.557206:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760772.557212:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.557221:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.557241:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.557249:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24391680->24395775] (req 24391680->24395775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760772.557462:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521024768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32982us (35814us total) trans 4294973275 rc 0/0
00000100:00100000:2.0:1789760772.557473:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5988
00000100:00100000:2.0:1789760772.557483:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744166646268 time 744211144493 state 0x2 ref 0
00000100:00100000:3.0:1789760772.561614:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760772.561707:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521024896
00000100:00100000:0.0:1789760772.561718:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521024896
00000100:00100000:0.0:1789760772.561770:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744166646268 time 744211144493 state 0x0 ref 1
00000100:00100000:0.0:1789760772.561784:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744211404909 time 744211144493 state 0x1 ref 1
00000100:00100000:0.0:1789760772.561840:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744211404909 time 744248522887 state 0x0 ref 1
00000100:00100000:0.0:1789760772.561852:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521024896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760772.561901:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24395776, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:0.0:1789760772.561910:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.561927:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:0.0:1789760772.561931:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760772.561937:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.561950:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760772.595796:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973276 is committed
00002000:00010000:2.0:1789760772.596093:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24395776 -> 24399872
00010000:00010000:2.0:1789760772.596110:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.596120:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.596128:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.596135:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760772.596209:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.596220:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.596242:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.596254:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d5bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24395776->24399871] (req 24395776->24399871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760772.596463:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521024896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34608us (34854us total) trans 4294973276 rc 0/0
00000100:00100000:2.0:1789760772.596476:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5989
00000100:00100000:2.0:1789760772.596485:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744211404909 time 744248522887 state 0x2 ref 0
00000100:00100000:1.0:1789760772.599993:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.600629:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521025024
00000100:00100000:3.0:1789760772.600639:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521025024
00000100:00100000:3.0:1789760772.600692:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744211404909 time 744248522887 state 0x0 ref 1
00000100:00100000:3.0:1789760772.600706:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744248783303 time 744248522887 state 0x1 ref 1
00000100:00100000:3.0:1789760772.600734:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744248783303 time 744287416896 state 0x0 ref 1
00000100:00100000:3.0:1789760772.600747:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521025024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.600796:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24399872, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.600806:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.600822:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:3.0:1789760772.600827:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.600834:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.600848:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760772.628467:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973277 is committed
00002000:00010000:1.0:1789760772.628586:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24399872 -> 24403968
00010000:00010000:1.0:1789760772.628603:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760772.628617:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760772.628626:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760772.628633:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760772.628638:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760772.628646:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760772.628666:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760772.628679:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d5c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24399872->24403967] (req 24399872->24403967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760772.628804:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521025024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28055us (28817us total) trans 4294973277 rc 0/0
00000100:00100000:1.0:1789760772.628814:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5990
00000100:00100000:1.0:1789760772.628823:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744248783303 time 744287416896 state 0x2 ref 0
00000100:00100000:1.0:1789760772.631962:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.632086:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521025152
00000100:00100000:3.0:1789760772.632096:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521025152
00000100:00100000:3.0:1789760772.632146:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744248783303 time 744287416896 state 0x0 ref 1
00000100:00100000:3.0:1789760772.632160:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744287677312 time 744287416896 state 0x1 ref 1
00000100:00100000:3.0:1789760772.632195:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744287677312 time 744318877266 state 0x0 ref 1
00000100:00100000:3.0:1789760772.632207:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521025152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.632260:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24403968, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.632270:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.632291:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:3.0:1789760772.632295:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.632302:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.632348:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760772.663252:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24403968 -> 24408064
00010000:00010000:3.0:1789760772.663271:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.663285:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.663294:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.663302:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.663307:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.663337:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.663356:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.663365:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24403968->24408063] (req 24403968->24408063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.663442:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521025152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31232us (31485us total) trans 4294973278 rc 0/0
00000100:00100000:3.0:1789760772.663453:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5991
00000100:00100000:3.0:1789760772.663461:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744287677312 time 744318877266 state 0x2 ref 0
00000001:00080000:1.0:1789760772.663543:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973278 is committed
00010000:00010000:0.0:1789760772.665844:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789760772.666494:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.666598:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521025280
00000100:00100000:2.0:1789760772.666607:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521025280
00000100:00100000:2.0:1789760772.666657:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744287677312 time 744318877266 state 0x0 ref 1
00000100:00100000:2.0:1789760772.666672:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744319137682 time 744318877266 state 0x1 ref 1
00000100:00100000:2.0:1789760772.666749:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744319137682 time 744353430925 state 0x0 ref 1
00000100:00100000:2.0:1789760772.666762:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521025280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760772.666808:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24408064, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:2.0:1789760772.666817:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.666832:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760772.666836:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760772.666842:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.666859:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760772.702752:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973279 is committed
00002000:00010000:3.0:1789760772.702832:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24408064 -> 24412160
00010000:00010000:3.0:1789760772.702848:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.702861:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.702871:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.702879:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.702883:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.702892:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.702917:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.702926:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d5d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24408064->24412159] (req 24408064->24412159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.703059:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521025280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36294us (36565us total) trans 4294973279 rc 0/0
00000100:00100000:3.0:1789760772.703071:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5992
00000100:00100000:3.0:1789760772.703080:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744319137682 time 744353430925 state 0x2 ref 0
00000100:00100000:0.0:1789760772.706788:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.707354:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521025408
00000100:00100000:2.0:1789760772.707366:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521025408
00000100:00100000:2.0:1789760772.707425:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744319137682 time 744353430925 state 0x0 ref 1
00000100:00100000:2.0:1789760772.707441:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744353691341 time 744353430925 state 0x1 ref 1
00000100:00100000:2.0:1789760772.707466:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744353691341 time 744394148628 state 0x0 ref 1
00000100:00100000:2.0:1789760772.707479:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521025408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760772.707540:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24412160, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:2.0:1789760772.707550:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.707565:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760772.707569:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760772.707575:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.707588:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760772.756096:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24412160 -> 24416256
00010000:00010000:0.0:1789760772.756115:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.756128:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.756159:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.756167:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760772.756172:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.756183:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.756201:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.756209:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d5d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24412160->24416255] (req 24412160->24416255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760772.756344:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521025408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48828us (49525us total) trans 4294973280 rc 0/0
00000100:00100000:0.0:1789760772.756355:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5993
00000100:00100000:0.0:1789760772.756365:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744353691341 time 744394148628 state 0x2 ref 0
00000001:00080000:3.0:1789760772.757018:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973280 is committed
00000100:00100000:1.0:1789760772.761358:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.762875:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521025536
00000100:00100000:2.0:1789760772.762889:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521025536
00000100:00100000:2.0:1789760772.762954:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744353691341 time 744394148628 state 0x0 ref 1
00000100:00100000:2.0:1789760772.762971:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744394409044 time 744394148628 state 0x1 ref 1
00000100:00100000:2.0:1789760772.763091:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744394409044 time 744449771846 state 0x0 ref 1
00000100:00100000:2.0:1789760772.763106:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521025536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760772.763158:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24416256, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:2.0:1789760772.763168:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.763184:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760772.763190:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760772.763196:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.763213:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760772.800964:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973281 is committed
00002000:00010000:3.0:1789760772.801202:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24416256 -> 24420352
00010000:00010000:3.0:1789760772.801220:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.801446:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.801460:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.801468:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.801473:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.801497:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.801532:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.801541:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d5e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24416256->24420351] (req 24416256->24420351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.801632:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521025536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38525us (40323us total) trans 4294973281 rc 0/0
00000100:00100000:3.0:1789760772.801643:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5994
00000100:00100000:3.0:1789760772.801652:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744394409044 time 744449771846 state 0x2 ref 0
00000100:00100000:1.0:1789760772.806415:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.806518:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521025664
00000100:00100000:3.0:1789760772.806528:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521025664
00000100:00100000:3.0:1789760772.806643:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744394409044 time 744449771846 state 0x0 ref 1
00000100:00100000:3.0:1789760772.806658:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744450032262 time 744449771846 state 0x1 ref 1
00000100:00100000:3.0:1789760772.806694:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744450032262 time 744493375933 state 0x0 ref 1
00000100:00100000:3.0:1789760772.806706:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521025664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.806751:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24420352, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.806760:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.806777:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:3.0:1789760772.806781:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.806788:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.806802:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760772.839274:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973282 is committed
00002000:00010000:3.0:1789760772.839384:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24420352 -> 24424448
00010000:00010000:3.0:1789760772.839401:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.839415:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.839423:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.839431:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.839436:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.839446:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.839466:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.839473:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d5e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24420352->24424447] (req 24420352->24424447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.839594:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521025664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32875us (33175us total) trans 4294973282 rc 0/0
00000100:00100000:3.0:1789760772.839604:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5995
00000100:00100000:3.0:1789760772.839614:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744450032262 time 744493375933 state 0x2 ref 0
00000100:00100000:0.0:1789760772.844102:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760772.844207:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521025792
00000100:00100000:3.0:1789760772.844221:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521025792
00000100:00100000:3.0:1789760772.844276:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744450032262 time 744493375933 state 0x0 ref 1
00000100:00100000:3.0:1789760772.844291:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744493636349 time 744493375933 state 0x1 ref 1
00000100:00100000:3.0:1789760772.844364:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744493636349 time 744531046152 state 0x0 ref 1
00000100:00100000:3.0:1789760772.844378:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521025792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760772.844428:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24424448, mtime: 0x6aad9505, atime: 0x0, ctime: 0x6aad9505, blocks: 0xc007
00010000:00010000:3.0:1789760772.844438:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.844454:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:3.0:1789760772.844459:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760772.844464:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.844483:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760772.886622:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973283 is committed
00002000:00010000:3.0:1789760772.887187:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24424448 -> 24428544
00002000:00010000:3.0:1789760772.887193:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760773 -> 1789760774
00002000:00010000:3.0:1789760772.887195:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760773 -> 1789760774
00010000:00010000:3.0:1789760772.887207:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.887220:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.887230:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.887237:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760772.887242:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.887251:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.887269:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760772.887280:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d5ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24424448->24428543] (req 24424448->24428543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760772.887631:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521025792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43251us (43531us total) trans 4294973283 rc 0/0
00000100:00100000:3.0:1789760772.887642:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5996
00000100:00100000:3.0:1789760772.887651:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744493636349 time 744531046152 state 0x2 ref 0
00000100:00100000:1.0:1789760772.892859:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.893285:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521025920
00000100:00100000:2.0:1789760772.893295:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521025920
00000100:00100000:2.0:1789760772.893387:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744493636349 time 744531046152 state 0x0 ref 1
00000100:00100000:2.0:1789760772.893402:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744531306568 time 744531046152 state 0x1 ref 1
00000100:00100000:2.0:1789760772.893438:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744531306568 time 744580120504 state 0x0 ref 1
00000100:00100000:2.0:1789760772.893450:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521025920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760772.893498:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24428544, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760772.893522:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.893539:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760772.893543:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760772.893550:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.893564:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760772.922390:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973284 is committed
00002000:00010000:2.0:1789760772.922533:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24428544 -> 24432640
00010000:00010000:2.0:1789760772.922548:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.922561:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.922570:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.922577:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760772.922582:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.922591:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.922611:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.922619:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24428544->24432639] (req 24428544->24432639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760772.922813:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521025920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29360us (29958us total) trans 4294973284 rc 0/0
00000100:00100000:2.0:1789760772.922824:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5997
00000100:00100000:2.0:1789760772.922833:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744531306568 time 744580120504 state 0x2 ref 0
00000100:00100000:1.0:1789760772.929926:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760772.930037:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521026048
00000100:00100000:2.0:1789760772.930109:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521026048
00000100:00100000:2.0:1789760772.930230:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744531306568 time 744580120504 state 0x0 ref 1
00000100:00100000:2.0:1789760772.930246:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744580380920 time 744580120504 state 0x1 ref 1
00000100:00100000:2.0:1789760772.930354:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744580380920 time 744617035440 state 0x0 ref 1
00000100:00100000:2.0:1789760772.930367:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521026048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760772.930417:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24432640, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760772.930426:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.930442:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760772.930447:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760772.930453:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760772.930467:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760772.994277:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973285 is committed
00002000:00010000:0.0:1789760772.994349:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24432640 -> 24436736
00010000:00010000:0.0:1789760772.994366:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.994483:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.994494:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.994501:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760772.994515:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.994525:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.994545:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760772.994552:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d5fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24432640->24436735] (req 24432640->24436735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760772.994653:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521026048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64284us (64733us total) trans 4294973285 rc 0/0
00000100:00100000:0.0:1789760772.994663:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5998
00000100:00100000:0.0:1789760772.994672:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744580380920 time 744617035440 state 0x2 ref 0
00000100:00100000:0.0:1789760773.006530:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.006853:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521026176
00000100:00100000:3.0:1789760773.006872:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521026176
00000100:00100000:3.0:1789760773.006926:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744580380920 time 744617035440 state 0x0 ref 1
00000100:00100000:3.0:1789760773.006942:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744617295856 time 744617035440 state 0x1 ref 1
00000100:00100000:3.0:1789760773.006976:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744617295856 time 744693658275 state 0x0 ref 1
00000100:00100000:3.0:1789760773.006992:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521026176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.007041:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24436736, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.007050:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.007066:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:3.0:1789760773.007070:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.007077:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.007092:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760773.037749:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973286 is committed
00002000:00010000:0.0:1789760773.039491:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24436736 -> 24440832
00010000:00010000:0.0:1789760773.039520:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.039533:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.039543:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.039551:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760773.039556:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.039566:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.039587:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.039595:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d603 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24436736->24440831] (req 24436736->24440831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760773.039701:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521026176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32710us (33191us total) trans 4294973286 rc 0/0
00000100:00100000:0.0:1789760773.039713:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 5999
00000100:00100000:0.0:1789760773.039723:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744617295856 time 744693658275 state 0x2 ref 0
00000100:00100000:3.0:1789760773.045463:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760773.045872:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521026304
00000100:00100000:2.0:1789760773.045882:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521026304
00000100:00100000:2.0:1789760773.045935:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744617295856 time 744693658275 state 0x0 ref 1
00000100:00100000:2.0:1789760773.045950:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744693918691 time 744693658275 state 0x1 ref 1
00000100:00100000:2.0:1789760773.045976:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744693918691 time 744732659381 state 0x0 ref 1
00000100:00100000:2.0:1789760773.045989:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521026304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760773.046037:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24440832, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760773.046046:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.046064:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760773.046069:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760773.046075:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.046090:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760773.097753:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973287 is committed
00002000:00010000:0.0:1789760773.097828:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24440832 -> 24444928
00010000:00010000:0.0:1789760773.097845:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.097859:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.097869:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.097876:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760773.097881:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.097890:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.097910:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.097917:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d60a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24440832->24444927] (req 24440832->24444927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760773.098012:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521026304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52021us (52558us total) trans 4294973287 rc 0/0
00000100:00100000:0.0:1789760773.098024:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6000
00000100:00100000:0.0:1789760773.098034:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744693918691 time 744732659381 state 0x2 ref 0
00000100:00100000:1.0:1789760773.101620:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760773.101735:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521026432
00000100:00100000:2.0:1789760773.101745:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521026432
00000100:00100000:2.0:1789760773.101798:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744693918691 time 744732659381 state 0x0 ref 1
00000100:00100000:2.0:1789760773.101813:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744732919797 time 744732659381 state 0x1 ref 1
00000100:00100000:2.0:1789760773.101877:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744732919797 time 744788559146 state 0x0 ref 1
00000100:00100000:2.0:1789760773.101891:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521026432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760773.101946:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24444928, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760773.101955:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.101971:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760773.101975:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760773.101982:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.101996:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760773.137994:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973288 is committed
00002000:00010000:0.0:1789760773.138093:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24444928 -> 24449024
00010000:00010000:0.0:1789760773.138109:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.138122:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.138132:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.138139:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760773.138145:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.138155:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.138174:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.138182:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d611 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24444928->24449023] (req 24444928->24449023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760773.138276:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521026432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36383us (36662us total) trans 4294973288 rc 0/0
00000100:00100000:0.0:1789760773.138291:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6001
00000100:00100000:0.0:1789760773.138300:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744732919797 time 744788559146 state 0x2 ref 0
00000100:00100000:1.0:1789760773.141665:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760773.142006:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521026560
00000100:00100000:0.0:1789760773.142016:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521026560
00000100:00100000:0.0:1789760773.142301:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744732919797 time 744788559146 state 0x0 ref 1
00000100:00100000:0.0:1789760773.142354:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744788819562 time 744788559146 state 0x1 ref 1
00000100:00100000:0.0:1789760773.142387:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744788819562 time 744829069553 state 0x0 ref 1
00000100:00100000:0.0:1789760773.142400:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521026560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760773.142572:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24449024, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:0.0:1789760773.142582:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.142599:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:0.0:1789760773.142603:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760773.142610:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.142623:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760773.178372:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973289 is committed
00002000:00010000:0.0:1789760773.178517:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24449024 -> 24453120
00010000:00010000:0.0:1789760773.178535:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.178549:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.178559:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.178567:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760773.178572:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.178583:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.178605:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.178614:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d618 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24449024->24453119] (req 24449024->24453119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760773.178957:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521026560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36555us (37296us total) trans 4294973289 rc 0/0
00000100:00100000:0.0:1789760773.178969:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6002
00000100:00100000:0.0:1789760773.178980:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744788819562 time 744829069553 state 0x2 ref 0
00000100:00100000:3.0:1789760773.184118:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760773.184193:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521026688
00000100:00100000:0.0:1789760773.184209:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521026688
00000100:00100000:0.0:1789760773.184272:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744788819562 time 744829069553 state 0x0 ref 1
00000100:00100000:0.0:1789760773.184288:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744829329969 time 744829069553 state 0x1 ref 1
00000100:00100000:0.0:1789760773.184353:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744829329969 time 744871035815 state 0x0 ref 1
00000100:00100000:0.0:1789760773.184368:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521026688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760773.184416:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24453120, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:0.0:1789760773.184426:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.184442:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:0.0:1789760773.184446:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760773.184452:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.184466:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760773.221382:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973290 is committed
00002000:00010000:0.0:1789760773.221556:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24453120 -> 24457216
00010000:00010000:0.0:1789760773.221572:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.221585:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.221601:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.221609:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760773.221614:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.221623:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.221641:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.221649:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60d61f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24453120->24457215] (req 24453120->24457215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760773.221849:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521026688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37479us (38309us total) trans 4294973290 rc 0/0
00000100:00100000:0.0:1789760773.221860:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6003
00000100:00100000:0.0:1789760773.221870:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744829329969 time 744871035815 state 0x2 ref 0
00000100:00100000:2.0:1789760773.225955:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.226682:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521026816
00000100:00100000:3.0:1789760773.226692:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521026816
00000100:00100000:0.0:1789760773.226798:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744829329969 time 744871035815 state 0x0 ref 1
00000100:00100000:0.0:1789760773.226813:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744871296231 time 744871035815 state 0x1 ref 1
00000100:00100000:0.0:1789760773.226851:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744871296231 time 744913532426 state 0x0 ref 1
00000100:00100000:0.0:1789760773.226863:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521026816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760773.226909:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24457216, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:0.0:1789760773.226919:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.226936:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:0.0:1789760773.226940:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760773.226947:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.226961:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760773.241529:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548767104:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.241595:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760773.241648:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548767616:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.241675:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760773.241693:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548768128:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.241712:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760773.241733:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:1.0:1789760773.241738:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548767232:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.241757:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760773.241779:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548767744:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.241801:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760773.241819:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548768256:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.241838:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760773.241867:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548767104
00000100:00100000:1.0:1789760773.241874:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548767104
00000100:00100000:1.0:1789760773.241914:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451
00000100:00100000:1.0:1789760773.241923:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548767104:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.241974:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548767104:12345-0@lo:400:kworker.0 Request processed in 52us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760773.241981:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451
00000100:00100000:1.0:1789760773.242003:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548767744
00000100:00100000:1.0:1789760773.242007:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548767744
00000100:00100000:1.0:1789760773.242029:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548768256
00000100:00100000:3.0:1789760773.242128:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548766848:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242225:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760773.242249:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548767360:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242267:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760773.242282:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548767872:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242299:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760773.242330:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548768384:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242350:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760773.242368:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:3.0:1789760773.242373:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548766976:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242394:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760773.242409:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548767488:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242427:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760773.242442:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548768000:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242459:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760773.242476:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548766848
00000100:00100000:3.0:1789760773.242479:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548766848
00000100:00100000:3.0:1789760773.242516:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483
00000100:00100000:3.0:1789760773.242523:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548766848:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242556:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548766848:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760773.242563:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483
00000100:00100000:3.0:1789760773.242597:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548767360
00000100:00100000:3.0:1789760773.242600:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548767360
00000100:00100000:3.0:1789760773.242619:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452
00000100:00100000:3.0:1789760773.242624:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548767360:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242650:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548767360:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760773.242655:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452
00000100:00100000:3.0:1789760773.242670:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548767872
00000100:00100000:3.0:1789760773.242672:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548767872
00000100:00100000:3.0:1789760773.242684:0:8098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548768384
00000100:00100000:3.0:1789760773.242686:0:8098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548768384
00000100:00100000:3.0:1789760773.242707:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303
00000100:00100000:3.0:1789760773.242712:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548767744:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242739:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548767744:12345-0@lo:400:kworker.0 Request processed in 27us (938us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760773.242745:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303
00000100:00100000:3.0:1789760773.242755:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304
00000100:00100000:3.0:1789760773.242760:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548767872:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242783:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548767872:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760773.242791:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304
00000100:00100000:3.0:1789760773.242803:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305
00000100:00100000:3.0:1789760773.242809:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548768384:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242833:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548768384:12345-0@lo:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760773.242838:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305
00000100:00100000:3.0:1789760773.242858:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548767616
00000100:00100000:3.0:1789760773.242861:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548767616
00000100:00100000:3.0:1789760773.242879:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548768128
00000100:00100000:3.0:1789760773.242881:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548768128
00000100:00100000:3.0:1789760773.242892:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548767232
00000100:00100000:3.0:1789760773.242894:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548767232
00000100:00100000:3.0:1789760773.242902:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548766976
00000100:00100000:3.0:1789760773.242905:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548766976
00000100:00100000:3.0:1789760773.242920:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548767488
00000100:00100000:3.0:1789760773.242922:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548767488
00000100:00100000:3.0:1789760773.242932:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548768000
00000100:00100000:3.0:1789760773.242934:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548768000
00000100:00100000:3.0:1789760773.242948:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937
00000100:00100000:3.0:1789760773.242954:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548767616:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.242984:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548767616:12345-0@lo:400:kworker.0 Request processed in 30us (1309us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760773.242990:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937
00000100:00100000:3.0:1789760773.243002:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938
00000100:00100000:3.0:1789760773.243007:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548768128:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.243206:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548768256
00000100:00100000:1.0:1789760773.243241:0:9637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306
00000100:00100000:1.0:1789760773.243249:0:9637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548768256:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.243281:0:9637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548768256:12345-0@lo:400:kworker.0 Request processed in 34us (1442us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760773.243286:0:9637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306
00000100:00100000:1.0:1789760773.243353:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548767744:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.243365:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548768256:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.243376:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548767104:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.243385:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548767616:0@lo:400:kworker.0
00000100:00100000:1.0:1789760773.243395:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548768128:0@lo:400:kworker.0
00000100:00100000:0.0:1789760773.243528:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548768512:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760773.243561:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760773.243594:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939
00000100:00100000:0.0:1789760773.243601:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548767232:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760773.243631:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548767232:12345-0@lo:400:kworker.0 Request processed in 32us (1873us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760773.243636:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939
00000100:00100000:0.0:1789760773.243655:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940
00000100:00100000:0.0:1789760773.243660:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548766976:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760773.243684:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548766976:12345-0@lo:400:kworker.0 Request processed in 24us (1289us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760773.243688:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940
00000100:00100000:0.0:1789760773.243699:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941
00000100:00100000:0.0:1789760773.243704:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548767488:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760773.243724:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548767488:12345-0@lo:400:kworker.0 Request processed in 20us (1296us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760773.243728:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941
00000100:00100000:0.0:1789760773.243736:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942
00000100:00100000:0.0:1789760773.243741:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548768000:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760773.243762:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548768000:12345-0@lo:400:kworker.0 Request processed in 22us (1303us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760773.243767:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942
00000100:00100000:0.0:1789760773.243790:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548768512
00000100:00100000:0.0:1789760773.243793:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548768512
00000100:00100000:0.0:1789760773.243814:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384
00000100:00100000:0.0:1789760773.243819:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548768512:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:0.0:1789760773.243843:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760773.243871:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548768512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (309us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760773.243876:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384
00000100:00100000:0.0:1789760773.243903:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548768512:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760773.243924:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548767232:0@lo:400:kworker.0
00000100:00100000:2.0:1789760773.244344:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:2.0:1789760773.244355:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548768640:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1789760773.244386:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760773.244425:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548768640
00000100:00100000:2.0:1789760773.244429:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548768640
00000100:00100000:2.0:1789760773.244453:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385
00000100:00100000:2.0:1789760773.244459:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548768640:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1789760773.244470:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:2.0:1789760773.244521:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548768640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (133us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760773.244527:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385
00000100:00100000:2.0:1789760773.244557:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548768640:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1789760773.244688:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548768128:12345-0@lo:400:kworker.0 Request processed in 24us (1317us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760773.244698:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938
00000100:00080000:3.0:1789760773.244729:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:3.0:1789760773.244734:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:3.0:1789760773.244736:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1789760773.244761:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548766976:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.244774:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548767488:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.244784:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548768000:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.244793:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548766848:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.244804:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548767360:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.244814:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548767872:0@lo:400:kworker.0
00000100:00100000:3.0:1789760773.244824:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548768384:0@lo:400:kworker.0
00000001:00080000:3.0:1789760773.263726:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973291 is committed
00002000:00010000:1.0:1789760773.263818:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24457216 -> 24461312
00010000:00010000:1.0:1789760773.263833:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.263845:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.263855:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.263862:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760773.263867:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.263877:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.263895:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.263903:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d626 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24457216->24461311] (req 24457216->24461311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760773.263994:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521026816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37128us (38046us total) trans 4294973291 rc 0/0
00000100:00100000:1.0:1789760773.264005:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6004
00000100:00100000:1.0:1789760773.264015:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744871296231 time 744913532426 state 0x2 ref 0
00000100:00100000:1.0:1789760773.268093:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.268245:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521026944
00000100:00100000:3.0:1789760773.268255:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521026944
00000100:00100000:3.0:1789760773.268308:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744871296231 time 744913532426 state 0x0 ref 1
00000100:00100000:3.0:1789760773.268442:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744913792842 time 744913532426 state 0x1 ref 1
00000100:00100000:3.0:1789760773.268515:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744913792842 time 744955197300 state 0x0 ref 1
00000100:00100000:3.0:1789760773.268530:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521026944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.268577:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24461312, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.268587:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.268608:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:3.0:1789760773.268613:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.268619:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.268633:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760773.300577:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973292 is committed
00002000:00010000:3.0:1789760773.300650:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24461312 -> 24465408
00010000:00010000:3.0:1789760773.300665:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.300678:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.300687:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.300695:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760773.300699:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.300709:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.300728:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.300737:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d62d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24461312->24465407] (req 24461312->24465407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760773.300856:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521026944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32325us (32824us total) trans 4294973292 rc 0/0
00000100:00100000:3.0:1789760773.300867:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6005
00000100:00100000:3.0:1789760773.300877:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744913792842 time 744955197300 state 0x2 ref 0
00000100:00100000:1.0:1789760773.305002:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760773.305202:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521027072
00000100:00100000:2.0:1789760773.305211:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521027072
00000100:00100000:2.0:1789760773.305262:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744913792842 time 744955197300 state 0x0 ref 1
00000100:00100000:2.0:1789760773.305278:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744955457716 time 744955197300 state 0x1 ref 1
00000100:00100000:2.0:1789760773.305425:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744955457716 time 744992106629 state 0x0 ref 1
00000100:00100000:2.0:1789760773.305439:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760773.305485:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24465408, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760773.305494:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.305522:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=744s v=(0 0)
00010000:00010000:2.0:1789760773.305527:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760773.305534:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.305547:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760773.331472:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973293 is committed
00002000:00010000:2.0:1789760773.331651:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24465408 -> 24469504
00010000:00010000:2.0:1789760773.331667:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.331680:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.331690:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.331698:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760773.331703:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.331713:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.331734:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.331743:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d634 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24465408->24469503] (req 24465408->24469503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760773.331842:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26400us (26843us total) trans 4294973293 rc 0/0
00000100:00100000:2.0:1789760773.331852:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6006
00000100:00100000:2.0:1789760773.331862:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744955457716 time 744992106629 state 0x2 ref 0
00000100:00100000:2.0:1789760773.335406:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760773.335485:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521027200
00000100:00100000:0.0:1789760773.335495:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521027200
00000100:00100000:0.0:1789760773.335552:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744955457716 time 744992106629 state 0x0 ref 1
00000100:00100000:0.0:1789760773.335566:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744992367045 time 744992106629 state 0x1 ref 1
00000100:00100000:0.0:1789760773.335621:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744992367045 time 745022303763 state 0x0 ref 1
00000100:00100000:0.0:1789760773.335633:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760773.335676:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24469504, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:0.0:1789760773.335685:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.335700:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:0.0:1789760773.335704:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760773.335710:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.335724:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760773.364450:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24469504 -> 24473600
00010000:00010000:0.0:1789760773.364469:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.364483:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.364499:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.364516:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760773.364522:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.364532:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.364552:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760773.364560:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d63b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24469504->24473599] (req 24469504->24473599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760773.364683:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521027200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29046us (29280us total) trans 4294973294 rc 0/0
00000100:00100000:0.0:1789760773.364694:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6007
00000100:00100000:0.0:1789760773.364703:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744992367045 time 745022303763 state 0x2 ref 0
00000001:00080000:1.0:1789760773.364773:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973294 is committed
00000100:00100000:2.0:1789760773.368830:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760773.368894:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521027328
00000100:00100000:1.0:1789760773.368904:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521027328
00000100:00100000:1.0:1789760773.368959:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 744992367045 time 745022303763 state 0x0 ref 1
00000100:00100000:1.0:1789760773.368975:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745022564179 time 745022303763 state 0x1 ref 1
00000100:00100000:1.0:1789760773.369009:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745022564179 time 745055691352 state 0x0 ref 1
00000100:00100000:1.0:1789760773.369021:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760773.369078:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24473600, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:1.0:1789760773.369088:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.369104:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:1.0:1789760773.369109:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760773.369115:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.369129:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760773.400375:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24473600 -> 24477696
00010000:00010000:2.0:1789760773.400396:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.400410:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.400420:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.400428:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760773.400433:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.400441:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.400461:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.400469:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d642 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24473600->24477695] (req 24473600->24477695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760773.400568:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521027328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31544us (31744us total) trans 4294973295 rc 0/0
00000100:00100000:2.0:1789760773.400578:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6008
00000100:00100000:2.0:1789760773.400588:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745022564179 time 745055691352 state 0x2 ref 0
00000001:00080000:3.0:1789760773.403987:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973295 is committed
00000100:00100000:0.0:1789760773.404473:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.404570:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521027456
00000100:00100000:3.0:1789760773.404579:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521027456
00000100:00100000:3.0:1789760773.404630:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745022564179 time 745055691352 state 0x0 ref 1
00000100:00100000:3.0:1789760773.404645:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745055951768 time 745055691352 state 0x1 ref 1
00000100:00100000:3.0:1789760773.404703:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745055951768 time 745091385032 state 0x0 ref 1
00000100:00100000:3.0:1789760773.404716:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521027456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.404764:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24477696, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.404775:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.404791:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760773.404795:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.404803:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.404816:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760773.442173:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24477696 -> 24481792
00010000:00010000:3.0:1789760773.442192:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.442206:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.442214:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.442222:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760773.442227:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.442237:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.442259:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.442268:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d649 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24477696->24481791] (req 24477696->24481791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760773.442401:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521027456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37681us (37927us total) trans 4294973296 rc 0/0
00000100:00100000:3.0:1789760773.442413:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6009
00000100:00100000:3.0:1789760773.442422:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745055951768 time 745091385032 state 0x2 ref 0
00000001:00080000:2.0:1789760773.442523:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973296 is committed
00000100:00100000:1.0:1789760773.446888:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.447125:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521027584
00000100:00100000:3.0:1789760773.447135:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521027584
00000100:00100000:3.0:1789760773.447197:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745055951768 time 745091385032 state 0x0 ref 1
00000100:00100000:3.0:1789760773.447213:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745091645448 time 745091385032 state 0x1 ref 1
00000100:00100000:3.0:1789760773.447306:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745091645448 time 745133986723 state 0x0 ref 1
00000100:00100000:3.0:1789760773.447365:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.447413:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24481792, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.447422:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.447438:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760773.447443:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.447455:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.447470:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760773.477449:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24481792 -> 24485888
00010000:00010000:3.0:1789760773.477467:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.477480:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.477488:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.477495:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760773.477509:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.477518:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.477535:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.477542:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d650 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24481792->24485887] (req 24481792->24485887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760773.477628:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521027584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30262us (30746us total) trans 4294973297 rc 0/0
00000100:00100000:3.0:1789760773.477642:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6010
00000100:00100000:3.0:1789760773.477650:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745091645448 time 745133986723 state 0x2 ref 0
00000001:00080000:0.0:1789760773.478497:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973297 is committed
00000100:00100000:0.0:1789760773.481604:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760773.482285:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521027712
00000100:00100000:2.0:1789760773.482296:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521027712
00000100:00100000:2.0:1789760773.482596:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745091645448 time 745133986723 state 0x0 ref 1
00000100:00100000:2.0:1789760773.482611:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745134247139 time 745133986723 state 0x1 ref 1
00000100:00100000:2.0:1789760773.482643:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745134247139 time 745169325120 state 0x0 ref 1
00000100:00100000:2.0:1789760773.482655:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521027712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760773.482705:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24485888, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760773.482714:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.482734:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:2.0:1789760773.482738:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760773.482745:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.482759:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760773.511904:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24485888 -> 24489984
00010000:00010000:2.0:1789760773.511924:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.511937:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.511947:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.511965:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760773.511970:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.511980:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.511999:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.512007:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d657 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24485888->24489983] (req 24485888->24489983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760773.512103:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521027712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29444us (30502us total) trans 4294973298 rc 0/0
00000100:00100000:2.0:1789760773.512114:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6011
00000100:00100000:2.0:1789760773.512123:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745134247139 time 745169325120 state 0x2 ref 0
00000001:00080000:2.0:1789760773.512282:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973298 is committed
00000100:00100000:1.0:1789760773.516941:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760773.517121:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521027840
00000100:00100000:2.0:1789760773.517142:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521027840
00000100:00100000:2.0:1789760773.517196:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745134247139 time 745169325120 state 0x0 ref 1
00000100:00100000:2.0:1789760773.517216:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745169585536 time 745169325120 state 0x1 ref 1
00000100:00100000:2.0:1789760773.517286:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745169585536 time 745203968047 state 0x0 ref 1
00000100:00100000:2.0:1789760773.517299:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760773.517386:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24489984, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760773.517396:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.517410:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:2.0:1789760773.517415:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760773.517421:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.517436:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760773.545772:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973299 is committed
00002000:00010000:3.0:1789760773.546002:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24489984 -> 24494080
00010000:00010000:3.0:1789760773.546017:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.546039:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.546048:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.546056:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760773.546061:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.546071:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.546090:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.546098:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d65e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24489984->24494079] (req 24489984->24494079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760773.546363:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29060us (29426us total) trans 4294973299 rc 0/0
00000100:00100000:3.0:1789760773.546375:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6012
00000100:00100000:3.0:1789760773.546385:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745169585536 time 745203968047 state 0x2 ref 0
00000100:00100000:2.0:1789760773.552679:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.552837:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521027968
00000100:00100000:3.0:1789760773.552849:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521027968
00000100:00100000:3.0:1789760773.552936:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745169585536 time 745203968047 state 0x0 ref 1
00000100:00100000:3.0:1789760773.553426:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745204228463 time 745203968047 state 0x1 ref 1
00000100:00100000:3.0:1789760773.553470:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745204228463 time 745240151315 state 0x0 ref 1
00000100:00100000:3.0:1789760773.553487:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.553562:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24494080, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.553573:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.553592:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760773.553596:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.553604:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.553620:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760773.585898:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973300 is committed
00002000:00010000:2.0:1789760773.586137:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24494080 -> 24498176
00010000:00010000:2.0:1789760773.586153:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.586167:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.586176:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.586184:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760773.586188:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.586197:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.586218:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.586226:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d665 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24494080->24498175] (req 24494080->24498175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760773.586436:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521027968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32948us (33766us total) trans 4294973300 rc 0/0
00000100:00100000:2.0:1789760773.586447:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6013
00000100:00100000:2.0:1789760773.586454:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745204228463 time 745240151315 state 0x2 ref 0
00000100:00100000:0.0:1789760773.589631:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.589732:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521028096
00000100:00100000:3.0:1789760773.589742:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521028096
00000100:00100000:3.0:1789760773.589796:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745204228463 time 745240151315 state 0x0 ref 1
00000100:00100000:3.0:1789760773.589810:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745240411731 time 745240151315 state 0x1 ref 1
00000100:00100000:3.0:1789760773.589880:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745240411731 time 745276561890 state 0x0 ref 1
00000100:00100000:3.0:1789760773.589894:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521028096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.589943:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24498176, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.589952:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.589977:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760773.589982:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.589988:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.590002:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760773.640626:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973301 is committed
00002000:00010000:1.0:1789760773.640735:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24498176 -> 24502272
00010000:00010000:1.0:1789760773.640753:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.640766:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.640787:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.640795:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760773.640800:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.640809:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.640830:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.640843:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d66c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24498176->24502271] (req 24498176->24502271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760773.640948:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521028096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51052us (51321us total) trans 4294973301 rc 0/0
00000100:00100000:1.0:1789760773.640960:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6014
00000100:00100000:1.0:1789760773.641045:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745240411731 time 745276561890 state 0x2 ref 0
00000100:00100000:1.0:1789760773.644105:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760773.644190:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521028224
00000100:00100000:2.0:1789760773.644201:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521028224
00000100:00100000:2.0:1789760773.644255:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745240411731 time 745276561890 state 0x0 ref 1
00000100:00100000:2.0:1789760773.644271:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745276822306 time 745276561890 state 0x1 ref 1
00000100:00100000:2.0:1789760773.644303:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745276822306 time 745330985852 state 0x0 ref 1
00000100:00100000:2.0:1789760773.644381:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521028224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760773.644428:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24502272, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760773.644437:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.644452:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:2.0:1789760773.644456:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760773.644461:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.644475:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760773.686981:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973302 is committed
00002000:00010000:1.0:1789760773.687209:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24502272 -> 24506368
00010000:00010000:1.0:1789760773.687225:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.687237:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.687246:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.687254:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760773.687259:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.687268:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.687288:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.687300:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d673 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24502272->24506367] (req 24502272->24506367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760773.687550:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521028224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43232us (43449us total) trans 4294973302 rc 0/0
00000100:00100000:1.0:1789760773.687561:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6015
00000100:00100000:1.0:1789760773.687570:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745276822306 time 745330985852 state 0x2 ref 0
00010000:00010000:3.0:1789760773.689417:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1789760773.691798:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.691939:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521028352
00000100:00100000:3.0:1789760773.691949:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521028352
00000100:00100000:3.0:1789760773.692001:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745276822306 time 745330985852 state 0x0 ref 1
00000100:00100000:3.0:1789760773.692020:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745331246268 time 745330985852 state 0x1 ref 1
00000100:00100000:3.0:1789760773.692060:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745331246268 time 745378742092 state 0x0 ref 1
00000100:00100000:3.0:1789760773.692073:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521028352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.692121:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24506368, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.692139:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.692155:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760773.692160:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.692166:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.692179:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760773.725514:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973303 is committed
00002000:00010000:1.0:1789760773.725656:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24506368 -> 24510464
00010000:00010000:1.0:1789760773.725673:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.725686:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.725696:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.725703:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760773.725708:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.725716:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.725740:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.725748:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d67a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24506368->24510463] (req 24506368->24510463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760773.725893:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521028352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33817us (34098us total) trans 4294973303 rc 0/0
00000100:00100000:1.0:1789760773.725905:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6016
00000100:00100000:1.0:1789760773.725914:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745331246268 time 745378742092 state 0x2 ref 0
00000100:00100000:1.0:1789760773.743968:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.744159:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521028480
00000100:00100000:3.0:1789760773.744168:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521028480
00000100:00100000:3.0:1789760773.744216:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745331246268 time 745378742092 state 0x0 ref 1
00000100:00100000:3.0:1789760773.744229:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745379002508 time 745378742092 state 0x1 ref 1
00000100:00100000:3.0:1789760773.744259:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745379002508 time 745430942372 state 0x0 ref 1
00000100:00100000:3.0:1789760773.744270:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521028480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.744347:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24510464, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.744357:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.744374:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760773.744379:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.744388:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.744401:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760773.780961:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973304 is committed
00002000:00010000:3.0:1789760773.781106:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24510464 -> 24514560
00010000:00010000:3.0:1789760773.781122:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.781262:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.781273:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.781281:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760773.781286:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.781295:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.781332:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.781341:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d681 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24510464->24514559] (req 24510464->24514559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760773.781480:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521028480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37205us (37519us total) trans 4294973304 rc 0/0
00000100:00100000:3.0:1789760773.781492:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6017
00000100:00100000:3.0:1789760773.781526:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745379002508 time 745430942372 state 0x2 ref 0
00000100:00100000:0.0:1789760773.786006:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.786096:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521028608
00000100:00100000:3.0:1789760773.786105:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521028608
00000100:00100000:3.0:1789760773.786167:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745379002508 time 745430942372 state 0x0 ref 1
00000100:00100000:3.0:1789760773.786192:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745431202788 time 745430942372 state 0x1 ref 1
00000100:00100000:3.0:1789760773.786225:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745431202788 time 745472907521 state 0x0 ref 1
00000100:00100000:3.0:1789760773.786237:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521028608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.786280:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24514560, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:3.0:1789760773.786290:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.786305:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760773.786310:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.786342:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.786357:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760773.820372:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973305 is committed
00002000:00010000:1.0:1789760773.820691:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24514560 -> 24518656
00010000:00010000:1.0:1789760773.820707:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.820720:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.820730:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.820739:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760773.820743:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.820759:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.820779:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.820787:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d688 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24514560->24518655] (req 24514560->24518655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760773.820882:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521028608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34640us (34879us total) trans 4294973305 rc 0/0
00000100:00100000:1.0:1789760773.820893:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6018
00000100:00100000:1.0:1789760773.820903:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745431202788 time 745472907521 state 0x2 ref 0
00000100:00100000:2.0:1789760773.824228:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760773.824311:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521028736
00000100:00100000:1.0:1789760773.824348:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521028736
00000100:00100000:1.0:1789760773.824402:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745431202788 time 745472907521 state 0x0 ref 1
00000100:00100000:1.0:1789760773.824417:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745473167937 time 745472907521 state 0x1 ref 1
00000100:00100000:1.0:1789760773.824446:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745473167937 time 745511128447 state 0x0 ref 1
00000100:00100000:1.0:1789760773.824457:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521028736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760773.824526:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24518656, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:1.0:1789760773.824535:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.824552:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:1.0:1789760773.824556:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760773.824563:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.824577:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760773.854034:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24518656 -> 24522752
00010000:00010000:1.0:1789760773.854054:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.854068:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.854077:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.854084:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760773.854088:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.854096:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.854115:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.854123:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d68f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24518656->24522751] (req 24518656->24522751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760773.854390:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973306 is committed
00000100:00100000:1.0:1789760773.854623:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521028736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30162us (30399us total) trans 4294973306 rc 0/0
00000100:00100000:1.0:1789760773.854634:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6019
00000100:00100000:1.0:1789760773.854644:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745473167937 time 745511128447 state 0x2 ref 0
00000100:00100000:2.0:1789760773.859584:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760773.861407:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521028864
00000100:00100000:1.0:1789760773.861421:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521028864
00000100:00100000:2.0:1789760773.863410:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745473167937 time 745511128447 state 0x0 ref 1
00000100:00100000:2.0:1789760773.863429:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745511388863 time 745511128447 state 0x1 ref 1
00000100:00100000:2.0:1789760773.863536:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745511388863 time 745550217007 state 0x0 ref 1
00000100:00100000:2.0:1789760773.863551:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521028864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760773.863602:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24522752, mtime: 0x6aad9506, atime: 0x0, ctime: 0x6aad9506, blocks: 0xc007
00010000:00010000:2.0:1789760773.863612:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.863628:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:2.0:1789760773.863633:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760773.863639:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.863653:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760773.910650:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973307 is committed
00002000:00010000:1.0:1789760773.910758:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24522752 -> 24526848
00002000:00010000:1.0:1789760773.910764:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760774 -> 1789760775
00002000:00010000:1.0:1789760773.910767:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760774 -> 1789760775
00010000:00010000:1.0:1789760773.910781:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.910793:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.910801:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.910809:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760773.910814:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.910961:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.910982:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760773.910990:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d696 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24522752->24526847] (req 24522752->24526847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760773.911086:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521028864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47534us (51506us total) trans 4294973307 rc 0/0
00000100:00100000:1.0:1789760773.911097:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6020
00000100:00100000:1.0:1789760773.911107:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745511388863 time 745550217007 state 0x2 ref 0
00000100:00100000:2.0:1789760773.917189:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760773.917398:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521028992
00000100:00100000:3.0:1789760773.917410:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521028992
00000100:00100000:3.0:1789760773.917482:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745511388863 time 745550217007 state 0x0 ref 1
00000100:00100000:3.0:1789760773.917506:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745550477423 time 745550217007 state 0x1 ref 1
00000100:00100000:3.0:1789760773.917778:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745550477423 time 745604458234 state 0x0 ref 1
00000100:00100000:3.0:1789760773.917794:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521028992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760773.917857:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24526848, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760773.917867:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.917885:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760773.917890:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760773.917897:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760773.917911:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760773.993109:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973308 is committed
00002000:00010000:2.0:1789760773.993109:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24526848 -> 24530944
00010000:00010000:2.0:1789760773.993129:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.993141:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.993149:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.993165:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760773.993170:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.993178:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.993196:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760773.993203:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d69d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24526848->24530943] (req 24526848->24530943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760773.993292:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521028992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 75498us (76108us total) trans 4294973308 rc 0/0
00000100:00100000:2.0:1789760773.993302:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6021
00000100:00100000:2.0:1789760773.993353:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745550477423 time 745604458234 state 0x2 ref 0
00000100:00100000:2.0:1789760773.999586:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.000125:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521029120
00000100:00100000:3.0:1789760774.000134:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521029120
00000100:00100000:3.0:1789760774.000185:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745550477423 time 745604458234 state 0x0 ref 1
00000100:00100000:3.0:1789760774.000201:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745604718650 time 745604458234 state 0x1 ref 1
00000100:00100000:3.0:1789760774.000233:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745604718650 time 745686916118 state 0x0 ref 1
00000100:00100000:3.0:1789760774.000246:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521029120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.000291:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24530944, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.000300:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.000339:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760774.000344:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.000350:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.000363:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760774.048159:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973309 is committed
00002000:00010000:3.0:1789760774.048342:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24530944 -> 24535040
00010000:00010000:3.0:1789760774.048358:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.048901:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.048910:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.048917:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.048922:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.048931:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.048952:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.048959:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24530944->24535039] (req 24530944->24535039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.049508:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521029120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49251us (49918us total) trans 4294973309 rc 0/0
00000100:00100000:3.0:1789760774.049520:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6022
00000100:00100000:3.0:1789760774.049530:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745604718650 time 745686916118 state 0x2 ref 0
00000100:00100000:0.0:1789760774.055301:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760774.055668:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521029248
00000100:00100000:1.0:1789760774.055677:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521029248
00000100:00100000:1.0:1789760774.055782:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745604718650 time 745686916118 state 0x0 ref 1
00000100:00100000:1.0:1789760774.055799:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745687176534 time 745686916118 state 0x1 ref 1
00000100:00100000:1.0:1789760774.055829:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745687176534 time 745742511067 state 0x0 ref 1
00000100:00100000:1.0:1789760774.055842:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521029248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760774.055895:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24535040, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:1.0:1789760774.055905:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.055922:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:1.0:1789760774.055927:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760774.055932:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.055946:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:3.0:1789760774.057486:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760774.094482:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973310 is committed
00002000:00010000:3.0:1789760774.094683:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24535040 -> 24539136
00010000:00010000:3.0:1789760774.094699:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.094711:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.094720:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.094728:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.094733:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.094742:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.094760:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.094769:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d6ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24535040->24539135] (req 24535040->24539135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.094892:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521029248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39048us (39595us total) trans 4294973310 rc 0/0
00000100:00100000:3.0:1789760774.094903:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6023
00000100:00100000:3.0:1789760774.094912:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745687176534 time 745742511067 state 0x2 ref 0
00000100:00100000:2.0:1789760774.099103:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760774.099298:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521029376
00000100:00100000:1.0:1789760774.099307:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521029376
00000100:00100000:1.0:1789760774.099427:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745687176534 time 745742511067 state 0x0 ref 1
00000100:00100000:1.0:1789760774.099442:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745742771483 time 745742511067 state 0x1 ref 1
00000100:00100000:1.0:1789760774.099467:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745742771483 time 745786149571 state 0x0 ref 1
00000100:00100000:1.0:1789760774.099479:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521029376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760774.099539:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24539136, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:1.0:1789760774.099548:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.099564:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:1.0:1789760774.099568:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760774.099575:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.099594:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760774.130781:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973311 is committed
00002000:00010000:1.0:1789760774.131129:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24539136 -> 24543232
00010000:00010000:1.0:1789760774.131144:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.131157:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.131165:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.131172:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760774.131177:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.131187:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.131204:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.131212:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d6b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24539136->24543231] (req 24539136->24543231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760774.131490:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521029376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32008us (32391us total) trans 4294973311 rc 0/0
00000100:00100000:1.0:1789760774.131512:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6024
00000100:00100000:1.0:1789760774.131522:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745742771483 time 745786149571 state 0x2 ref 0
00000100:00100000:2.0:1789760774.137269:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.137358:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521029504
00000100:00100000:3.0:1789760774.137369:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521029504
00000100:00100000:3.0:1789760774.137422:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745742771483 time 745786149571 state 0x0 ref 1
00000100:00100000:3.0:1789760774.137438:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745786409987 time 745786149571 state 0x1 ref 1
00000100:00100000:2.0:1789760774.137569:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745786409987 time 745824249066 state 0x0 ref 1
00000100:00100000:2.0:1789760774.137583:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521029504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760774.137630:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24543232, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:2.0:1789760774.137653:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.137669:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:2.0:1789760774.137673:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760774.137679:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.137693:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760774.167512:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973312 is committed
00002000:00010000:1.0:1789760774.167678:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24543232 -> 24547328
00010000:00010000:1.0:1789760774.167693:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.167706:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.167715:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.167723:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760774.167727:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.167736:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.167754:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.167766:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d6b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24543232->24547327] (req 24543232->24547327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760774.167861:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521029504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30276us (30596us total) trans 4294973312 rc 0/0
00000100:00100000:1.0:1789760774.167871:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6025
00000100:00100000:1.0:1789760774.167880:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745786409987 time 745824249066 state 0x2 ref 0
00000100:00100000:0.0:1789760774.170825:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.170878:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521029632
00000100:00100000:3.0:1789760774.170887:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521029632
00000100:00100000:3.0:1789760774.170932:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745786409987 time 745824249066 state 0x0 ref 1
00000100:00100000:3.0:1789760774.170943:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745824509482 time 745824249066 state 0x1 ref 1
00000100:00100000:3.0:1789760774.170966:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745824509482 time 745857649279 state 0x0 ref 1
00000100:00100000:3.0:1789760774.171008:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521029632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.171065:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24547328, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.171074:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.171089:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:3.0:1789760774.171094:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.171099:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.171114:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760774.206637:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24547328 -> 24551424
00010000:00010000:0.0:1789760774.206659:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.206673:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.206682:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.206690:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760774.206694:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.206703:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.206723:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.206735:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d6c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24547328->24551423] (req 24547328->24551423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760774.206831:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521029632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35849us (36006us total) trans 4294973313 rc 0/0
00000100:00100000:0.0:1789760774.206840:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6026
00000100:00100000:0.0:1789760774.206849:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745824509482 time 745857649279 state 0x2 ref 0
00000001:00080000:2.0:1789760774.210428:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973313 is committed
00000100:00100000:2.0:1789760774.213852:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760774.214807:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521029760
00000100:00100000:1.0:1789760774.214818:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521029760
00000100:00100000:1.0:1789760774.214874:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745824509482 time 745857649279 state 0x0 ref 1
00000100:00100000:1.0:1789760774.214889:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745857909695 time 745857649279 state 0x1 ref 1
00000100:00100000:1.0:1789760774.214963:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745857909695 time 745901644688 state 0x0 ref 1
00000100:00100000:1.0:1789760774.214976:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521029760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760774.215022:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24551424, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:1.0:1789760774.215032:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.215047:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:1.0:1789760774.215052:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760774.215058:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.215077:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760774.268824:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973314 is committed
00002000:00010000:3.0:1789760774.269030:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24551424 -> 24555520
00010000:00010000:3.0:1789760774.269047:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.269062:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.269072:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.269079:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.269085:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.269093:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.269112:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.269120:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60d6c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24551424->24555519] (req 24551424->24555519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.270014:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521029760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55030us (56161us total) trans 4294973314 rc 0/0
00000100:00100000:3.0:1789760774.270031:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6027
00000100:00100000:3.0:1789760774.270040:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745857909695 time 745901644688 state 0x2 ref 0
00000100:00100000:1.0:1789760774.284681:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760774.284783:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521029888
00000100:00100000:2.0:1789760774.284794:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521029888
00000100:00100000:2.0:1789760774.284846:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745857909695 time 745901644688 state 0x0 ref 1
00000100:00100000:2.0:1789760774.284863:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745901905104 time 745901644688 state 0x1 ref 1
00000100:00100000:2.0:1789760774.284894:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745901905104 time 745971576726 state 0x0 ref 1
00000100:00100000:2.0:1789760774.284906:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521029888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760774.284954:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24555520, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:2.0:1789760774.284964:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.284980:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=745s v=(0 0)
00010000:00010000:2.0:1789760774.284984:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760774.284990:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.285003:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760774.342888:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973315 is committed
00002000:00010000:3.0:1789760774.345945:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24555520 -> 24559616
00010000:00010000:3.0:1789760774.345964:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.345977:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.345986:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.345994:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.345999:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.346008:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.346029:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.346036:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d6ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24555520->24559615] (req 24555520->24559615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.346954:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521029888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62043us (62275us total) trans 4294973315 rc 0/0
00000100:00100000:3.0:1789760774.346966:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6028
00000100:00100000:3.0:1789760774.346976:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745901905104 time 745971576726 state 0x2 ref 0
00000100:00100000:2.0:1789760774.352486:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760774.352593:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521030016
00000100:00100000:1.0:1789760774.352603:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521030016
00000100:00100000:1.0:1789760774.352655:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745901905104 time 745971576726 state 0x0 ref 1
00000100:00100000:1.0:1789760774.352671:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745971837142 time 745971576726 state 0x1 ref 1
00000100:00100000:1.0:1789760774.352705:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745971837142 time 746039387052 state 0x0 ref 1
00000100:00100000:1.0:1789760774.352718:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521030016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760774.352766:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24559616, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:1.0:1789760774.352775:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.352790:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:1.0:1789760774.352794:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760774.352799:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.352814:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760774.384551:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973316 is committed
00002000:00010000:3.0:1789760774.384646:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24559616 -> 24563712
00010000:00010000:3.0:1789760774.384663:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.384676:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.384686:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.384693:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.384699:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.384708:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.384726:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.384738:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d6d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24559616->24563711] (req 24559616->24563711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.384853:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521030016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32128us (32366us total) trans 4294973316 rc 0/0
00000100:00100000:3.0:1789760774.384861:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6029
00000100:00100000:3.0:1789760774.384868:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745971837142 time 746039387052 state 0x2 ref 0
00000100:00100000:0.0:1789760774.388241:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.388371:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521030144
00000100:00100000:3.0:1789760774.388380:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521030144
00000100:00100000:3.0:1789760774.388431:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 745971837142 time 746039387052 state 0x0 ref 1
00000100:00100000:3.0:1789760774.388451:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746039647468 time 746039387052 state 0x1 ref 1
00000100:00100000:3.0:1789760774.388480:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746039647468 time 746075162860 state 0x0 ref 1
00000100:00100000:3.0:1789760774.388502:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521030144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.388551:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24563712, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.388560:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.388576:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:3.0:1789760774.388580:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.388586:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.388606:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760774.413175:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973317 is committed
00002000:00010000:3.0:1789760774.413302:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24563712 -> 24567808
00010000:00010000:3.0:1789760774.413351:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.413363:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.413381:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.413389:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.413394:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.413402:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.413422:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.413429:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24563712->24567807] (req 24563712->24567807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.413526:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521030144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25031us (25290us total) trans 4294973317 rc 0/0
00000100:00100000:3.0:1789760774.413537:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6030
00000100:00100000:3.0:1789760774.413546:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746039647468 time 746075162860 state 0x2 ref 0
00000100:00100000:1.0:1789760774.419800:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.419946:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521030272
00000100:00100000:3.0:1789760774.419956:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521030272
00000100:00100000:3.0:1789760774.420006:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746039647468 time 746075162860 state 0x0 ref 1
00000100:00100000:3.0:1789760774.420021:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746075423276 time 746075162860 state 0x1 ref 1
00000100:00100000:3.0:1789760774.420208:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746075423276 time 746106812508 state 0x0 ref 1
00000100:00100000:3.0:1789760774.420224:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521030272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.420269:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24567808, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.420279:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.420295:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:3.0:1789760774.420299:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.420306:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.420809:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760774.447690:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973318 is committed
00002000:00010000:2.0:1789760774.447772:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24567808 -> 24571904
00010000:00010000:2.0:1789760774.447789:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.447802:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.447815:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.447823:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760774.447828:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.447837:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.447855:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.447862:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d6e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24567808->24571903] (req 24567808->24571903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760774.447955:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521030272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27730us (28161us total) trans 4294973318 rc 0/0
00000100:00100000:2.0:1789760774.447966:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6031
00000100:00100000:2.0:1789760774.447975:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746075423276 time 746106812508 state 0x2 ref 0
00000100:00100000:1.0:1789760774.452154:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.452283:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521030400
00000100:00100000:3.0:1789760774.452292:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521030400
00000100:00100000:3.0:1789760774.452382:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746075423276 time 746106812508 state 0x0 ref 1
00000100:00100000:3.0:1789760774.452396:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746107072924 time 746106812508 state 0x1 ref 1
00000100:00100000:3.0:1789760774.452420:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746107072924 time 746139103106 state 0x0 ref 1
00000100:00100000:3.0:1789760774.452433:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521030400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.452484:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24571904, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.452506:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.452521:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:3.0:1789760774.452526:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.452532:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.452545:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760774.485885:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973319 is committed
00002000:00010000:3.0:1789760774.485970:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24571904 -> 24576000
00010000:00010000:3.0:1789760774.485984:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.486002:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.486011:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.486019:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.486090:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.486100:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.486118:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.486195:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24571904->24575999] (req 24571904->24575999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.486402:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521030400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33965us (34252us total) trans 4294973319 rc 0/0
00000100:00100000:3.0:1789760774.486413:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6032
00000100:00100000:3.0:1789760774.486423:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746107072924 time 746139103106 state 0x2 ref 0
00000100:00100000:0.0:1789760774.492055:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760774.492230:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521030528
00000100:00100000:2.0:1789760774.492241:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521030528
00000100:00100000:2.0:1789760774.492299:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746107072924 time 746139103106 state 0x0 ref 1
00000100:00100000:2.0:1789760774.492347:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746139363522 time 746139103106 state 0x1 ref 1
00000100:00100000:2.0:1789760774.492380:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746139363522 time 746179062130 state 0x0 ref 1
00000100:00100000:2.0:1789760774.492393:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521030528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760774.492451:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24576000, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:2.0:1789760774.492461:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.492486:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:2.0:1789760774.492499:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760774.492507:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.492521:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760774.519728:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973320 is committed
00002000:00010000:0.0:1789760774.520366:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24576000 -> 24580096
00010000:00010000:0.0:1789760774.520383:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.520396:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.520404:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.520412:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760774.520416:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.520425:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.520444:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.520451:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d6f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24576000->24580095] (req 24576000->24580095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760774.520546:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521030528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28151us (28505us total) trans 4294973320 rc 0/0
00000100:00100000:0.0:1789760774.520556:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6033
00000100:00100000:0.0:1789760774.520566:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746139363522 time 746179062130 state 0x2 ref 0
00000100:00100000:0.0:1789760774.523614:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.523877:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521030656
00000100:00100000:3.0:1789760774.523887:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521030656
00000100:00100000:3.0:1789760774.523940:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746139363522 time 746179062130 state 0x0 ref 1
00000100:00100000:3.0:1789760774.523954:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746179322546 time 746179062130 state 0x1 ref 1
00000100:00100000:3.0:1789760774.523985:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746179322546 time 746210667538 state 0x0 ref 1
00000100:00100000:3.0:1789760774.523997:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521030656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.524056:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24580096, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.524066:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.524080:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:3.0:1789760774.524084:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.524090:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.524103:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760774.554934:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973321 is committed
00002000:00010000:1.0:1789760774.555095:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24580096 -> 24584192
00010000:00010000:1.0:1789760774.555112:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.555125:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.555136:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.555144:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760774.555149:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.555158:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.555177:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.555185:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d6f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24580096->24584191] (req 24580096->24584191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760774.555310:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521030656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31310us (31702us total) trans 4294973321 rc 0/0
00000100:00100000:1.0:1789760774.555359:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6034
00000100:00100000:1.0:1789760774.555370:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746179322546 time 746210667538 state 0x2 ref 0
00000100:00100000:1.0:1789760774.562482:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.562569:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521030784
00000100:00100000:3.0:1789760774.562579:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521030784
00000100:00100000:3.0:1789760774.562683:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746179322546 time 746210667538 state 0x0 ref 1
00000100:00100000:3.0:1789760774.562698:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746210927954 time 746210667538 state 0x1 ref 1
00000100:00100000:3.0:1789760774.562765:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746210927954 time 746249446454 state 0x0 ref 1
00000100:00100000:3.0:1789760774.562782:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521030784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.562832:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24584192, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.562841:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.562858:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:3.0:1789760774.562862:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.562869:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.562884:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760774.591901:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24584192 -> 24588288
00010000:00010000:2.0:1789760774.591924:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.591938:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.591947:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.591955:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760774.591960:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.591969:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.591988:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.591996:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d6ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24584192->24588287] (req 24584192->24588287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760774.592508:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521030784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29723us (30187us total) trans 4294973322 rc 0/0
00000100:00100000:2.0:1789760774.592520:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6035
00000100:00100000:2.0:1789760774.592530:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746210927954 time 746249446454 state 0x2 ref 0
00000001:00080000:2.0:1789760774.592570:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973322 is committed
00000100:00100000:0.0:1789760774.598976:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760774.599061:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521030912
00000100:00100000:1.0:1789760774.599072:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521030912
00000100:00100000:1.0:1789760774.599252:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746210927954 time 746249446454 state 0x0 ref 1
00000100:00100000:1.0:1789760774.599269:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746249706870 time 746249446454 state 0x1 ref 1
00000100:00100000:1.0:1789760774.599375:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746249706870 time 746286056410 state 0x0 ref 1
00000100:00100000:1.0:1789760774.599388:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521030912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760774.599438:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24588288, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:1.0:1789760774.599447:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.599461:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:1.0:1789760774.599465:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760774.599471:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.599484:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760774.632565:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973323 is committed
00002000:00010000:3.0:1789760774.632589:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24588288 -> 24592384
00010000:00010000:3.0:1789760774.632606:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.632619:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.632628:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.632635:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.632640:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.632649:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.632670:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.632679:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60d706 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24588288->24592383] (req 24588288->24592383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.632766:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521030912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33377us (33797us total) trans 4294973323 rc 0/0
00000100:00100000:3.0:1789760774.632777:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6036
00000100:00100000:3.0:1789760774.632787:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746249706870 time 746286056410 state 0x2 ref 0
00000100:00100000:3.0:1789760774.641429:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760774.641948:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521031040
00000100:00100000:0.0:1789760774.641958:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521031040
00000100:00100000:0.0:1789760774.642013:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746249706870 time 746286056410 state 0x0 ref 1
00000100:00100000:0.0:1789760774.642030:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746286316826 time 746286056410 state 0x1 ref 1
00000100:00100000:0.0:1789760774.642063:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746286316826 time 746328745812 state 0x0 ref 1
00000100:00100000:0.0:1789760774.642076:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521031040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760774.642126:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24592384, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:0.0:1789760774.642135:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.642163:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:0.0:1789760774.642168:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760774.642175:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.642188:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760774.670122:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973324 is committed
00002000:00010000:2.0:1789760774.670186:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24592384 -> 24596480
00010000:00010000:2.0:1789760774.670202:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.670216:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.670226:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.670233:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760774.670238:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.670247:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.670266:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.670274:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d70d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24592384->24596479] (req 24592384->24596479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760774.670511:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521031040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28432us (29085us total) trans 4294973324 rc 0/0
00000100:00100000:2.0:1789760774.670522:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6037
00000100:00100000:2.0:1789760774.670531:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746286316826 time 746328745812 state 0x2 ref 0
00000100:00100000:1.0:1789760774.679485:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.679614:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521031168
00000100:00100000:3.0:1789760774.679624:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521031168
00000100:00100000:3.0:1789760774.679676:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746286316826 time 746328745812 state 0x0 ref 1
00000100:00100000:3.0:1789760774.679693:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746329006228 time 746328745812 state 0x1 ref 1
00000100:00100000:3.0:1789760774.679724:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746329006228 time 746366406894 state 0x0 ref 1
00000100:00100000:3.0:1789760774.679739:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521031168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.679786:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24596480, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.679795:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.679810:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:3.0:1789760774.679814:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.679820:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.679834:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.713694:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760774.734971:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973325 is committed
00002000:00010000:3.0:1789760774.735078:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24596480 -> 24600576
00010000:00010000:3.0:1789760774.735093:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.735106:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.735115:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.735122:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760774.735127:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.735135:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.735444:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.735453:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d714 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24596480->24600575] (req 24596480->24600575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760774.735588:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521031168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55848us (56108us total) trans 4294973325 rc 0/0
00000100:00100000:3.0:1789760774.735599:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6038
00000100:00100000:3.0:1789760774.735608:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746329006228 time 746366406894 state 0x2 ref 0
00000100:00100000:3.0:1789760774.742217:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760774.742279:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521031296
00000100:00100000:2.0:1789760774.742290:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521031296
00000100:00100000:2.0:1789760774.742376:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746329006228 time 746366406894 state 0x0 ref 1
00000100:00100000:2.0:1789760774.742391:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746366667310 time 746366406894 state 0x1 ref 1
00000100:00100000:2.0:1789760774.742424:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746366667310 time 746429106475 state 0x0 ref 1
00000100:00100000:2.0:1789760774.742436:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521031296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760774.742480:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24600576, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:2.0:1789760774.742502:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.742518:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:2.0:1789760774.742522:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760774.742528:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.742542:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760774.772903:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973326 is committed
00002000:00010000:2.0:1789760774.772997:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24600576 -> 24604672
00010000:00010000:2.0:1789760774.773012:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.773034:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.773044:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.773058:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760774.773062:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.773072:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.773092:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.773100:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d71b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24600576->24604671] (req 24600576->24604671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760774.773258:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521031296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30818us (31044us total) trans 4294973326 rc 0/0
00000100:00100000:2.0:1789760774.773269:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6039
00000100:00100000:2.0:1789760774.773278:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746366667310 time 746429106475 state 0x2 ref 0
00000100:00100000:1.0:1789760774.777907:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760774.778194:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521031424
00000100:00100000:3.0:1789760774.778205:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521031424
00000100:00100000:3.0:1789760774.778261:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746366667310 time 746429106475 state 0x0 ref 1
00000100:00100000:3.0:1789760774.778275:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746429366891 time 746429106475 state 0x1 ref 1
00000100:00100000:3.0:1789760774.778307:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746429366891 time 746464989399 state 0x0 ref 1
00000100:00100000:3.0:1789760774.778360:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521031424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760774.778408:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24604672, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:3.0:1789760774.778417:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.778437:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:3.0:1789760774.778441:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760774.778448:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760774.778462:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760774.803907:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973327 is committed
00002000:00010000:1.0:1789760774.804099:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24604672 -> 24608768
00010000:00010000:1.0:1789760774.804113:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.804125:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.804134:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.804140:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760774.804145:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.804153:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.804170:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.804176:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d722 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24604672->24608767] (req 24604672->24608767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760774.804355:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521031424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25994us (26454us total) trans 4294973327 rc 0/0
00000100:00100000:1.0:1789760774.804366:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6040
00000100:00100000:1.0:1789760774.804374:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746429366891 time 746464989399 state 0x2 ref 0
00000100:00100000:1.0:1789760774.809736:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760774.810348:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521031552
00000100:00100000:0.0:1789760774.810359:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521031552
00000100:00100000:0.0:1789760774.810416:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746429366891 time 746464989399 state 0x0 ref 1
00000100:00100000:0.0:1789760774.810432:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746465249815 time 746464989399 state 0x1 ref 1
00000100:00100000:0.0:1789760774.810522:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746465249815 time 746497203311 state 0x0 ref 1
00000100:00100000:0.0:1789760774.810536:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521031552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760774.810599:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24608768, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:0.0:1789760774.810609:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.810624:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:0.0:1789760774.810628:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760774.810635:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.810654:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760774.843978:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973328 is committed
00002000:00010000:1.0:1789760774.844172:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24608768 -> 24612864
00010000:00010000:1.0:1789760774.844188:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.844202:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.844212:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.844220:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760774.844224:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.844234:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.844254:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.844268:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60d729 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24608768->24612863] (req 24608768->24612863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760774.844381:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521031552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33841us (34648us total) trans 4294973328 rc 0/0
00000100:00100000:1.0:1789760774.844391:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6041
00000100:00100000:1.0:1789760774.844402:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746465249815 time 746497203311 state 0x2 ref 0
00000100:00100000:3.0:1789760774.846961:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760774.847197:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521031680
00000100:00100000:1.0:1789760774.847207:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521031680
00000100:00100000:1.0:1789760774.847260:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746465249815 time 746497203311 state 0x0 ref 1
00000100:00100000:1.0:1789760774.847275:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746497463727 time 746497203311 state 0x1 ref 1
00000100:00100000:3.0:1789760774.847654:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746497463727 time 746534333319 state 0x0 ref 1
00000100:00100000:2.0:1789760774.847734:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521031680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760774.847786:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24612864, mtime: 0x6aad9507, atime: 0x0, ctime: 0x6aad9507, blocks: 0xc007
00010000:00010000:2.0:1789760774.847794:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.847808:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:2.0:1789760774.847812:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760774.847817:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.847827:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760774.900783:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973329 is committed
00002000:00010000:0.0:1789760774.902939:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24612864 -> 24616960
00002000:00010000:0.0:1789760774.902948:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760775 -> 1789760776
00002000:00010000:0.0:1789760774.902951:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760775 -> 1789760776
00010000:00010000:0.0:1789760774.902965:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.902977:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.902985:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.902993:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760774.902997:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.903005:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.903129:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760774.903206:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d730 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24612864->24616959] (req 24612864->24616959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760774.903504:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521031680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55823us (56536us total) trans 4294973329 rc 0/0
00000100:00100000:0.0:1789760774.903514:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6042
00000100:00100000:0.0:1789760774.903524:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746497463727 time 746534333319 state 0x2 ref 0
00000100:00100000:3.0:1789760774.907195:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760774.907306:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521031808
00000100:00100000:2.0:1789760774.907343:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521031808
00000100:00100000:2.0:1789760774.907401:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746497463727 time 746534333319 state 0x0 ref 1
00000100:00100000:2.0:1789760774.907417:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746534593735 time 746534333319 state 0x1 ref 1
00000100:00100000:2.0:1789760774.907445:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746534593735 time 746594127526 state 0x0 ref 1
00000100:00100000:2.0:1789760774.907458:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521031808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760774.907546:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24616960, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760774.907555:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.907570:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:2.0:1789760774.907574:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760774.907581:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.907594:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760774.961206:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24616960 -> 24621056
00010000:00010000:2.0:1789760774.961227:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.961240:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.961248:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.961255:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760774.961260:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.961269:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.961289:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760774.961296:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d737 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24616960->24621055] (req 24616960->24621055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760774.961635:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521031808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54174us (54445us total) trans 4294973330 rc 0/0
00000100:00100000:2.0:1789760774.961649:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6043
00000100:00100000:2.0:1789760774.961658:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746534593735 time 746594127526 state 0x2 ref 0
00000001:00080000:2.0:1789760774.961698:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973330 is committed
00000100:00100000:0.0:1789760774.973787:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760774.973883:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521031936
00000100:00100000:1.0:1789760774.973893:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521031936
00000100:00100000:1.0:1789760774.973947:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746534593735 time 746594127526 state 0x0 ref 1
00000100:00100000:1.0:1789760774.973962:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746594387942 time 746594127526 state 0x1 ref 1
00000100:00100000:1.0:1789760774.973993:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746594387942 time 746660675889 state 0x0 ref 1
00000100:00100000:1.0:1789760774.974006:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521031936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760774.974064:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24621056, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:1.0:1789760774.974073:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.974089:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:1.0:1789760774.974094:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760774.974100:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760774.974113:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760775.013855:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24621056 -> 24625152
00010000:00010000:3.0:1789760775.013876:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.013891:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.013900:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.013908:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760775.013914:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.013928:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.013948:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.013956:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d73e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24621056->24625151] (req 24621056->24625151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760775.014067:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521031936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40058us (40285us total) trans 4294973331 rc 0/0
00000100:00100000:3.0:1789760775.014077:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6044
00000100:00100000:3.0:1789760775.014086:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746594387942 time 746660675889 state 0x2 ref 0
00000001:00080000:2.0:1789760775.014945:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973331 is committed
00000100:00100000:2.0:1789760775.018904:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760775.020874:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521032064
00000100:00100000:1.0:1789760775.020887:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521032064
00000100:00100000:1.0:1789760775.020944:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746594387942 time 746660675889 state 0x0 ref 1
00000100:00100000:1.0:1789760775.020959:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746660936305 time 746660675889 state 0x1 ref 1
00000100:00100000:1.0:1789760775.021046:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746660936305 time 746707728185 state 0x0 ref 1
00000100:00100000:1.0:1789760775.021061:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521032064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760775.021109:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24625152, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:1.0:1789760775.021118:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.021133:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:1.0:1789760775.021137:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760775.021152:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.021173:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760775.048555:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24625152 -> 24629248
00010000:00010000:1.0:1789760775.048576:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.048589:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.048599:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.048607:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760775.048612:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.048622:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.048639:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.048647:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d745 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24625152->24629247] (req 24625152->24629247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760775.048742:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521032064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27677us (29840us total) trans 4294973332 rc 0/0
00000100:00100000:1.0:1789760775.048752:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6045
00000100:00100000:1.0:1789760775.048761:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746660936305 time 746707728185 state 0x2 ref 0
00000001:00080000:2.0:1789760775.048964:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973332 is committed
00000100:00100000:1.0:1789760775.052451:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760775.052537:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521032192
00000100:00100000:0.0:1789760775.052546:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521032192
00000100:00100000:0.0:1789760775.052602:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746660936305 time 746707728185 state 0x0 ref 1
00000100:00100000:0.0:1789760775.052619:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746707988601 time 746707728185 state 0x1 ref 1
00000100:00100000:0.0:1789760775.052649:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746707988601 time 746739331943 state 0x0 ref 1
00000100:00100000:0.0:1789760775.052662:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521032192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760775.052708:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24629248, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:0.0:1789760775.052717:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.052734:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:0.0:1789760775.052738:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760775.052744:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.052762:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760775.092772:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973333 is committed
00002000:00010000:3.0:1789760775.093370:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24629248 -> 24633344
00010000:00010000:3.0:1789760775.093387:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.093401:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.093409:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.093417:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760775.093422:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.093431:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.093451:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.093459:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60d74c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24629248->24633343] (req 24629248->24633343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760775.093561:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521032192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40897us (41114us total) trans 4294973333 rc 0/0
00000100:00100000:3.0:1789760775.093572:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6046
00000100:00100000:3.0:1789760775.093581:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746707988601 time 746739331943 state 0x2 ref 0
00000100:00100000:1.0:1789760775.097216:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.097527:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521032320
00000100:00100000:2.0:1789760775.097537:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521032320
00000100:00100000:2.0:1789760775.097596:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746707988601 time 746739331943 state 0x0 ref 1
00000100:00100000:2.0:1789760775.097611:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746739592359 time 746739331943 state 0x1 ref 1
00000100:00100000:2.0:1789760775.097649:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746739592359 time 746784331068 state 0x0 ref 1
00000100:00100000:2.0:1789760775.097660:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521032320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.097709:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24633344, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760775.097728:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.097744:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:2.0:1789760775.097749:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.097755:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.097768:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760775.143767:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973334 is committed
00002000:00010000:3.0:1789760775.143855:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24633344 -> 24637440
00010000:00010000:3.0:1789760775.143870:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.143884:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.143894:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.143907:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760775.143912:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.143922:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.143942:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.143951:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d753 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24633344->24637439] (req 24633344->24637439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760775.144109:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521032320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46445us (46898us total) trans 4294973334 rc 0/0
00000100:00100000:3.0:1789760775.144120:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6047
00000100:00100000:3.0:1789760775.144129:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746739592359 time 746784331068 state 0x2 ref 0
00000100:00100000:3.0:1789760775.149628:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760775.149728:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521032448
00000100:00100000:1.0:1789760775.149737:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521032448
00000100:00100000:1.0:1789760775.149795:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746739592359 time 746784331068 state 0x0 ref 1
00000100:00100000:1.0:1789760775.149812:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746784591484 time 746784331068 state 0x1 ref 1
00000100:00100000:1.0:1789760775.149889:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746784591484 time 746836571269 state 0x0 ref 1
00000100:00100000:1.0:1789760775.149903:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521032448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760775.149961:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24637440, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:1.0:1789760775.149971:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.150001:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:1.0:1789760775.150006:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760775.150013:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.150032:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760775.187678:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973335 is committed
00002000:00010000:2.0:1789760775.187859:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24637440 -> 24641536
00010000:00010000:2.0:1789760775.187875:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.187889:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.187898:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.187905:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.187911:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.187920:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.187940:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.187947:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60d75a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24637440->24641535] (req 24637440->24641535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.188066:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521032448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38160us (38442us total) trans 4294973335 rc 0/0
00000100:00100000:2.0:1789760775.188078:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6048
00000100:00100000:2.0:1789760775.188088:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746784591484 time 746836571269 state 0x2 ref 0
00000100:00100000:0.0:1789760775.191561:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760775.191678:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521032576
00000100:00100000:1.0:1789760775.191688:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521032576
00000100:00100000:1.0:1789760775.191737:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746784591484 time 746836571269 state 0x0 ref 1
00000100:00100000:1.0:1789760775.191753:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746836831685 time 746836571269 state 0x1 ref 1
00000100:00100000:1.0:1789760775.191820:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746836831685 time 746878502034 state 0x0 ref 1
00000100:00100000:1.0:1789760775.191832:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521032576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760775.191879:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24641536, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:1.0:1789760775.191889:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.191904:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:1.0:1789760775.191909:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760775.191916:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.191930:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760775.228089:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973336 is committed
00002000:00010000:2.0:1789760775.228464:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24641536 -> 24645632
00010000:00010000:2.0:1789760775.228545:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.228558:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.228567:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.228585:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.228590:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.228599:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.228619:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.228627:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d761 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24641536->24645631] (req 24641536->24645631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.228762:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521032576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36926us (37205us total) trans 4294973336 rc 0/0
00000100:00100000:2.0:1789760775.228773:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6049
00000100:00100000:2.0:1789760775.228782:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746836831685 time 746878502034 state 0x2 ref 0
00000100:00100000:1.0:1789760775.236963:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760775.237056:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521032704
00000100:00100000:3.0:1789760775.237066:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521032704
00000100:00100000:3.0:1789760775.237186:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746836831685 time 746878502034 state 0x0 ref 1
00000100:00100000:3.0:1789760775.237200:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746878762450 time 746878502034 state 0x1 ref 1
00000100:00100000:3.0:1789760775.237382:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746878762450 time 746924062635 state 0x0 ref 1
00000100:00100000:3.0:1789760775.237395:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521032704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760775.237440:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24645632, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:3.0:1789760775.237450:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.237635:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:3.0:1789760775.237641:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760775.237647:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.237666:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760775.275865:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973337 is committed
00002000:00010000:2.0:1789760775.275995:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24645632 -> 24649728
00010000:00010000:2.0:1789760775.276011:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.276034:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.276042:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.276049:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.276054:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.276062:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.276079:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.276092:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d768 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24645632->24649727] (req 24645632->24649727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.276225:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521032704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38826us (39265us total) trans 4294973337 rc 0/0
00000100:00100000:2.0:1789760775.276236:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6050
00000100:00100000:2.0:1789760775.276246:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746878762450 time 746924062635 state 0x2 ref 0
00000100:00100000:3.0:1789760775.281520:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760775.281675:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521032832
00000100:00100000:0.0:1789760775.281685:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521032832
00000100:00100000:0.0:1789760775.281739:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746878762450 time 746924062635 state 0x0 ref 1
00000100:00100000:0.0:1789760775.281755:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746924323051 time 746924062635 state 0x1 ref 1
00000100:00100000:0.0:1789760775.281823:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746924323051 time 746968505045 state 0x0 ref 1
00000100:00100000:0.0:1789760775.281836:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521032832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760775.281901:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24649728, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:0.0:1789760775.281911:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.281926:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=746s v=(0 0)
00010000:00010000:0.0:1789760775.281932:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760775.281939:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.281953:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760775.323354:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973338 is committed
00002000:00010000:2.0:1789760775.323658:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24649728 -> 24653824
00010000:00010000:2.0:1789760775.323674:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.323686:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.323695:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.323703:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.323708:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.323716:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.323743:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.323750:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d76f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24649728->24653823] (req 24649728->24653823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.323843:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521032832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42004us (42328us total) trans 4294973338 rc 0/0
00000100:00100000:2.0:1789760775.323853:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6051
00000100:00100000:2.0:1789760775.323863:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746924323051 time 746968505045 state 0x2 ref 0
00000100:00100000:0.0:1789760775.328985:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.329116:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521032960
00000100:00100000:2.0:1789760775.329126:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521032960
00000100:00100000:2.0:1789760775.329190:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746924323051 time 746968505045 state 0x0 ref 1
00000100:00100000:2.0:1789760775.329206:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746968765461 time 746968505045 state 0x1 ref 1
00000100:00100000:2.0:1789760775.329232:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746968765461 time 747015914382 state 0x0 ref 1
00000100:00100000:2.0:1789760775.329439:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521032960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.329499:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24653824, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760775.329509:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.329524:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.329529:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.329536:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.329782:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760775.372374:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973339 is committed
00002000:00010000:2.0:1789760775.372479:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24653824 -> 24657920
00010000:00010000:2.0:1789760775.372506:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.372519:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.372527:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.372535:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.372539:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.372615:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.372634:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.372642:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d776 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24653824->24657919] (req 24653824->24657919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.372740:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521032960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43493us (43758us total) trans 4294973339 rc 0/0
00000100:00100000:2.0:1789760775.372751:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6052
00000100:00100000:2.0:1789760775.372759:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746968765461 time 747015914382 state 0x2 ref 0
00000100:00100000:1.0:1789760775.378659:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.378738:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521033088
00000100:00100000:2.0:1789760775.378746:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521033088
00000100:00100000:2.0:1789760775.378788:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 746968765461 time 747015914382 state 0x0 ref 1
00000100:00100000:2.0:1789760775.378800:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747016174798 time 747015914382 state 0x1 ref 1
00000100:00100000:2.0:1789760775.378823:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747016174798 time 747065507504 state 0x0 ref 1
00000100:00100000:2.0:1789760775.378831:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521033088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.378875:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24657920, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760775.378882:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.378893:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.378897:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.378900:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.378910:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760775.425803:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973340 is committed
00002000:00010000:3.0:1789760775.426900:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24657920 -> 24662016
00010000:00010000:3.0:1789760775.426918:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.426932:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.426942:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.426954:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760775.426959:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.426968:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.426987:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.426995:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d77d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24657920->24662015] (req 24657920->24662015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760775.427377:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521033088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48539us (48721us total) trans 4294973340 rc 0/0
00000100:00100000:3.0:1789760775.427389:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6053
00000100:00100000:3.0:1789760775.427398:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747016174798 time 747065507504 state 0x2 ref 0
00000100:00100000:0.0:1789760775.431724:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760775.431827:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521033216
00000100:00100000:3.0:1789760775.431838:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521033216
00000100:00100000:3.0:1789760775.431892:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747016174798 time 747065507504 state 0x0 ref 1
00000100:00100000:3.0:1789760775.431907:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747065767920 time 747065507504 state 0x1 ref 1
00000100:00100000:3.0:1789760775.431972:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747065767920 time 747118653891 state 0x0 ref 1
00000100:00100000:3.0:1789760775.431999:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521033216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760775.432045:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24662016, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:3.0:1789760775.432054:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.432070:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:3.0:1789760775.432075:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760775.432081:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.432094:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760775.457770:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973341 is committed
00002000:00010000:2.0:1789760775.457796:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24662016 -> 24666112
00010000:00010000:2.0:1789760775.457819:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.457832:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.457842:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.457850:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.457859:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.457868:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.457887:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.457895:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d784 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24662016->24666111] (req 24662016->24666111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.457978:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521033216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25978us (26258us total) trans 4294973341 rc 0/0
00000100:00100000:2.0:1789760775.457991:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6054
00000100:00100000:2.0:1789760775.458000:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747065767920 time 747118653891 state 0x2 ref 0
00000100:00100000:0.0:1789760775.461189:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.461271:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521033344
00000100:00100000:2.0:1789760775.461285:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521033344
00000100:00100000:2.0:1789760775.461366:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747065767920 time 747118653891 state 0x0 ref 1
00000100:00100000:2.0:1789760775.461383:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747118914307 time 747118653891 state 0x1 ref 1
00000100:00100000:2.0:1789760775.461413:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747118914307 time 747148096275 state 0x0 ref 1
00000100:00100000:2.0:1789760775.461427:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521033344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.461475:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24666112, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760775.461494:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.461509:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.461513:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.461519:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.461534:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760775.490336:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973342 is committed
00002000:00010000:0.0:1789760775.490463:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24666112 -> 24670208
00010000:00010000:0.0:1789760775.490481:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.490504:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.490513:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.490520:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760775.490525:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.490534:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.490555:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.490562:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d78b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24666112->24670207] (req 24666112->24670207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760775.490659:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521033344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29231us (29481us total) trans 4294973342 rc 0/0
00000100:00100000:0.0:1789760775.490669:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6055
00000100:00100000:0.0:1789760775.490678:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747118914307 time 747148096275 state 0x2 ref 0
00000100:00100000:0.0:1789760775.493596:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.494970:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521033472
00000100:00100000:2.0:1789760775.494982:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521033472
00000100:00100000:2.0:1789760775.495039:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747118914307 time 747148096275 state 0x0 ref 1
00000100:00100000:2.0:1789760775.495053:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747148356691 time 747148096275 state 0x1 ref 1
00000100:00100000:2.0:1789760775.495088:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747148356691 time 747181770408 state 0x0 ref 1
00000100:00100000:2.0:1789760775.495099:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521033472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.495144:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24670208, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760775.495153:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.495168:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.495172:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.495179:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.495191:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760775.530138:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973343 is committed
00002000:00010000:2.0:1789760775.530245:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24670208 -> 24674304
00010000:00010000:2.0:1789760775.530261:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.530274:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.530284:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.530292:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.530298:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.530307:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.530356:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.530364:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d792 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24670208->24674303] (req 24670208->24674303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.530451:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521033472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35349us (36860us total) trans 4294973343 rc 0/0
00000100:00100000:2.0:1789760775.530462:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6056
00000100:00100000:2.0:1789760775.530472:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747148356691 time 747181770408 state 0x2 ref 0
00000100:00100000:3.0:1789760775.533403:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760775.534305:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521033600
00000100:00100000:1.0:1789760775.534347:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521033600
00000100:00100000:1.0:1789760775.534406:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747148356691 time 747181770408 state 0x0 ref 1
00000100:00100000:1.0:1789760775.534421:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747182030824 time 747181770408 state 0x1 ref 1
00000100:00100000:1.0:1789760775.534444:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747182030824 time 747221126902 state 0x0 ref 1
00000100:00100000:1.0:1789760775.534457:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521033600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760775.534516:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24674304, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:1.0:1789760775.534526:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.534542:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:1.0:1789760775.534547:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760775.534553:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760775.534568:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760775.565282:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973344 is committed
00002000:00010000:2.0:1789760775.565448:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24674304 -> 24678400
00010000:00010000:2.0:1789760775.565464:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.565477:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.565502:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.565509:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.565514:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.565524:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.565543:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.565551:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d799 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24674304->24678399] (req 24674304->24678399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.565675:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521033600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31215us (32277us total) trans 4294973344 rc 0/0
00000100:00100000:2.0:1789760775.565686:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6057
00000100:00100000:2.0:1789760775.565695:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747182030824 time 747221126902 state 0x2 ref 0
00000100:00100000:1.0:1789760775.569545:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760775.569593:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521033728
00000100:00100000:3.0:1789760775.569602:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521033728
00000100:00100000:3.0:1789760775.569655:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747182030824 time 747221126902 state 0x0 ref 1
00000100:00100000:3.0:1789760775.569671:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747221387318 time 747221126902 state 0x1 ref 1
00000100:00100000:3.0:1789760775.569701:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747221387318 time 747256383837 state 0x0 ref 1
00000100:00100000:3.0:1789760775.569713:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521033728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760775.569761:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24678400, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:3.0:1789760775.569771:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.569786:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:3.0:1789760775.569790:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760775.569796:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.569809:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760775.611692:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973345 is committed
00002000:00010000:2.0:1789760775.611818:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24678400 -> 24682496
00010000:00010000:2.0:1789760775.611833:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.611851:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.611859:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.611866:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.611871:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.611881:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.611905:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.611913:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d7a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24678400->24682495] (req 24678400->24682495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.613010:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521033728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43289us (43465us total) trans 4294973345 rc 0/0
00000100:00100000:2.0:1789760775.613024:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6058
00000100:00100000:2.0:1789760775.613034:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747221387318 time 747256383837 state 0x2 ref 0
00000100:00100000:0.0:1789760775.619369:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.619464:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521033856
00000100:00100000:2.0:1789760775.619474:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521033856
00000100:00100000:2.0:1789760775.619536:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747221387318 time 747256383837 state 0x0 ref 1
00000100:00100000:2.0:1789760775.619551:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747256644253 time 747256383837 state 0x1 ref 1
00000100:00100000:2.0:1789760775.619571:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747256644253 time 747306254863 state 0x0 ref 1
00000100:00100000:2.0:1789760775.619583:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521033856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.619627:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24682496, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760775.619635:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.619651:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.619654:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.619661:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.619674:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760775.669420:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973346 is committed
00002000:00010000:2.0:1789760775.669728:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24682496 -> 24686592
00010000:00010000:2.0:1789760775.669744:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.669756:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.669771:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.669778:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.669783:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.669791:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.669866:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.669875:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24682496->24686591] (req 24682496->24686591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.669996:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521033856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50410us (50632us total) trans 4294973346 rc 0/0
00000100:00100000:2.0:1789760775.670007:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6059
00000100:00100000:2.0:1789760775.670025:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747256644253 time 747306254863 state 0x2 ref 0
00000100:00100000:3.0:1789760775.677637:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.677749:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521033984
00000100:00100000:2.0:1789760775.677759:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521033984
00000100:00100000:2.0:1789760775.678808:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747256644253 time 747306254863 state 0x0 ref 1
00000100:00100000:2.0:1789760775.678830:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747306515279 time 747306254863 state 0x1 ref 1
00000100:00100000:3.0:1789760775.678908:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747306515279 time 747365588214 state 0x0 ref 1
00000100:00100000:3.0:1789760775.678927:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521033984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760775.678977:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24686592, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:3.0:1789760775.678987:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.679004:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:3.0:1789760775.679008:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760775.679080:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.679103:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760775.737592:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973347 is committed
00002000:00010000:2.0:1789760775.737716:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24686592 -> 24690688
00010000:00010000:2.0:1789760775.737731:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.737743:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.737751:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.737758:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.737763:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.737771:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.737789:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.737797:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d7ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24686592->24690687] (req 24686592->24690687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.737898:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521033984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 58973us (60267us total) trans 4294973347 rc 0/0
00000100:00100000:2.0:1789760775.737907:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6060
00000100:00100000:2.0:1789760775.737917:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747306515279 time 747365588214 state 0x2 ref 0
00010000:00010000:0.0:1789760775.738698:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1789760775.745653:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.745743:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521034112
00000100:00100000:2.0:1789760775.745754:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521034112
00000100:00100000:2.0:1789760775.745809:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747306515279 time 747365588214 state 0x0 ref 1
00000100:00100000:2.0:1789760775.745825:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747365848630 time 747365588214 state 0x1 ref 1
00000100:00100000:2.0:1789760775.745864:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747365848630 time 747432545860 state 0x0 ref 1
00000100:00100000:2.0:1789760775.745877:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521034112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.745926:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24690688, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760775.745936:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.745953:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.745957:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.745964:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.745977:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760775.778331:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973348 is committed
00002000:00010000:2.0:1789760775.778418:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24690688 -> 24694784
00010000:00010000:2.0:1789760775.778437:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.778456:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.778465:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.778472:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.778477:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.778499:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.778521:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.778530:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24690688->24694783] (req 24690688->24694783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.778658:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521034112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32778us (33009us total) trans 4294973348 rc 0/0
00000100:00100000:2.0:1789760775.778669:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6061
00000100:00100000:2.0:1789760775.778679:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747365848630 time 747432545860 state 0x2 ref 0
00000100:00100000:1.0:1789760775.781242:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.781301:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521034240
00000100:00100000:2.0:1789760775.781310:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521034240
00000100:00100000:2.0:1789760775.781383:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747365848630 time 747432545860 state 0x0 ref 1
00000100:00100000:2.0:1789760775.781397:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747432806276 time 747432545860 state 0x1 ref 1
00000100:00100000:2.0:1789760775.781425:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747432806276 time 747468108578 state 0x0 ref 1
00000100:00100000:2.0:1789760775.781555:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521034240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.781771:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24694784, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:2.0:1789760775.781781:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.781797:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.781800:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.781807:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.781820:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.803291:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789760775.803327:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548768768:0@lo:41:osp-pre-0-1.0
00000100:00100000:2.0:1789760775.803391:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760775.803473:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548768768
00000100:00100000:2.0:1789760775.803490:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548768768
00000100:00100000:2.0:1789760775.803535:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453
00000100:00100000:2.0:1789760775.803549:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548768768:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1789760775.803591:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:2.0:1789760775.803638:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548768768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (247us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760775.803645:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453
00000100:00100000:2.0:1789760775.803689:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548768768:0@lo:41:osp-pre-0-1.0
00000001:00080000:1.0:1789760775.812724:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973349 is committed
00002000:00010000:2.0:1789760775.814375:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24694784 -> 24698880
00010000:00010000:2.0:1789760775.814395:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.814409:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.814418:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.814425:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.814429:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.814438:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.814458:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.814466:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24694784->24698879] (req 24694784->24698879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.814569:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521034240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33129us (33332us total) trans 4294973349 rc 0/0
00000100:00100000:2.0:1789760775.814579:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6062
00000100:00100000:2.0:1789760775.814589:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747432806276 time 747468108578 state 0x2 ref 0
00000100:00100000:3.0:1789760775.820139:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760775.820309:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521034368
00000100:00100000:0.0:1789760775.820360:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521034368
00000100:00100000:0.0:1789760775.820414:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747432806276 time 747468108578 state 0x0 ref 1
00000100:00100000:0.0:1789760775.820428:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747468368994 time 747468108578 state 0x1 ref 1
00000100:00100000:0.0:1789760775.820467:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747468368994 time 747507142166 state 0x0 ref 1
00000100:00100000:0.0:1789760775.820652:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521034368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760775.820701:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24698880, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:0.0:1789760775.820711:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.820726:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:0.0:1789760775.820731:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760775.820738:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.820758:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760775.867337:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973350 is committed
00002000:00010000:0.0:1789760775.867434:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24698880 -> 24702976
00010000:00010000:0.0:1789760775.867451:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.867464:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.867473:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.867489:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760775.867494:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.867503:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.867523:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760775.867531:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d7c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24698880->24702975] (req 24698880->24702975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760775.867629:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521034368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47146us (47494us total) trans 4294973350 rc 0/0
00000100:00100000:0.0:1789760775.867640:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6063
00000100:00100000:0.0:1789760775.867649:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747468368994 time 747507142166 state 0x2 ref 0
00000100:00100000:1.0:1789760775.876878:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760775.876962:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521034496
00000100:00100000:3.0:1789760775.876972:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521034496
00000100:00100000:3.0:1789760775.877034:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747468368994 time 747507142166 state 0x0 ref 1
00000100:00100000:3.0:1789760775.877050:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747507402582 time 747507142166 state 0x1 ref 1
00000100:00100000:3.0:1789760775.877166:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747507402582 time 747563847163 state 0x0 ref 1
00000100:00100000:3.0:1789760775.877180:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521034496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760775.877225:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24702976, mtime: 0x6aad9508, atime: 0x0, ctime: 0x6aad9508, blocks: 0xc007
00010000:00010000:3.0:1789760775.877235:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.877250:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:3.0:1789760775.877255:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760775.877261:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760775.877274:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760775.930739:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24702976 -> 24707072
00002000:00010000:2.0:1789760775.930748:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760776 -> 1789760777
00002000:00010000:2.0:1789760775.930751:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760776 -> 1789760777
00010000:00010000:2.0:1789760775.930769:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.930783:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.930792:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.930799:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.930804:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.930813:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.930836:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.930843:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d7ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24702976->24707071] (req 24702976->24707071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.930933:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521034496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53751us (54058us total) trans 4294973351 rc 0/0
00000100:00100000:2.0:1789760775.930943:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6064
00000100:00100000:2.0:1789760775.930952:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747507402582 time 747563847163 state 0x2 ref 0
00000001:00080000:2.0:1789760775.930989:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973351 is committed
00000100:00100000:1.0:1789760775.936100:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.936283:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521034624
00000100:00100000:2.0:1789760775.936292:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521034624
00000100:00100000:2.0:1789760775.936372:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747507402582 time 747563847163 state 0x0 ref 1
00000100:00100000:2.0:1789760775.936388:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747564107579 time 747563847163 state 0x1 ref 1
00000100:00100000:2.0:1789760775.937559:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747564107579 time 747624235858 state 0x0 ref 1
00000100:00100000:2.0:1789760775.937580:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521034624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.937633:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24707072, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760775.937642:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.937665:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.937669:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.937676:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.937689:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760775.964504:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24707072 -> 24711168
00010000:00010000:2.0:1789760775.964522:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.964535:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.964543:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.964550:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760775.964555:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.964563:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.964581:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.964589:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24707072->24711167] (req 24707072->24711167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760775.964676:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521034624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27098us (28580us total) trans 4294973352 rc 0/0
00000100:00100000:2.0:1789760775.964687:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6065
00000100:00100000:2.0:1789760775.964698:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747564107579 time 747624235858 state 0x2 ref 0
00000001:00080000:2.0:1789760775.964738:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973352 is committed
00000100:00100000:3.0:1789760775.970255:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760775.970515:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521034752
00000100:00100000:2.0:1789760775.970526:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521034752
00000100:00100000:2.0:1789760775.970581:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747564107579 time 747624235858 state 0x0 ref 1
00000100:00100000:2.0:1789760775.970595:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747624496274 time 747624235858 state 0x1 ref 1
00000100:00100000:2.0:1789760775.970622:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747624496274 time 747657304544 state 0x0 ref 1
00000100:00100000:2.0:1789760775.970635:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521034752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760775.970685:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24711168, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760775.970694:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.970710:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760775.970715:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760775.970721:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760775.970736:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.027103:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973353 is committed
00002000:00010000:2.0:1789760776.027199:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24711168 -> 24715264
00010000:00010000:2.0:1789760776.027215:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.027228:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.027236:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.027244:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.027249:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.027256:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.027274:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.027282:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24711168->24715263] (req 24711168->24715263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.027419:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521034752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56782us (57169us total) trans 4294973353 rc 0/0
00000100:00100000:2.0:1789760776.027430:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6066
00000100:00100000:2.0:1789760776.027439:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747624496274 time 747657304544 state 0x2 ref 0
00000100:00100000:1.0:1789760776.032856:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760776.032943:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521034880
00000100:00100000:3.0:1789760776.032953:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521034880
00000100:00100000:3.0:1789760776.033026:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747624496274 time 747657304544 state 0x0 ref 1
00000100:00100000:3.0:1789760776.033042:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747657564960 time 747657304544 state 0x1 ref 1
00000100:00100000:3.0:1789760776.033119:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747657564960 time 747719800568 state 0x0 ref 1
00000100:00100000:3.0:1789760776.033132:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521034880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760776.033177:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24715264, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:3.0:1789760776.033187:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760776.033661:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1789760776.034711:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:3.0:1789760776.034716:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760776.034724:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.034744:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.071213:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973354 is committed
00002000:00010000:2.0:1789760776.071418:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24715264 -> 24719360
00010000:00010000:2.0:1789760776.071434:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.071447:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.071456:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.071463:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.071468:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.071477:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.071505:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.071518:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d7df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24715264->24719359] (req 24715264->24719359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.071734:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9df6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521034880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38600us (38882us total) trans 4294973354 rc 0/0
00000100:00100000:2.0:1789760776.071747:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6067
00000100:00100000:2.0:1789760776.071756:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747657564960 time 747719800568 state 0x2 ref 0
00000100:00100000:1.0:1789760776.075217:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760776.075426:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521035008
00000100:00100000:3.0:1789760776.075435:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521035008
00000100:00100000:3.0:1789760776.075503:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747657564960 time 747719800568 state 0x0 ref 1
00000100:00100000:3.0:1789760776.075519:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747720060984 time 747719800568 state 0x1 ref 1
00000100:00100000:3.0:1789760776.075641:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747720060984 time 747762321720 state 0x0 ref 1
00000100:00100000:3.0:1789760776.075654:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521035008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760776.075705:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24719360, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:3.0:1789760776.075715:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.075733:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:3.0:1789760776.075737:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760776.075744:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.075759:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760776.109470:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973355 is committed
00002000:00010000:2.0:1789760776.109565:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24719360 -> 24723456
00010000:00010000:2.0:1789760776.109654:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.109668:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.109678:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.109685:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.109689:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.109698:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.109722:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.109730:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d7e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24719360->24723455] (req 24719360->24723455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.109859:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521035008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34202us (34648us total) trans 4294973355 rc 0/0
00000100:00100000:2.0:1789760776.109871:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6068
00000100:00100000:2.0:1789760776.109880:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747720060984 time 747762321720 state 0x2 ref 0
00000100:00100000:3.0:1789760776.117688:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.118536:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521035136
00000100:00100000:2.0:1789760776.118547:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521035136
00000100:00100000:2.0:1789760776.118602:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747720060984 time 747762321720 state 0x0 ref 1
00000100:00100000:2.0:1789760776.118617:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747762582136 time 747762321720 state 0x1 ref 1
00000100:00100000:2.0:1789760776.118648:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747762582136 time 747805331400 state 0x0 ref 1
00000100:00100000:2.0:1789760776.118660:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521035136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.118712:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24723456, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.118722:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.118737:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760776.118742:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.118748:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.118762:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.166278:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973356 is committed
00002000:00010000:2.0:1789760776.166411:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24723456 -> 24727552
00010000:00010000:2.0:1789760776.166427:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.166442:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.166451:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.166459:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.166463:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.166473:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.166504:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.166513:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d7ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24723456->24727551] (req 24723456->24727551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.166608:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521035136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47945us (48926us total) trans 4294973356 rc 0/0
00000100:00100000:2.0:1789760776.166618:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6069
00000100:00100000:2.0:1789760776.166628:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747762582136 time 747805331400 state 0x2 ref 0
00000100:00100000:1.0:1789760776.171919:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.172210:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521035264
00000100:00100000:2.0:1789760776.172220:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521035264
00000100:00100000:2.0:1789760776.172274:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747762582136 time 747805331400 state 0x0 ref 1
00000100:00100000:2.0:1789760776.172289:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747805591816 time 747805331400 state 0x1 ref 1
00000100:00100000:2.0:1789760776.172407:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747805591816 time 747859088453 state 0x0 ref 1
00000100:00100000:2.0:1789760776.172421:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521035264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.172471:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24727552, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.172490:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.172506:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760776.172516:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.172523:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.172537:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.207189:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973357 is committed
00002000:00010000:2.0:1789760776.207411:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24727552 -> 24731648
00010000:00010000:2.0:1789760776.207426:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.207438:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.207446:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.207453:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.207457:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.207466:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.207494:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.207503:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d7f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24727552->24731647] (req 24727552->24731647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.207729:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521035264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35304us (35814us total) trans 4294973357 rc 0/0
00000100:00100000:2.0:1789760776.207742:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6070
00000100:00100000:2.0:1789760776.208067:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747805591816 time 747859088453 state 0x2 ref 0
00000100:00100000:0.0:1789760776.214526:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760776.214835:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521035392
00000100:00100000:3.0:1789760776.214846:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521035392
00000100:00100000:3.0:1789760776.214896:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747805591816 time 747859088453 state 0x0 ref 1
00000100:00100000:3.0:1789760776.214911:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747859348869 time 747859088453 state 0x1 ref 1
00000100:00100000:3.0:1789760776.214943:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747859348869 time 747901626086 state 0x0 ref 1
00000100:00100000:3.0:1789760776.214959:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521035392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760776.215005:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24731648, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:3.0:1789760776.215025:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.215040:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:3.0:1789760776.215044:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760776.215050:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.215063:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.268216:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973358 is committed
00002000:00010000:2.0:1789760776.268337:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24731648 -> 24735744
00010000:00010000:2.0:1789760776.268353:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.268366:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.268375:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.268382:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.268387:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.268395:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.268413:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.268420:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d7fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24731648->24735743] (req 24731648->24735743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.268644:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521035392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53683us (54133us total) trans 4294973358 rc 0/0
00000100:00100000:2.0:1789760776.268655:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6071
00000100:00100000:2.0:1789760776.268663:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747859348869 time 747901626086 state 0x2 ref 0
00000100:00100000:3.0:1789760776.276975:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.277057:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521035520
00000100:00100000:2.0:1789760776.277067:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521035520
00000100:00100000:2.0:1789760776.277122:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747859348869 time 747901626086 state 0x0 ref 1
00000100:00100000:2.0:1789760776.277138:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747901886502 time 747901626086 state 0x1 ref 1
00000100:00100000:2.0:1789760776.277172:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747901886502 time 747963854326 state 0x0 ref 1
00000100:00100000:2.0:1789760776.277184:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521035520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.277234:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24735744, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.277244:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.277259:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=747s v=(0 0)
00010000:00010000:2.0:1789760776.277263:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.277270:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.277283:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.333221:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973359 is committed
00002000:00010000:2.0:1789760776.333353:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24735744 -> 24739840
00010000:00010000:2.0:1789760776.333370:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.333382:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.333392:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.333399:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.333405:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.333413:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.333436:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.333444:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d802 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24735744->24739839] (req 24735744->24739839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.333540:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521035520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56354us (56570us total) trans 4294973359 rc 0/0
00000100:00100000:2.0:1789760776.333554:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6072
00000100:00100000:2.0:1789760776.333563:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747901886502 time 747963854326 state 0x2 ref 0
00000100:00100000:1.0:1789760776.337938:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.338025:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521035648
00000100:00100000:2.0:1789760776.338035:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521035648
00000100:00100000:2.0:1789760776.338085:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747901886502 time 747963854326 state 0x0 ref 1
00000100:00100000:2.0:1789760776.338100:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747964114742 time 747963854326 state 0x1 ref 1
00000100:00100000:2.0:1789760776.338132:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747964114742 time 748024814849 state 0x0 ref 1
00000100:00100000:2.0:1789760776.338144:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521035648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.338191:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24739840, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.338200:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.338215:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760776.338219:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.338225:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.338239:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.387468:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973360 is committed
00002000:00010000:1.0:1789760776.387609:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24739840 -> 24743936
00010000:00010000:1.0:1789760776.387625:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.387639:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.387648:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.387656:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760776.387661:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.387674:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.387695:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.387702:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60d809 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24739840->24743935] (req 24739840->24743935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760776.387976:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521035648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49829us (50045us total) trans 4294973360 rc 0/0
00000100:00100000:1.0:1789760776.387988:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6073
00000100:00100000:1.0:1789760776.387999:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747964114742 time 748024814849 state 0x2 ref 0
00000100:00100000:0.0:1789760776.391470:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.391577:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521035776
00000100:00100000:2.0:1789760776.391586:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521035776
00000100:00100000:2.0:1789760776.391639:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 747964114742 time 748024814849 state 0x0 ref 1
00000100:00100000:2.0:1789760776.391654:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748025075265 time 748024814849 state 0x1 ref 1
00000100:00100000:2.0:1789760776.391683:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748025075265 time 748078366202 state 0x0 ref 1
00000100:00100000:2.0:1789760776.391695:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521035776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.391746:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24743936, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.391757:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.391773:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760776.391778:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.391785:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.391869:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760776.439614:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973361 is committed
00002000:00010000:2.0:1789760776.440739:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24743936 -> 24748032
00010000:00010000:2.0:1789760776.440766:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.440783:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.440792:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.440800:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.440805:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.440814:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.440831:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.440838:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d810 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24743936->24748031] (req 24743936->24748031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.440932:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521035776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49233us (49466us total) trans 4294973361 rc 0/0
00000100:00100000:2.0:1789760776.440943:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6074
00000100:00100000:2.0:1789760776.440952:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748025075265 time 748078366202 state 0x2 ref 0
00000100:00100000:3.0:1789760776.450770:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.451183:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521035904
00000100:00100000:2.0:1789760776.451194:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521035904
00000100:00100000:2.0:1789760776.451687:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748025075265 time 748078366202 state 0x0 ref 1
00000100:00100000:2.0:1789760776.451703:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748078626618 time 748078366202 state 0x1 ref 1
00000100:00100000:2.0:1789760776.451737:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748078626618 time 748138419747 state 0x0 ref 1
00000100:00100000:2.0:1789760776.451753:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521035904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.451801:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24748032, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.451810:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.451826:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760776.451830:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.451837:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.451850:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760776.498765:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973362 is committed
00002000:00010000:2.0:1789760776.499205:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24748032 -> 24752128
00010000:00010000:2.0:1789760776.499474:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.499497:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.499506:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.499514:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.499519:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.499529:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.499547:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.499555:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d817 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24748032->24752127] (req 24748032->24752127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.499685:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521035904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47929us (48920us total) trans 4294973362 rc 0/0
00000100:00100000:2.0:1789760776.499696:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6075
00000100:00100000:2.0:1789760776.499705:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748078626618 time 748138419747 state 0x2 ref 0
00000100:00100000:1.0:1789760776.503486:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760776.503572:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521036032
00000100:00100000:3.0:1789760776.503583:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521036032
00000100:00100000:3.0:1789760776.503636:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748078626618 time 748138419747 state 0x0 ref 1
00000100:00100000:3.0:1789760776.503650:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748138680163 time 748138419747 state 0x1 ref 1
00000100:00100000:3.0:1789760776.503712:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748138680163 time 748190393721 state 0x0 ref 1
00000100:00100000:3.0:1789760776.503725:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521036032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760776.503772:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24752128, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:3.0:1789760776.503781:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.503796:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:3.0:1789760776.503800:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760776.503807:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.503820:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760776.546767:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24752128 -> 24756224
00010000:00010000:3.0:1789760776.546786:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.546800:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.546808:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.546816:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760776.546821:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.546830:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.546852:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.546859:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d81e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24752128->24756223] (req 24752128->24756223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760776.546962:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521036032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43234us (43488us total) trans 4294973363 rc 0/0
00000100:00100000:3.0:1789760776.546973:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6076
00000100:00100000:3.0:1789760776.546983:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748138680163 time 748190393721 state 0x2 ref 0
00000001:00080000:1.0:1789760776.547216:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973363 is committed
00000100:00100000:1.0:1789760776.550536:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.550611:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521036160
00000100:00100000:2.0:1789760776.550620:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521036160
00000100:00100000:2.0:1789760776.550672:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748138680163 time 748190393721 state 0x0 ref 1
00000100:00100000:2.0:1789760776.550687:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748190654137 time 748190393721 state 0x1 ref 1
00000100:00100000:2.0:1789760776.550712:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748190654137 time 748237395076 state 0x0 ref 1
00000100:00100000:2.0:1789760776.550723:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521036160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.550772:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24756224, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.550782:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.550799:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760776.550804:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.550810:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.550825:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760776.584938:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973364 is committed
00002000:00010000:2.0:1789760776.585007:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24756224 -> 24760320
00010000:00010000:2.0:1789760776.585024:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.585036:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.585043:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.585050:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.585055:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.585064:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.585083:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.585092:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d825 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24756224->24760319] (req 24756224->24760319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.585184:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521036160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34457us (34652us total) trans 4294973364 rc 0/0
00000100:00100000:2.0:1789760776.585195:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6077
00000100:00100000:2.0:1789760776.585205:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748190654137 time 748237395076 state 0x2 ref 0
00000100:00100000:2.0:1789760776.589466:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760776.589676:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521036288
00000100:00100000:3.0:1789760776.589685:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521036288
00000100:00100000:0.0:1789760776.589849:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748190654137 time 748237395076 state 0x0 ref 1
00000100:00100000:0.0:1789760776.589865:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748237655492 time 748237395076 state 0x1 ref 1
00000100:00100000:0.0:1789760776.589927:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748237655492 time 748276609324 state 0x0 ref 1
00000100:00100000:0.0:1789760776.589939:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521036288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760776.589985:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24760320, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:0.0:1789760776.589993:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.590023:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:0.0:1789760776.590027:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760776.590033:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.590047:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760776.634123:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24760320 -> 24764416
00010000:00010000:0.0:1789760776.634155:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.634272:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.634280:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.634288:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760776.634293:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.634302:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.634339:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.634349:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d82c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24760320->24764415] (req 24760320->24764415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760776.634441:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521036288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44499us (44981us total) trans 4294973365 rc 0/0
00000100:00100000:0.0:1789760776.634451:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6078
00000100:00100000:0.0:1789760776.634461:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748237655492 time 748276609324 state 0x2 ref 0
00000001:00080000:3.0:1789760776.635393:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973365 is committed
00000100:00100000:0.0:1789760776.636921:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760776.637487:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521036416
00000100:00100000:3.0:1789760776.637498:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521036416
00000100:00100000:3.0:1789760776.637553:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748237655492 time 748276609324 state 0x0 ref 1
00000100:00100000:3.0:1789760776.637567:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748276869740 time 748276609324 state 0x1 ref 1
00000100:00100000:3.0:1789760776.637598:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748276869740 time 748324280506 state 0x0 ref 1
00000100:00100000:3.0:1789760776.637611:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521036416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760776.637658:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24764416, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:3.0:1789760776.637669:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.637684:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:3.0:1789760776.637688:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760776.637693:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.637707:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.675374:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973366 is committed
00002000:00010000:3.0:1789760776.675572:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24764416 -> 24768512
00010000:00010000:3.0:1789760776.675586:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.675599:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.675609:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.675616:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760776.675621:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.675630:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.675653:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.675661:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d833 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24764416->24768511] (req 24764416->24768511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760776.675775:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521036416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38162us (38856us total) trans 4294973366 rc 0/0
00000100:00100000:3.0:1789760776.675786:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6079
00000100:00100000:3.0:1789760776.675795:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748276869740 time 748324280506 state 0x2 ref 0
00000100:00100000:1.0:1789760776.679409:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760776.679607:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521036544
00000100:00100000:3.0:1789760776.679617:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521036544
00000100:00100000:3.0:1789760776.679670:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748276869740 time 748324280506 state 0x0 ref 1
00000100:00100000:3.0:1789760776.679685:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748324540922 time 748324280506 state 0x1 ref 1
00000100:00100000:3.0:1789760776.679765:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748324540922 time 748366446986 state 0x0 ref 1
00000100:00100000:3.0:1789760776.679779:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521036544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760776.679829:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24768512, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:3.0:1789760776.679839:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.679853:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:3.0:1789760776.679859:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760776.679865:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.679878:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760776.724959:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24768512 -> 24772608
00010000:00010000:3.0:1789760776.724979:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.724991:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.725000:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.725018:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760776.725023:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.725032:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.725051:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.725060:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d83a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24768512->24772607] (req 24768512->24772607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760776.725159:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521036544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45378us (45755us total) trans 4294973367 rc 0/0
00000100:00100000:3.0:1789760776.725169:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6080
00000100:00100000:3.0:1789760776.725178:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748324540922 time 748366446986 state 0x2 ref 0
00000001:00080000:1.0:1789760776.725931:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973367 is committed
00000100:00100000:2.0:1789760776.735991:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760776.736180:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521036672
00000100:00100000:1.0:1789760776.736189:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521036672
00000100:00100000:1.0:1789760776.736252:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748324540922 time 748366446986 state 0x0 ref 1
00000100:00100000:1.0:1789760776.736267:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748366707402 time 748366446986 state 0x1 ref 1
00000100:00100000:1.0:1789760776.736296:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748366707402 time 748422978703 state 0x0 ref 1
00000100:00100000:1.0:1789760776.736308:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521036672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760776.736402:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24772608, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:1.0:1789760776.736419:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.736434:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:1.0:1789760776.736438:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760776.736448:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.736464:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.762891:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760776.766535:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973368 is committed
00002000:00010000:1.0:1789760776.766597:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24772608 -> 24776704
00010000:00010000:1.0:1789760776.766613:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.766626:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.766635:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.766647:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760776.766652:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.766661:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.766681:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.766694:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d841 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24772608->24776703] (req 24772608->24776703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760776.766788:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521036672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30477us (30801us total) trans 4294973368 rc 0/0
00000100:00100000:1.0:1789760776.766799:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6081
00000100:00100000:1.0:1789760776.766808:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748366707402 time 748422978703 state 0x2 ref 0
00000100:00100000:0.0:1789760776.773724:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.773826:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521036800
00000100:00100000:2.0:1789760776.773836:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521036800
00000100:00100000:2.0:1789760776.773892:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748366707402 time 748422978703 state 0x0 ref 1
00000100:00100000:2.0:1789760776.773907:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748423239119 time 748422978703 state 0x1 ref 1
00000100:00100000:2.0:1789760776.773938:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748423239119 time 748460620803 state 0x0 ref 1
00000100:00100000:2.0:1789760776.773950:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521036800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.773998:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24776704, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.774007:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.774032:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760776.774037:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.774044:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.774059:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760776.818451:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24776704 -> 24780800
00010000:00010000:2.0:1789760776.818471:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.818492:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.818500:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.818508:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760776.818512:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.818522:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.818541:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.818549:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d848 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24776704->24780799] (req 24776704->24780799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.818644:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521036800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44690us (44926us total) trans 4294973369 rc 0/0
00000100:00100000:2.0:1789760776.818654:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6082
00000100:00100000:2.0:1789760776.818663:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748423239119 time 748460620803 state 0x2 ref 0
00000001:00080000:1.0:1789760776.818818:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973369 is committed
00000100:00100000:0.0:1789760776.823005:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760776.823098:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521036928
00000100:00100000:3.0:1789760776.823118:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521036928
00000100:00100000:3.0:1789760776.823170:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748423239119 time 748460620803 state 0x0 ref 1
00000100:00100000:3.0:1789760776.823186:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748460881219 time 748460620803 state 0x1 ref 1
00000100:00100000:3.0:1789760776.823226:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748460881219 time 748509908536 state 0x0 ref 1
00000100:00100000:3.0:1789760776.823238:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521036928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760776.823284:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24780800, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:3.0:1789760776.823294:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.823309:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:3.0:1789760776.823357:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760776.823365:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.823380:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760776.826642:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:2.0:1789760776.826665:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda617f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548768896:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1789760776.826739:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760776.826834:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548768896
00000100:00100000:2.0:1789760776.826842:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548768896
00000100:00100000:2.0:1789760776.826887:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454
00000100:00100000:2.0:1789760776.826896:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548768896:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1789760776.826932:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:2.0:1789760776.826981:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548768896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (243us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760776.826989:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454
00000100:00100000:2.0:1789760776.827053:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda617f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548768896:0@lo:41:osp-pre-1-0.0
00000001:00080000:2.0:1789760776.855663:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973370 is committed
00002000:00010000:3.0:1789760776.855773:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24780800 -> 24784896
00010000:00010000:3.0:1789760776.855789:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.855802:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.855812:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.855821:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760776.855826:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.855836:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.855855:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.855864:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d84f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24780800->24784895] (req 24780800->24784895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760776.856138:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521036928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32896us (33136us total) trans 4294973370 rc 0/0
00000100:00100000:3.0:1789760776.856152:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6083
00000100:00100000:3.0:1789760776.856161:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748460881219 time 748509908536 state 0x2 ref 0
00000100:00100000:3.0:1789760776.858798:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.859412:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521037056
00000100:00100000:2.0:1789760776.859422:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521037056
00000100:00100000:2.0:1789760776.859659:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748460881219 time 748509908536 state 0x0 ref 1
00000100:00100000:2.0:1789760776.859673:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748510168952 time 748509908536 state 0x1 ref 1
00000100:00100000:2.0:1789760776.859739:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748510168952 time 748546420974 state 0x0 ref 1
00000100:00100000:2.0:1789760776.859753:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521037056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.859806:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24784896, mtime: 0x6aad9509, atime: 0x0, ctime: 0x6aad9509, blocks: 0xc007
00010000:00010000:2.0:1789760776.859815:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.859832:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760776.859836:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.859842:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.859857:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760776.891945:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973371 is committed
00002000:00010000:3.0:1789760776.892385:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24784896 -> 24788992
00002000:00010000:3.0:1789760776.892390:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760777 -> 1789760778
00002000:00010000:3.0:1789760776.892393:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760777 -> 1789760778
00010000:00010000:3.0:1789760776.892406:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.892418:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.892427:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.892435:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760776.892439:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.892448:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.892470:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760776.892867:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60d856 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24784896->24788991] (req 24784896->24788991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760776.892969:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521037056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33212us (34172us total) trans 4294973371 rc 0/0
00000100:00100000:3.0:1789760776.892979:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6084
00000100:00100000:3.0:1789760776.892988:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748510168952 time 748546420974 state 0x2 ref 0
00000100:00100000:0.0:1789760776.901237:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760776.901653:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521037184
00000100:00100000:1.0:1789760776.901663:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521037184
00000100:00100000:1.0:1789760776.901719:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748510168952 time 748546420974 state 0x0 ref 1
00000100:00100000:1.0:1789760776.901734:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748546681390 time 748546420974 state 0x1 ref 1
00000100:00100000:1.0:1789760776.901771:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748546681390 time 748588449796 state 0x0 ref 1
00000100:00100000:1.0:1789760776.901784:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521037184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760776.901830:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24788992, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:1.0:1789760776.901840:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.901855:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:1.0:1789760776.901859:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760776.901870:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760776.901885:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760776.950778:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973372 is committed
00002000:00010000:0.0:1789760776.950863:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24788992 -> 24793088
00010000:00010000:0.0:1789760776.950942:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.950956:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.950964:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.950971:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760776.950977:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.950986:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.951015:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.951023:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60d85d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24788992->24793087] (req 24788992->24793087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760776.951279:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521037184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49492us (50046us total) trans 4294973372 rc 0/0
00000100:00100000:0.0:1789760776.951291:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6085
00000100:00100000:0.0:1789760776.951301:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748546681390 time 748588449796 state 0x2 ref 0
00000100:00100000:0.0:1789760776.956818:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.957179:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521037312
00000100:00100000:2.0:1789760776.957189:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521037312
00000100:00100000:2.0:1789760776.957240:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748546681390 time 748588449796 state 0x0 ref 1
00000100:00100000:2.0:1789760776.957254:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748588710212 time 748588449796 state 0x1 ref 1
00000100:00100000:2.0:1789760776.957283:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748588710212 time 748643965130 state 0x0 ref 1
00000100:00100000:2.0:1789760776.957295:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521037312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.957374:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24793088, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760776.957383:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.957402:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760776.957406:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.957412:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.957425:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760776.992118:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973373 is committed
00002000:00010000:0.0:1789760776.992195:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24793088 -> 24797184
00010000:00010000:0.0:1789760776.992211:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.992223:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.992233:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.992244:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760776.992249:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.992257:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.992275:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760776.992283:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d864 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24793088->24797183] (req 24793088->24797183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760776.992585:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521037312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35279us (35764us total) trans 4294973373 rc 0/0
00000100:00100000:0.0:1789760776.992596:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6086
00000100:00100000:0.0:1789760776.992605:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748588710212 time 748643965130 state 0x2 ref 0
00000100:00100000:3.0:1789760776.998130:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760776.998264:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521037440
00000100:00100000:2.0:1789760776.998273:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521037440
00000100:00100000:2.0:1789760776.998349:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748588710212 time 748643965130 state 0x0 ref 1
00000100:00100000:2.0:1789760776.998361:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748644225546 time 748643965130 state 0x1 ref 1
00000100:00100000:2.0:1789760776.998376:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748644225546 time 748685060186 state 0x0 ref 1
00000100:00100000:2.0:1789760776.998384:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521037440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760776.998420:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24797184, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760776.998427:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.998438:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760776.998441:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760776.998445:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760776.998458:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760777.041754:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973374 is committed
00002000:00010000:0.0:1789760777.041820:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24797184 -> 24801280
00010000:00010000:0.0:1789760777.041837:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.041849:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.041865:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.041873:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760777.041878:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.041886:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.041905:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.041912:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d86b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24797184->24801279] (req 24797184->24801279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760777.042008:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521037440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43619us (43882us total) trans 4294973374 rc 0/0
00000100:00100000:0.0:1789760777.042019:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6087
00000100:00100000:0.0:1789760777.042029:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748644225546 time 748685060186 state 0x2 ref 0
00000100:00100000:2.0:1789760777.052781:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760777.052912:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521037568
00000100:00100000:3.0:1789760777.052922:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521037568
00000100:00100000:3.0:1789760777.052981:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748644225546 time 748685060186 state 0x0 ref 1
00000100:00100000:3.0:1789760777.052998:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748685320602 time 748685060186 state 0x1 ref 1
00000100:00100000:3.0:1789760777.053033:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748685320602 time 748739714925 state 0x0 ref 1
00000100:00100000:3.0:1789760777.053046:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521037568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760777.053096:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24801280, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:3.0:1789760777.053106:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.053121:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:3.0:1789760777.053126:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760777.053134:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.053148:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760777.058121:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.058205:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.058237:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.058260:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.058284:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760777.058382:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521037952
00000100:00100000:1.0:1789760777.058393:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521037952
00000100:00100000:1.0:1789760777.058446:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521038208
00000100:00100000:1.0:1789760777.058449:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521038208
00000100:00100000:1.0:1789760777.058460:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521037824
00000100:00100000:1.0:1789760777.058462:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521037824
00000100:00100000:1.0:1789760777.058486:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521038080
00000100:00100000:1.0:1789760777.058489:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521038080
00000100:00100000:1.0:1789760777.058505:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 943
00000100:00100000:1.0:1789760777.058513:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521037952:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760777.058585:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521037952:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (379us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760777.058595:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 943
00000100:00100000:1.0:1789760777.058611:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 944
00000100:00100000:1.0:1789760777.058617:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521038208:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760777.058641:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521038208:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760777.058646:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 944
00000100:00100000:1.0:1789760777.058657:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 945
00000100:00100000:1.0:1789760777.058662:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699521037824:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760777.058701:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699521037824:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 38us (440us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760777.058706:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 945
00000100:00100000:1.0:1789760777.058717:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 946
00000100:00100000:1.0:1789760777.058724:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521038080:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760777.058743:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521038080:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 19us (458us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760777.058749:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 946
00000100:00100000:0.0:1789760777.059874:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521037696
00000100:00100000:0.0:1789760777.059884:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521037696
00000100:00100000:0.0:1789760777.059925:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 484
00000100:00100000:0.0:1789760777.059935:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699521037696:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:0.0:1789760777.059990:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699521037696:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 56us (1878us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760777.059996:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 484
00000100:00080000:0.0:1789760777.060041:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:0.0:1789760777.060046:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00002000:00010000:2.0:1789760777.085273:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24801280 -> 24805376
00010000:00010000:2.0:1789760777.085293:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.085306:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.085342:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.085350:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760777.085355:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.085365:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.085390:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.085398:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60d872 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24801280->24805375] (req 24801280->24805375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760777.085503:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521037568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32455us (32729us total) trans 4294973375 rc 0/0
00000100:00100000:2.0:1789760777.085514:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6088
00000100:00100000:2.0:1789760777.085523:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748685320602 time 748739714925 state 0x2 ref 0
00000001:00080000:1.0:1789760777.085976:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973375 is committed
00000100:00100000:2.0:1789760777.091582:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760777.091664:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521038336
00000100:00100000:0.0:1789760777.091674:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521038336
00000100:00100000:0.0:1789760777.091734:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748685320602 time 748739714925 state 0x0 ref 1
00000100:00100000:0.0:1789760777.091752:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748739975341 time 748739714925 state 0x1 ref 1
00000100:00100000:0.0:1789760777.091781:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748739975341 time 748778464079 state 0x0 ref 1
00000100:00100000:0.0:1789760777.091794:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521038336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760777.091843:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24805376, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:0.0:1789760777.091852:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.091868:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:0.0:1789760777.091872:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760777.091879:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.091892:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760777.117262:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973376 is committed
00002000:00010000:1.0:1789760777.117431:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24805376 -> 24809472
00010000:00010000:1.0:1789760777.117448:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.117462:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.117494:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.117501:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.117506:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.117514:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.117533:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.117540:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60d879 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24805376->24809471] (req 24805376->24809471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.117669:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521038336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25871us (26092us total) trans 4294973376 rc 0/0
00000100:00100000:1.0:1789760777.117680:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6089
00000100:00100000:1.0:1789760777.117689:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748739975341 time 748778464079 state 0x2 ref 0
00000100:00100000:0.0:1789760777.124288:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.124540:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521038464
00000100:00100000:2.0:1789760777.124551:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521038464
00000100:00100000:3.0:1789760777.124668:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748739975341 time 748778464079 state 0x0 ref 1
00000100:00100000:3.0:1789760777.124684:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748778724495 time 748778464079 state 0x1 ref 1
00000100:00100000:3.0:1789760777.124745:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748778724495 time 748811427045 state 0x0 ref 1
00000100:00100000:3.0:1789760777.124759:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521038464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760777.124813:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24809472, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:3.0:1789760777.124822:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.124836:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:3.0:1789760777.124839:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760777.124845:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.124858:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760777.167262:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24809472 -> 24813568
00010000:00010000:1.0:1789760777.167281:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.167298:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.167306:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.167343:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.167348:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.167358:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.167377:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.167386:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60d880 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24809472->24813567] (req 24809472->24813567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.167483:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521038464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42711us (43188us total) trans 4294973377 rc 0/0
00000100:00100000:1.0:1789760777.167493:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6090
00000100:00100000:1.0:1789760777.167502:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748778724495 time 748811427045 state 0x2 ref 0
00000001:00080000:2.0:1789760777.168673:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973377 is committed
00000100:00100000:0.0:1789760777.171344:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.171491:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521038592
00000100:00100000:2.0:1789760777.171501:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521038592
00000100:00100000:2.0:1789760777.171557:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748778724495 time 748811427045 state 0x0 ref 1
00000100:00100000:2.0:1789760777.171581:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748811687461 time 748811427045 state 0x1 ref 1
00000100:00100000:2.0:1789760777.171616:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748811687461 time 748858298792 state 0x0 ref 1
00000100:00100000:2.0:1789760777.171629:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521038592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.171686:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24813568, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.171698:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.171713:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760777.171717:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.171724:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.171738:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760777.204758:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973378 is committed
00002000:00010000:0.0:1789760777.204877:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24813568 -> 24817664
00010000:00010000:0.0:1789760777.204894:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.204907:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.204916:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.204924:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760777.204929:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.204939:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.204957:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.204965:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60d887 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24813568->24817663] (req 24813568->24817663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760777.205070:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521038592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33438us (33761us total) trans 4294973378 rc 0/0
00000100:00100000:0.0:1789760777.205084:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6091
00000100:00100000:0.0:1789760777.205096:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748811687461 time 748858298792 state 0x2 ref 0
00000100:00100000:0.0:1789760777.208960:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.209077:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521038720
00000100:00100000:2.0:1789760777.209088:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521038720
00000100:00100000:2.0:1789760777.209150:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748811687461 time 748858298792 state 0x0 ref 1
00000100:00100000:2.0:1789760777.209165:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748858559208 time 748858298792 state 0x1 ref 1
00000100:00100000:2.0:1789760777.209199:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748858559208 time 748895881657 state 0x0 ref 1
00000100:00100000:2.0:1789760777.209211:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521038720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.209259:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24817664, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.209268:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.209284:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:2.0:1789760777.209290:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.209296:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.209346:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760777.260846:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973379 is committed
00002000:00010000:0.0:1789760777.260953:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24817664 -> 24821760
00010000:00010000:0.0:1789760777.260969:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.260982:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.260991:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.260999:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760777.261015:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.261025:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.261046:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.261054:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d88e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24817664->24821759] (req 24817664->24821759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760777.261145:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521038720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51931us (52190us total) trans 4294973379 rc 0/0
00000100:00100000:0.0:1789760777.261159:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6092
00000100:00100000:0.0:1789760777.261175:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748858559208 time 748895881657 state 0x2 ref 0
00000100:00100000:1.0:1789760777.265830:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760777.265909:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521038848
00000100:00100000:0.0:1789760777.265919:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521038848
00000100:00100000:0.0:1789760777.265968:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748858559208 time 748895881657 state 0x0 ref 1
00000100:00100000:0.0:1789760777.265983:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748896142073 time 748895881657 state 0x1 ref 1
00000100:00100000:0.0:1789760777.266020:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748896142073 time 748952703094 state 0x0 ref 1
00000100:00100000:0.0:1789760777.266032:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521038848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760777.266079:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24821760, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:0.0:1789760777.266089:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.266106:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:0.0:1789760777.266110:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760777.266116:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.266130:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760777.297378:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973380 is committed
00002000:00010000:1.0:1789760777.297612:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24821760 -> 24825856
00010000:00010000:1.0:1789760777.297628:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.297641:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.297650:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.297657:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.297662:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.297670:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.297690:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.297702:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60d895 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24821760->24825855] (req 24821760->24825855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.297789:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521038848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31753us (31964us total) trans 4294973380 rc 0/0
00000100:00100000:1.0:1789760777.297803:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6093
00000100:00100000:1.0:1789760777.297813:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748896142073 time 748952703094 state 0x2 ref 0
00000100:00100000:2.0:1789760777.302420:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760777.304983:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521038976
00000100:00100000:1.0:1789760777.304998:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521038976
00000100:00100000:1.0:1789760777.305058:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748896142073 time 748952703094 state 0x0 ref 1
00000100:00100000:1.0:1789760777.305075:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748952963510 time 748952703094 state 0x1 ref 1
00000100:00100000:1.0:1789760777.305148:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748952963510 time 748991830592 state 0x0 ref 1
00000100:00100000:1.0:1789760777.305163:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521038976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760777.305222:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24825856, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:1.0:1789760777.305231:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.305247:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=748s v=(0 0)
00010000:00010000:1.0:1789760777.305251:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760777.305257:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.305271:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760777.338164:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548769024:0@lo:13:osp-pre-0-1.0
00000100:00100000:2.0:1789760777.338230:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760777.338282:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548769024
00000100:00100000:1.0:1789760777.338292:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548769024
00000100:00100000:1.0:1789760777.338372:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386
00000100:00100000:1.0:1789760777.338382:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548769024:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:1.0:1789760777.338417:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527892480 pending 1703936 free 3833593856 avail 3831496704
00000100:00100000:0.0:1789760777.338637:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1789760777.338648:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8b72d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548769152:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760777.339240:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548769024:0@lo:13:osp-pre-0-1.0
00000100:00100000:0.0:1789760777.339983:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760777.340485:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548769024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2092us (2242us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760777.340498:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386
00000100:00100000:0.0:1789760777.340627:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548769152
00000100:00100000:0.0:1789760777.340634:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548769152
00000100:00100000:2.0:1789760777.341279:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387
00000100:00100000:2.0:1789760777.341291:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548769152:12345-0@lo:13:osp-pre-0-0.0
00000100:00080000:1.0:1789760777.341435:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00002000:00000024:2.0:1789760777.341615:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 527892480 pending 1703936 free 3833593856 avail 3831496704
00000100:00100000:2.0:1789760777.341703:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548769152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 414us (1720us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760777.341712:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387
00000100:00100000:0.0:1789760777.341749:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8b72d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548769152:0@lo:13:osp-pre-0-0.0
00000001:00080000:0.0:1789760777.344694:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973381 is committed
00002000:00010000:2.0:1789760777.352526:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24825856 -> 24829952
00010000:00010000:2.0:1789760777.352546:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.352560:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.352570:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.352578:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760777.352583:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.352594:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.352616:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.352624:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d89c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24825856->24829951] (req 24825856->24829951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760777.352723:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521038976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47559us (50309us total) trans 4294973381 rc 0/0
00000100:00100000:2.0:1789760777.352734:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6094
00000100:00100000:2.0:1789760777.352744:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748952963510 time 748991830592 state 0x2 ref 0
00000100:00100000:0.0:1789760777.355871:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.355973:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521039104
00000100:00100000:2.0:1789760777.355982:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521039104
00000100:00100000:2.0:1789760777.356091:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748952963510 time 748991830592 state 0x0 ref 1
00000100:00100000:2.0:1789760777.356107:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748992091008 time 748991830592 state 0x1 ref 1
00000100:00100000:2.0:1789760777.356207:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748992091008 time 749042887948 state 0x0 ref 1
00000100:00100000:2.0:1789760777.356219:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.356266:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24829952, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.356276:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.356293:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.356297:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.356304:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.356390:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760777.424746:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973382 is committed
00002000:00010000:1.0:1789760777.424896:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24829952 -> 24834048
00010000:00010000:1.0:1789760777.424911:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.424923:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.424931:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.424939:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.424943:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.424953:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.424973:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.424985:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d8a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24829952->24834047] (req 24829952->24834047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.425086:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68865us (69220us total) trans 4294973382 rc 0/0
00000100:00100000:1.0:1789760777.425096:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6095
00000100:00100000:1.0:1789760777.425107:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748992091008 time 749042887948 state 0x2 ref 0
00000100:00100000:0.0:1789760777.428893:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.429054:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521039232
00000100:00100000:2.0:1789760777.429065:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521039232
00000100:00100000:2.0:1789760777.429114:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 748992091008 time 749042887948 state 0x0 ref 1
00000100:00100000:2.0:1789760777.429129:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749043148364 time 749042887948 state 0x1 ref 1
00000100:00100000:2.0:1789760777.429186:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749043148364 time 749115868746 state 0x0 ref 1
00000100:00100000:2.0:1789760777.429197:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521039232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.429242:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24834048, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.429250:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.429265:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.429270:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.429276:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.429294:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760777.466645:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973383 is committed
00002000:00010000:3.0:1789760777.466804:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24834048 -> 24838144
00010000:00010000:3.0:1789760777.466820:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.466833:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.466844:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.466852:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760777.466858:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.466867:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.466887:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.466896:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d8aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24834048->24838143] (req 24834048->24838143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760777.466991:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521039232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37790us (38102us total) trans 4294973383 rc 0/0
00000100:00100000:3.0:1789760777.467421:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6096
00000100:00100000:3.0:1789760777.467433:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749043148364 time 749115868746 state 0x2 ref 0
00000100:00100000:3.0:1789760777.475881:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760777.476288:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521039360
00000100:00100000:1.0:1789760777.476298:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521039360
00000100:00100000:1.0:1789760777.476381:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749043148364 time 749115868746 state 0x0 ref 1
00000100:00100000:1.0:1789760777.476397:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749116129162 time 749115868746 state 0x1 ref 1
00000100:00100000:1.0:1789760777.476722:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749116129162 time 749163402536 state 0x0 ref 1
00000100:00100000:1.0:1789760777.476737:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760777.476787:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24838144, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:1.0:1789760777.476797:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.476813:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:1.0:1789760777.476818:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760777.476824:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.476838:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760777.511247:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973384 is committed
00002000:00010000:1.0:1789760777.511544:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24838144 -> 24842240
00010000:00010000:1.0:1789760777.511560:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.511574:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.511584:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.511591:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.511596:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.511605:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.511625:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.511633:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24838144->24842239] (req 24838144->24842239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.511729:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34990us (35853us total) trans 4294973384 rc 0/0
00000100:00100000:1.0:1789760777.511740:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6097
00000100:00100000:1.0:1789760777.511750:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749116129162 time 749163402536 state 0x2 ref 0
00000100:00100000:2.0:1789760777.517738:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760777.519055:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521039488
00000100:00100000:1.0:1789760777.519068:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521039488
00000100:00100000:0.0:1789760777.519279:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749116129162 time 749163402536 state 0x0 ref 1
00000100:00100000:0.0:1789760777.520288:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749163662952 time 749163402536 state 0x1 ref 1
00000100:00100000:0.0:1789760777.520409:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749163662952 time 749207091004 state 0x0 ref 1
00000100:00100000:0.0:1789760777.520428:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521039488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760777.520489:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24842240, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:0.0:1789760777.520499:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.520513:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:0.0:1789760777.520517:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760777.520523:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.520536:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760777.569297:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973385 is committed
00002000:00010000:1.0:1789760777.569605:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24842240 -> 24846336
00010000:00010000:1.0:1789760777.569621:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.569635:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.569696:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.569705:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.569710:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.569719:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.569740:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.569753:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60d8b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24842240->24846335] (req 24842240->24846335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.569844:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521039488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49420us (52113us total) trans 4294973385 rc 0/0
00000100:00100000:1.0:1789760777.569855:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6098
00000100:00100000:1.0:1789760777.569864:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749163662952 time 749207091004 state 0x2 ref 0
00000100:00100000:0.0:1789760777.572599:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.572743:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521039616
00000100:00100000:2.0:1789760777.572753:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521039616
00000100:00100000:2.0:1789760777.572807:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749163662952 time 749207091004 state 0x0 ref 1
00000100:00100000:2.0:1789760777.573082:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749207351420 time 749207091004 state 0x1 ref 1
00000100:00100000:2.0:1789760777.573170:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749207351420 time 749259791278 state 0x0 ref 1
00000100:00100000:2.0:1789760777.573191:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.573434:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24846336, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.573444:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.573460:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.573464:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.573480:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.573493:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760777.604950:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973386 is committed
00002000:00010000:1.0:1789760777.605028:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24846336 -> 24850432
00010000:00010000:1.0:1789760777.605042:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.605054:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.605063:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.605070:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.605075:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.605084:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.605109:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.605117:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24846336->24850431] (req 24846336->24850431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.605248:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32056us (32652us total) trans 4294973386 rc 0/0
00000100:00100000:1.0:1789760777.605259:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6099
00000100:00100000:1.0:1789760777.605269:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749207351420 time 749259791278 state 0x2 ref 0
00000100:00100000:0.0:1789760777.609257:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.609680:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521039744
00000100:00100000:2.0:1789760777.609690:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521039744
00000100:00100000:2.0:1789760777.609743:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749207351420 time 749259791278 state 0x0 ref 1
00000100:00100000:2.0:1789760777.609759:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749260051694 time 749259791278 state 0x1 ref 1
00000100:00100000:2.0:1789760777.609790:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749260051694 time 749296472392 state 0x0 ref 1
00000100:00100000:2.0:1789760777.609803:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.609852:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24850432, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.609861:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.609876:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.609880:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.609886:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.609900:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760777.643369:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973387 is committed
00002000:00010000:1.0:1789760777.643607:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24850432 -> 24854528
00010000:00010000:1.0:1789760777.643622:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.643636:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.643645:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.643652:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.643658:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.643672:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.643691:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.643700:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24850432->24854527] (req 24850432->24854527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.643787:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33982us (34536us total) trans 4294973387 rc 0/0
00000100:00100000:1.0:1789760777.643797:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6100
00000100:00100000:1.0:1789760777.643806:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749260051694 time 749296472392 state 0x2 ref 0
00000100:00100000:2.0:1789760777.650200:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760777.650298:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521039872
00000100:00100000:1.0:1789760777.650309:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521039872
00000100:00100000:1.0:1789760777.650397:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749260051694 time 749296472392 state 0x0 ref 1
00000100:00100000:1.0:1789760777.650413:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749296732808 time 749296472392 state 0x1 ref 1
00000100:00100000:1.0:1789760777.650534:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749296732808 time 749337216519 state 0x0 ref 1
00000100:00100000:1.0:1789760777.650547:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760777.650613:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24854528, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:1.0:1789760777.650623:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.650640:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:1.0:1789760777.650645:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760777.650651:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.650664:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760777.699519:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973388 is committed
00002000:00010000:1.0:1789760777.699648:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24854528 -> 24858624
00010000:00010000:1.0:1789760777.699664:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.699678:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.699687:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.699694:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.699699:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.699708:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.699728:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.699735:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24854528->24858623] (req 24854528->24858623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.699838:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521039872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49288us (49644us total) trans 4294973388 rc 0/0
00000100:00100000:1.0:1789760777.699849:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6101
00000100:00100000:1.0:1789760777.699859:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749296732808 time 749337216519 state 0x2 ref 0
00000100:00100000:0.0:1789760777.704583:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.706757:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521040000
00000100:00100000:2.0:1789760777.706771:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521040000
00000100:00100000:2.0:1789760777.706831:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749296732808 time 749337216519 state 0x0 ref 1
00000100:00100000:2.0:1789760777.706846:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749337476935 time 749337216519 state 0x1 ref 1
00000100:00100000:2.0:1789760777.706886:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749337476935 time 749393568379 state 0x0 ref 1
00000100:00100000:2.0:1789760777.706899:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521040000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.706950:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24858624, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.706959:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.706975:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.706986:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.706993:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.707013:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760777.743381:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24858624 -> 24862720
00010000:00010000:1.0:1789760777.743400:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.743412:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.743421:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.743428:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.743433:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.743443:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.743475:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.743483:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60d8d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24858624->24862719] (req 24858624->24862719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.743578:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521040000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36676us (38999us total) trans 4294973389 rc 0/0
00000100:00100000:1.0:1789760777.743588:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6102
00000100:00100000:1.0:1789760777.743598:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749337476935 time 749393568379 state 0x2 ref 0
00000001:00080000:0.0:1789760777.744093:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973389 is committed
00000100:00100000:0.0:1789760777.749240:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.749413:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521040128
00000100:00100000:2.0:1789760777.749423:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521040128
00000100:00100000:2.0:1789760777.749486:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749337476935 time 749393568379 state 0x0 ref 1
00000100:00100000:2.0:1789760777.749501:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749393828795 time 749393568379 state 0x1 ref 1
00000100:00100000:2.0:1789760777.749530:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749393828795 time 749436212730 state 0x0 ref 1
00000100:00100000:2.0:1789760777.749546:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521040128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.749593:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24862720, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.749602:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.749617:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.749622:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.749628:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.749641:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760777.774084:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973390 is committed
00002000:00010000:2.0:1789760777.774273:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24862720 -> 24866816
00010000:00010000:2.0:1789760777.774289:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.774303:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.774337:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.774345:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760777.774351:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.774360:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.774378:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.774385:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24862720->24866815] (req 24862720->24866815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760777.774458:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521040128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24910us (25223us total) trans 4294973390 rc 0/0
00000100:00100000:2.0:1789760777.774477:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6103
00000100:00100000:2.0:1789760777.774488:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749393828795 time 749436212730 state 0x2 ref 0
00000100:00100000:3.0:1789760777.778450:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760777.779236:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521040256
00000100:00100000:1.0:1789760777.779246:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521040256
00000100:00100000:1.0:1789760777.779298:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749393828795 time 749436212730 state 0x0 ref 1
00000100:00100000:1.0:1789760777.779406:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749436473146 time 749436212730 state 0x1 ref 1
00000100:00100000:1.0:1789760777.779465:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749436473146 time 749466147124 state 0x0 ref 1
00000100:00100000:1.0:1789760777.779489:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521040256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760777.779535:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24866816, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:1.0:1789760777.779544:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.779559:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:1.0:1789760777.779564:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760777.779571:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.779585:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.786231:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760777.819539:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973391 is committed
00002000:00010000:1.0:1789760777.819757:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24866816 -> 24870912
00010000:00010000:1.0:1789760777.819773:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.819786:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.819796:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.819803:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.819808:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.819817:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.819835:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.819842:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60d8e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24866816->24870911] (req 24866816->24870911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.819970:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521040256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40480us (41525us total) trans 4294973391 rc 0/0
00000100:00100000:1.0:1789760777.819980:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6104
00000100:00100000:1.0:1789760777.819988:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749436473146 time 749466147124 state 0x2 ref 0
00000100:00100000:1.0:1789760777.822891:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760777.822986:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521040384
00000100:00100000:0.0:1789760777.822995:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521040384
00000100:00100000:0.0:1789760777.823082:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749436473146 time 749466147124 state 0x0 ref 1
00000100:00100000:0.0:1789760777.823093:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749466407540 time 749466147124 state 0x1 ref 1
00000100:00100000:0.0:1789760777.823217:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749466407540 time 749509899201 state 0x0 ref 1
00000100:00100000:0.0:1789760777.823227:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521040384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760777.823268:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24870912, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:0.0:1789760777.823276:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.823290:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:0.0:1789760777.823295:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760777.823300:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.823345:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760777.858703:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973392 is committed
00002000:00010000:2.0:1789760777.858857:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24870912 -> 24875008
00010000:00010000:2.0:1789760777.858870:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.858879:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.858886:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.858890:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760777.858894:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.858901:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.858915:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.858920:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60d8e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24870912->24875007] (req 24870912->24875007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760777.859028:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521040384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35799us (36144us total) trans 4294973392 rc 0/0
00000100:00100000:2.0:1789760777.859036:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6105
00000100:00100000:2.0:1789760777.859044:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749466407540 time 749509899201 state 0x2 ref 0
00000100:00100000:0.0:1789760777.864160:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.864248:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521040512
00000100:00100000:2.0:1789760777.864258:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521040512
00000100:00100000:2.0:1789760777.864387:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749466407540 time 749509899201 state 0x0 ref 1
00000100:00100000:2.0:1789760777.864402:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749510159617 time 749509899201 state 0x1 ref 1
00000100:00100000:2.0:1789760777.864453:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749510159617 time 749551136715 state 0x0 ref 1
00000100:00100000:2.0:1789760777.864463:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521040512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.864600:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24875008, mtime: 0x6aad950a, atime: 0x0, ctime: 0x6aad950a, blocks: 0xc007
00010000:00010000:2.0:1789760777.864610:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.864627:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.864632:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.864638:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.864652:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760777.901992:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973393 is committed
00002000:00010000:1.0:1789760777.904117:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24875008 -> 24879104
00002000:00010000:1.0:1789760777.904126:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760778 -> 1789760779
00002000:00010000:1.0:1789760777.904129:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760778 -> 1789760779
00010000:00010000:1.0:1789760777.904142:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.904159:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.904168:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.904175:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760777.904180:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.904190:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.904216:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760777.904225:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d8f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24875008->24879103] (req 24875008->24879103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760777.905131:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521040512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40660us (40972us total) trans 4294973393 rc 0/0
00000100:00100000:1.0:1789760777.905144:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6106
00000100:00100000:1.0:1789760777.905154:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749510159617 time 749551136715 state 0x2 ref 0
00000100:00100000:3.0:1789760777.912641:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760777.912876:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521040640
00000100:00100000:2.0:1789760777.912887:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521040640
00000100:00100000:2.0:1789760777.912941:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749510159617 time 749551136715 state 0x0 ref 1
00000100:00100000:2.0:1789760777.912956:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749551397131 time 749551136715 state 0x1 ref 1
00000100:00100000:2.0:1789760777.912995:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749551397131 time 749599678030 state 0x0 ref 1
00000100:00100000:2.0:1789760777.913008:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521040640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.913053:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24879104, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760777.913061:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.913076:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.913080:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.913087:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.913101:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760777.947057:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24879104 -> 24883200
00010000:00010000:0.0:1789760777.947077:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.947092:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.947113:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.947120:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760777.947125:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.947133:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.947152:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.947160:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60d8f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24879104->24883199] (req 24879104->24883199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760777.947258:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521040640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34248us (34624us total) trans 4294973394 rc 0/0
00000100:00100000:0.0:1789760777.947271:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6107
00000100:00100000:0.0:1789760777.947280:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749551397131 time 749599678030 state 0x2 ref 0
00000001:00080000:1.0:1789760777.947565:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973394 is committed
00000100:00100000:1.0:1789760777.952487:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760777.952646:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521040768
00000100:00100000:3.0:1789760777.952655:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521040768
00000100:00100000:3.0:1789760777.952711:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749551397131 time 749599678030 state 0x0 ref 1
00000100:00100000:3.0:1789760777.952727:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749599938446 time 749599678030 state 0x1 ref 1
00000100:00100000:3.0:1789760777.952755:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749599938446 time 749639438602 state 0x0 ref 1
00000100:00100000:3.0:1789760777.952764:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521040768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760777.952810:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24883200, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:3.0:1789760777.952820:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.952837:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:3.0:1789760777.952840:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760777.952845:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760777.952855:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760777.986619:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973395 is committed
00002000:00010000:0.0:1789760777.986768:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24883200 -> 24887296
00010000:00010000:0.0:1789760777.986784:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.986796:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.986806:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.986813:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760777.986819:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.986828:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.986846:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760777.986854:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60d8fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24883200->24887295] (req 24883200->24887295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760777.986964:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521040768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34195us (34491us total) trans 4294973395 rc 0/0
00000100:00100000:0.0:1789760777.986975:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6108
00000100:00100000:0.0:1789760777.986984:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749599938446 time 749639438602 state 0x2 ref 0
00000100:00100000:2.0:1789760777.992966:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760777.993387:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521040896
00000100:00100000:0.0:1789760777.993398:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521040896
00000100:00100000:2.0:1789760777.993563:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749599938446 time 749639438602 state 0x0 ref 1
00000100:00100000:2.0:1789760777.993578:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749639699018 time 749639438602 state 0x1 ref 1
00000100:00100000:2.0:1789760777.993609:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749639699018 time 749680291973 state 0x0 ref 1
00000100:00100000:2.0:1789760777.993623:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521040896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760777.993750:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24887296, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760777.993761:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.993776:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760777.993780:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760777.993784:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760777.993794:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760778.035893:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973396 is committed
00002000:00010000:0.0:1789760778.036163:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24887296 -> 24891392
00010000:00010000:0.0:1789760778.036179:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760778.036192:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760778.036202:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760778.036210:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760778.036215:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760778.036225:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760778.036245:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760778.036259:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60d905 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24887296->24891391] (req 24887296->24891391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760778.036452:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521040896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42826us (43488us total) trans 4294973396 rc 0/0
00000100:00100000:0.0:1789760778.036463:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6109
00000100:00100000:0.0:1789760778.036487:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749639699018 time 749680291973 state 0x2 ref 0
00000100:00100000:3.0:1789760778.040654:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760778.040726:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521041024
00000100:00100000:1.0:1789760778.040736:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521041024
00000100:00100000:1.0:1789760778.040845:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749639699018 time 749680291973 state 0x0 ref 1
00000100:00100000:1.0:1789760778.041203:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749680552389 time 749680291973 state 0x1 ref 1
00000100:00100000:1.0:1789760778.041242:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749680552389 time 749727924516 state 0x0 ref 1
00000100:00100000:1.0:1789760778.041257:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521041024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760778.041347:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24891392, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:1.0:1789760778.041356:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.041376:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:1.0:1789760778.041380:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760778.041387:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.041400:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760778.042597:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:3.0:1789760778.083892:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973397 is committed
00002000:00010000:2.0:1789760778.083945:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24891392 -> 24895488
00010000:00010000:2.0:1789760778.084046:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.084059:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.084068:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.084076:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760778.084081:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.084090:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.084120:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.084129:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60d90c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24891392->24895487] (req 24891392->24895487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760778.084239:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521041024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42977us (43585us total) trans 4294973397 rc 0/0
00000100:00100000:2.0:1789760778.084249:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6110
00000100:00100000:2.0:1789760778.084259:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749680552389 time 749727924516 state 0x2 ref 0
00000100:00100000:3.0:1789760778.089355:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760778.089597:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521041152
00000100:00100000:0.0:1789760778.089609:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521041152
00000100:00100000:0.0:1789760778.089671:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749680552389 time 749727924516 state 0x0 ref 1
00000100:00100000:0.0:1789760778.089686:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749728184932 time 749727924516 state 0x1 ref 1
00000100:00100000:0.0:1789760778.089721:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749728184932 time 749776403564 state 0x0 ref 1
00000100:00100000:0.0:1789760778.089733:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760778.089780:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24895488, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:0.0:1789760778.089790:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760778.089807:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:0.0:1789760778.089811:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760778.089819:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760778.089834:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760778.124715:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973398 is committed
00002000:00010000:2.0:1789760778.124897:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24895488 -> 24899584
00010000:00010000:2.0:1789760778.124911:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.124924:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.124932:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.124940:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760778.124944:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.125085:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.125105:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.125113:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60d913 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24895488->24899583] (req 24895488->24899583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760778.125247:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35509us (35938us total) trans 4294973398 rc 0/0
00000100:00100000:2.0:1789760778.125258:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6111
00000100:00100000:2.0:1789760778.125268:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749728184932 time 749776403564 state 0x2 ref 0
00000100:00100000:0.0:1789760778.131834:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760778.131916:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521041280
00000100:00100000:3.0:1789760778.131926:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521041280
00000100:00100000:3.0:1789760778.131991:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749728184932 time 749776403564 state 0x0 ref 1
00000100:00100000:3.0:1789760778.132169:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749776663980 time 749776403564 state 0x1 ref 1
00000100:00100000:3.0:1789760778.132203:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749776663980 time 749818885167 state 0x0 ref 1
00000100:00100000:3.0:1789760778.132217:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760778.132265:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24899584, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:3.0:1789760778.132274:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.132288:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:3.0:1789760778.132292:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760778.132298:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.132311:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760778.170013:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973399 is committed
00002000:00010000:3.0:1789760778.170133:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24899584 -> 24903680
00010000:00010000:3.0:1789760778.170148:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.170161:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.170170:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.170178:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760778.170182:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.170192:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.170210:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.170218:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d91a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24899584->24903679] (req 24899584->24903679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760778.170350:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38093us (38482us total) trans 4294973399 rc 0/0
00000100:00100000:3.0:1789760778.170366:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6112
00000100:00100000:3.0:1789760778.170375:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749776663980 time 749818885167 state 0x2 ref 0
00000100:00100000:3.0:1789760778.179631:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760778.179781:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521041408
00000100:00100000:2.0:1789760778.179791:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521041408
00000100:00100000:2.0:1789760778.179846:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749776663980 time 749818885167 state 0x0 ref 1
00000100:00100000:2.0:1789760778.179861:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749819145583 time 749818885167 state 0x1 ref 1
00000100:00100000:2.0:1789760778.179899:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749819145583 time 749866581624 state 0x0 ref 1
00000100:00100000:2.0:1789760778.179912:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521041408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.179961:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24903680, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.179970:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.179986:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760778.179991:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.179997:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.180012:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760778.205370:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24903680 -> 24907776
00010000:00010000:2.0:1789760778.205392:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.205411:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.205421:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.205428:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760778.205433:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.205442:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.205460:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.205477:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60d921 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24903680->24907775] (req 24903680->24907775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760778.205565:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521041408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25651us (25940us total) trans 4294973400 rc 0/0
00000100:00100000:2.0:1789760778.205576:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6113
00000100:00100000:2.0:1789760778.205584:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749819145583 time 749866581624 state 0x2 ref 0
00000001:00080000:0.0:1789760778.206243:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973400 is committed
00000100:00100000:1.0:1789760778.209760:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760778.209808:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521041536
00000100:00100000:2.0:1789760778.209818:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521041536
00000100:00100000:2.0:1789760778.209872:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749819145583 time 749866581624 state 0x0 ref 1
00000100:00100000:2.0:1789760778.209888:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749866842040 time 749866581624 state 0x1 ref 1
00000100:00100000:2.0:1789760778.209915:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749866842040 time 749896597404 state 0x0 ref 1
00000100:00100000:2.0:1789760778.209933:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.209986:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24907776, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.209995:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.210011:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760778.210015:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.210021:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.210042:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760778.282841:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973401 is committed
00002000:00010000:1.0:1789760778.282916:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24907776 -> 24911872
00010000:00010000:1.0:1789760778.282932:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.282945:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.282956:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.282963:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760778.282968:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.282977:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.283000:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.283008:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d928 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24907776->24911871] (req 24907776->24911871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760778.283099:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73162us (73343us total) trans 4294973401 rc 0/0
00000100:00100000:1.0:1789760778.283110:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6114
00000100:00100000:1.0:1789760778.283120:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749866842040 time 749896597404 state 0x2 ref 0
00000100:00100000:0.0:1789760778.289710:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760778.289942:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521041664
00000100:00100000:2.0:1789760778.289951:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521041664
00000100:00100000:2.0:1789760778.290005:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749866842040 time 749896597404 state 0x0 ref 1
00000100:00100000:2.0:1789760778.290031:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749896857820 time 749896597404 state 0x1 ref 1
00000100:00100000:2.0:1789760778.290063:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749896857820 time 749976746157 state 0x0 ref 1
00000100:00100000:2.0:1789760778.290079:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.290123:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24911872, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.290132:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.290147:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=749s v=(0 0)
00010000:00010000:2.0:1789760778.290151:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.290157:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.290169:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760778.346800:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973402 is committed
00002000:00010000:1.0:1789760778.346933:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24911872 -> 24915968
00010000:00010000:1.0:1789760778.346950:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.346963:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.346971:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.346978:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760778.346982:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.347193:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.347217:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.347226:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d92f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24911872->24915967] (req 24911872->24915967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760778.347474:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57384us (57758us total) trans 4294973402 rc 0/0
00000100:00100000:1.0:1789760778.347484:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6115
00000100:00100000:1.0:1789760778.347493:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749896857820 time 749976746157 state 0x2 ref 0
00000100:00100000:2.0:1789760778.356387:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760778.356527:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521041792
00000100:00100000:3.0:1789760778.356540:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521041792
00000100:00100000:3.0:1789760778.356614:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749896857820 time 749976746157 state 0x0 ref 1
00000100:00100000:3.0:1789760778.356633:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749977006573 time 749976746157 state 0x1 ref 1
00000100:00100000:3.0:1789760778.356666:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749977006573 time 750043348863 state 0x0 ref 1
00000100:00100000:3.0:1789760778.356681:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521041792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760778.356747:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24915968, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:3.0:1789760778.356760:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.356781:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:3.0:1789760778.356786:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760778.356793:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.356811:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760778.362251:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789760778.362281:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8ae47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548769280:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1789760778.362403:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760778.362471:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548769408:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760778.362547:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760778.362607:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1789760778.362621:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8daba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548769536:0@lo:400:kworker.0
00000100:00100000:0.0:1789760778.362666:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760778.362709:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548769664:0@lo:400:kworker.0
00000100:00100000:0.0:1789760778.362746:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548769280
00000100:00100000:0.0:1789760778.362756:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548769280
00000100:00100000:2.0:1789760778.362765:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760778.362768:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548769536
00000100:00100000:3.0:1789760778.362776:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548769536
00000100:00100000:0.0:1789760778.362826:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548769408
00000100:00100000:0.0:1789760778.362833:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548769408
00000100:00100000:3.0:1789760778.362838:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485
00000100:00100000:3.0:1789760778.362851:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548769536:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.362861:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548770176:0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.362887:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760778.363050:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3453:x1876699548769536:12345-0@lo:400:kworker.0 Request processed in 201us (383us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760778.363059:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485
00000100:00100000:3.0:1789760778.363173:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548770048:0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.363206:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760778.363228:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548770560:0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.363251:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760778.363270:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1]
00000100:00100000:3.0:1789760778.363275:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876699548769920:0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.363303:0:8097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548770560
00000100:00100000:3.0:1789760778.363307:0:8097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548770560
00000100:00100000:3.0:1789760778.363364:0:8097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307
00000100:00100000:3.0:1789760778.363372:0:8097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548770560:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.363413:0:8097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548770560:12345-0@lo:400:kworker.0 Request processed in 41us (160us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760778.363419:0:8097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307
00000100:00100000:3.0:1789760778.363437:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548769792:0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.363534:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760778.363556:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3456:1876699548770304:0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.363923:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548770688:0@lo:400:kworker.0
00000100:00100000:1.0:1789760778.363935:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548769664
00000100:00100000:1.0:1789760778.363942:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548769664
00000100:00100000:2.0:1789760778.363957:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760778.363986:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548770176
00000100:00100000:1.0:1789760778.363991:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548770176
00000100:00100000:1.0:1789760778.364033:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548770688
00000100:00100000:1.0:1789760778.364036:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548770688
00000100:00100000:1.0:1789760778.364054:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947
00000100:00100000:1.0:1789760778.364062:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548769664:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.364107:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388
00000100:00100000:2.0:1789760778.364119:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548769280:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1789760778.364248:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:2.0:1789760778.364301:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548769280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 186us (1900us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760778.364310:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388
00000100:00100000:2.0:1789760778.364626:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389
00000100:00100000:2.0:1789760778.364635:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548769408:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:2.0:1789760778.364649:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:2.0:1789760778.364685:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548769408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (2139us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760778.364692:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389
00000100:00100000:2.0:1789760778.364721:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548770048
00000100:00100000:2.0:1789760778.364726:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548770048
00000100:00100000:2.0:1789760778.365300:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548769792
00000100:00100000:2.0:1789760778.365307:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548769792
00000100:00100000:2.0:1789760778.365358:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455
00000100:00100000:2.0:1789760778.365366:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548770048:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.365428:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548770048:12345-0@lo:400:kworker.0 Request processed in 62us (2221us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760778.365435:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455
00000100:00100000:1.0:1789760778.365635:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3455:x1876699548769664:12345-0@lo:400:kworker.0 Request processed in 1570us (2868us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760778.365645:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947
00000100:00080000:0.0:1789760778.365737:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:0.0:1789760778.365747:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1789760778.366217:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456
00000100:00100000:2.0:1789760778.366233:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548769792:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.366304:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548769792:12345-0@lo:400:kworker.0 Request processed in 77us (2840us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760778.366337:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456
00000100:00100000:2.0:1789760778.366389:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948
00000100:00100000:2.0:1789760778.366400:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548770176:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.366445:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3455:x1876699548770176:12345-0@lo:400:kworker.0 Request processed in 49us (3558us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760778.366561:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8daba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e2f0499-cafa-479a-9c13-a508b560cb61:3453:1876699548769536:0@lo:400:kworker.0
00000100:00100000:0.0:1789760778.366656:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548769408:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1789760778.366849:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949
00000100:00100000:1.0:1789760778.366861:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548770688:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760778.367073:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3455:x1876699548770688:12345-0@lo:400:kworker.0 Request processed in 213us (3115us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760778.367080:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949
00000100:00100000:0.0:1789760778.367529:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3455:1876699548770688:0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.367529:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948
00000100:00100000:0.0:1789760778.367553:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3455:1876699548769664:0@lo:400:kworker.0
00000100:00100000:0.0:1789760778.367570:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3455:1876699548770176:0@lo:400:kworker.0
00000100:00100000:0.0:1789760778.367596:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8ae47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548769280:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1789760778.369347:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760778.369423:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3456:1876699548770816:0@lo:400:kworker.0
00000100:00100000:1.0:1789760778.369509:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548770304
00000100:00100000:1.0:1789760778.369521:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548770304
00000100:00100000:1.0:1789760778.369605:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950
00000100:00100000:1.0:1789760778.369615:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876699548770304:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.369640:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760778.369676:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3456:x1876699548770304:12345-0@lo:400:kworker.0 Request processed in 64us (338us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760778.369683:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950
00000100:00100000:1.0:1789760778.369697:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548770816
00000100:00100000:1.0:1789760778.369700:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548770816
00000100:00100000:3.0:1789760778.369708:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548769792:0@lo:400:kworker.0
00000100:00100000:1.0:1789760778.369719:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951
00000100:00100000:1.0:1789760778.369726:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876699548770816:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.369730:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3456:1876699548770304:0@lo:400:kworker.0
00000100:00100000:1.0:1789760778.369750:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3456:x1876699548770816:12345-0@lo:400:kworker.0 Request processed in 25us (110us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760778.369756:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951
00000100:00100000:3.0:1789760778.369777:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3456:1876699548770816:0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.369805:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760778.369860:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548769920
00000100:00100000:1.0:1789760778.369863:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548769920
00000100:00100000:1.0:1789760778.369883:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952
00000100:00100000:1.0:1789760778.369887:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876699548769920:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760778.369912:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3454:x1876699548769920:12345-0@lo:400:kworker.0 Request processed in 25us (108us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760778.369917:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952
00000100:00100000:3.0:1789760778.370029:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3454:1876699548769920:0@lo:400:kworker.0
00000100:00080000:0.0:1789760778.370040:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1789760778.370040:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548770432:0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.370080:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760778.370122:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548770048:0@lo:400:kworker.0
00000100:00100000:3.0:1789760778.370138:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548770560:0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.370195:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548770432
00000100:00100000:2.0:1789760778.370201:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548770432
00000100:00100000:2.0:1789760778.370250:0:9637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308
00000100:00100000:2.0:1789760778.370260:0:9637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548770432:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.370350:0:9637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3454:x1876699548770432:12345-0@lo:400:kworker.0 Request processed in 92us (269us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760778.370359:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548770432:0@lo:400:kworker.0
00000100:00100000:2.0:1789760778.370360:0:9637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308
00000001:00080000:2.0:1789760778.410154:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973403 is committed
00002000:00010000:1.0:1789760778.410430:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24915968 -> 24920064
00010000:00010000:1.0:1789760778.410450:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.410476:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.410486:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.410494:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760778.410500:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.410509:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.410533:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.410542:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60d936 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24915968->24920063] (req 24915968->24920063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760778.410716:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521041792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54031us (54336us total) trans 4294973403 rc 0/0
00000100:00100000:1.0:1789760778.410729:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6116
00000100:00100000:1.0:1789760778.410742:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749977006573 time 750043348863 state 0x2 ref 0
00000100:00100000:1.0:1789760778.414581:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760778.417176:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521041920
00000100:00100000:0.0:1789760778.417198:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521041920
00000100:00100000:2.0:1789760778.417538:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 749977006573 time 750043348863 state 0x0 ref 1
00000100:00100000:2.0:1789760778.417561:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750043609279 time 750043348863 state 0x1 ref 1
00000100:00100000:2.0:1789760778.417638:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750043609279 time 750104319353 state 0x0 ref 1
00000100:00100000:2.0:1789760778.417655:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.417726:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24920064, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.417738:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.417759:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760778.417764:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.417772:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.417789:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760778.462508:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973404 is committed
00002000:00010000:3.0:1789760778.462773:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24920064 -> 24924160
00010000:00010000:3.0:1789760778.462794:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.462811:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.462821:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.462906:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760778.462912:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.462929:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.462956:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.462965:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d93d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24920064->24924159] (req 24920064->24924159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760778.463098:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521041920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45439us (48522us total) trans 4294973404 rc 0/0
00000100:00100000:3.0:1789760778.464256:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6117
00000100:00100000:3.0:1789760778.464269:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750043609279 time 750104319353 state 0x2 ref 0
00000100:00100000:1.0:1789760778.469732:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760778.469923:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521042048
00000100:00100000:2.0:1789760778.469936:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521042048
00000100:00100000:2.0:1789760778.470013:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750043609279 time 750104319353 state 0x0 ref 1
00000100:00100000:2.0:1789760778.470033:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750104579769 time 750104319353 state 0x1 ref 1
00000100:00100000:2.0:1789760778.470112:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750104579769 time 750156785362 state 0x0 ref 1
00000100:00100000:2.0:1789760778.470127:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521042048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.470190:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24924160, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.470203:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.470222:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760778.470227:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.470234:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.470251:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760778.515429:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973405 is committed
00002000:00010000:2.0:1789760778.515786:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24924160 -> 24928256
00010000:00010000:2.0:1789760778.515803:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.515815:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.515824:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.515831:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760778.515835:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.515843:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.515862:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.515870:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d944 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24924160->24928255] (req 24924160->24928255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760778.516013:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521042048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45883us (46289us total) trans 4294973405 rc 0/0
00000100:00100000:2.0:1789760778.516027:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6118
00000100:00100000:2.0:1789760778.516038:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750104579769 time 750156785362 state 0x2 ref 0
00000100:00100000:2.0:1789760778.522258:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760778.522377:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521042176
00000100:00100000:1.0:1789760778.522387:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521042176
00000100:00100000:1.0:1789760778.522441:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750104579769 time 750156785362 state 0x0 ref 1
00000100:00100000:1.0:1789760778.522456:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750157045778 time 750156785362 state 0x1 ref 1
00000100:00100000:1.0:1789760778.522602:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750157045778 time 750209284147 state 0x0 ref 1
00000100:00100000:1.0:1789760778.522617:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521042176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760778.522663:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24928256, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:1.0:1789760778.522673:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.522688:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:1.0:1789760778.522692:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760778.522698:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.522712:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760778.559738:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973406 is committed
00002000:00010000:3.0:1789760778.559784:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24928256 -> 24932352
00010000:00010000:3.0:1789760778.559804:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.559817:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.559826:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.559833:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760778.559838:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.559846:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.559878:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.559886:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60d94b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24928256->24932351] (req 24928256->24932351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760778.560103:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521042176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37483us (37848us total) trans 4294973406 rc 0/0
00000100:00100000:3.0:1789760778.560120:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6119
00000100:00100000:3.0:1789760778.560130:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750157045778 time 750209284147 state 0x2 ref 0
00000100:00100000:0.0:1789760778.564198:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760778.564367:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521042304
00000100:00100000:3.0:1789760778.564379:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521042304
00000100:00100000:2.0:1789760778.564835:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750157045778 time 750209284147 state 0x0 ref 1
00000100:00100000:2.0:1789760778.564853:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750209544563 time 750209284147 state 0x1 ref 1
00000100:00100000:2.0:1789760778.564887:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750209544563 time 750251569860 state 0x0 ref 1
00000100:00100000:2.0:1789760778.564911:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521042304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.564960:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24932352, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.564969:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.564985:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760778.564989:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.565163:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.565178:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760778.608284:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973407 is committed
00002000:00010000:3.0:1789760778.608445:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24932352 -> 24936448
00010000:00010000:3.0:1789760778.608470:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.608484:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.608494:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.608507:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760778.608512:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.608602:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.608622:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.608629:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d952 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24932352->24936447] (req 24932352->24936447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760778.608767:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521042304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43853us (44572us total) trans 4294973407 rc 0/0
00000100:00100000:3.0:1789760778.608778:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6120
00000100:00100000:3.0:1789760778.608787:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750209544563 time 750251569860 state 0x2 ref 0
00000100:00100000:0.0:1789760778.616071:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760778.616502:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521042432
00000100:00100000:2.0:1789760778.616513:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521042432
00000100:00100000:2.0:1789760778.616632:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750209544563 time 750251569860 state 0x0 ref 1
00000100:00100000:2.0:1789760778.616647:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750251830276 time 750251569860 state 0x1 ref 1
00000100:00100000:2.0:1789760778.616708:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750251830276 time 750303389960 state 0x0 ref 1
00000100:00100000:2.0:1789760778.616723:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521042432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.616775:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24936448, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.616784:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.616800:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760778.616804:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.616811:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.616826:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760778.648072:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973408 is committed
00002000:00010000:1.0:1789760778.649634:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24936448 -> 24940544
00010000:00010000:1.0:1789760778.649650:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.649869:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.649883:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.649891:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760778.649897:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.649906:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.649927:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.649935:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d959 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24936448->24940543] (req 24936448->24940543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760778.650110:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521042432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33384us (34045us total) trans 4294973408 rc 0/0
00000100:00100000:1.0:1789760778.650121:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6121
00000100:00100000:1.0:1789760778.650131:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750251830276 time 750303389960 state 0x2 ref 0
00000100:00100000:2.0:1789760778.656852:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760778.657012:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521042560
00000100:00100000:3.0:1789760778.657022:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521042560
00000100:00100000:3.0:1789760778.657075:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750251830276 time 750303389960 state 0x0 ref 1
00000100:00100000:3.0:1789760778.657102:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750303650376 time 750303389960 state 0x1 ref 1
00000100:00100000:3.0:1789760778.657133:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750303650376 time 750343815660 state 0x0 ref 1
00000100:00100000:3.0:1789760778.657148:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521042560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760778.657193:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24940544, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:3.0:1789760778.657203:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.657220:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:3.0:1789760778.657224:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760778.657230:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.657246:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760778.691500:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973409 is committed
00002000:00010000:1.0:1789760778.691615:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24940544 -> 24944640
00010000:00010000:1.0:1789760778.691631:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.691647:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.691657:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.691664:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760778.691669:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.691678:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.691697:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.691706:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60d960 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24940544->24944639] (req 24940544->24944639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760778.691798:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521042560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34646us (34949us total) trans 4294973409 rc 0/0
00000100:00100000:1.0:1789760778.691809:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6122
00000100:00100000:1.0:1789760778.691818:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750303650376 time 750343815660 state 0x2 ref 0
00000100:00100000:2.0:1789760778.696745:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760778.696794:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521042688
00000100:00100000:3.0:1789760778.696803:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521042688
00000100:00100000:3.0:1789760778.696865:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750303650376 time 750343815660 state 0x0 ref 1
00000100:00100000:3.0:1789760778.696881:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750344076076 time 750343815660 state 0x1 ref 1
00000100:00100000:3.0:1789760778.696909:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750344076076 time 750383591665 state 0x0 ref 1
00000100:00100000:3.0:1789760778.696922:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521042688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760778.696973:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24944640, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:3.0:1789760778.696983:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.697016:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:3.0:1789760778.697020:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760778.697026:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.697039:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760778.726414:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24944640 -> 24948736
00010000:00010000:3.0:1789760778.726435:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.726448:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.726457:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.726475:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760778.726480:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.726489:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.726509:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.726518:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d967 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24944640->24948735] (req 24944640->24948735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760778.726601:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521042688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29677us (29861us total) trans 4294973410 rc 0/0
00000100:00100000:3.0:1789760778.726611:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6123
00000100:00100000:3.0:1789760778.726621:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750344076076 time 750383591665 state 0x2 ref 0
00000001:00080000:0.0:1789760778.726773:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973410 is committed
00000100:00100000:0.0:1789760778.730004:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760778.730124:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521042816
00000100:00100000:2.0:1789760778.730134:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521042816
00000100:00100000:2.0:1789760778.730187:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750344076076 time 750383591665 state 0x0 ref 1
00000100:00100000:2.0:1789760778.730201:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750383852081 time 750383591665 state 0x1 ref 1
00000100:00100000:2.0:1789760778.730278:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750383852081 time 750416959395 state 0x0 ref 1
00000100:00100000:2.0:1789760778.730292:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521042816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.730384:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24948736, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.730394:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.730413:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760778.730418:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.730425:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.730440:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760778.755836:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973411 is committed
00002000:00010000:3.0:1789760778.755921:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24948736 -> 24952832
00010000:00010000:3.0:1789760778.755938:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.755949:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.755955:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.755960:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760778.755964:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.755969:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.756033:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.756040:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60d96e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24948736->24952831] (req 24948736->24952831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760778.756215:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521042816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25921us (26216us total) trans 4294973411 rc 0/0
00000100:00100000:3.0:1789760778.756225:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6124
00000100:00100000:3.0:1789760778.756234:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750383852081 time 750416959395 state 0x2 ref 0
00000100:00100000:2.0:1789760778.758911:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760778.759310:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521042944
00000100:00100000:1.0:1789760778.759441:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521042944
00000100:00100000:1.0:1789760778.759507:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750383852081 time 750416959395 state 0x0 ref 1
00000100:00100000:1.0:1789760778.759523:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750417219811 time 750416959395 state 0x1 ref 1
00000100:00100000:2.0:1789760778.759700:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750417219811 time 750446380660 state 0x0 ref 1
00000100:00100000:2.0:1789760778.759714:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521042944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.759768:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24952832, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:2.0:1789760778.759777:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.759792:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760778.759797:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.759804:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.759823:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760778.785676:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24952832 -> 24956928
00000001:00080000:0.0:1789760778.785679:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973412 is committed
00010000:00010000:3.0:1789760778.785695:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.785709:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.785718:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.785725:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760778.785730:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.785746:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.785767:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.785775:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60d975 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24952832->24956927] (req 24952832->24956927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760778.785874:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521042944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26156us (26966us total) trans 4294973412 rc 0/0
00000100:00100000:3.0:1789760778.785886:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6125
00000100:00100000:3.0:1789760778.785896:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750417219811 time 750446380660 state 0x2 ref 0
00000100:00100000:2.0:1789760778.790501:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760778.791157:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521043072
00000100:00100000:1.0:1789760778.791167:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521043072
00000100:00100000:1.0:1789760778.791219:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750417219811 time 750446380660 state 0x0 ref 1
00000100:00100000:1.0:1789760778.791234:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750446641076 time 750446380660 state 0x1 ref 1
00000100:00100000:1.0:1789760778.791299:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750446641076 time 750477981621 state 0x0 ref 1
00000100:00100000:1.0:1789760778.791311:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521043072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760778.791373:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24956928, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:1.0:1789760778.791382:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.791397:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:1.0:1789760778.791402:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760778.791408:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.791420:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.809963:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760778.818636:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973413 is committed
00002000:00010000:1.0:1789760778.818858:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24956928 -> 24961024
00010000:00010000:1.0:1789760778.818875:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.818890:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.818899:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.818907:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760778.818912:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.818920:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.818941:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.818949:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d97c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24956928->24961023] (req 24956928->24961023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760778.819248:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521043072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27934us (28939us total) trans 4294973413 rc 0/0
00000100:00100000:1.0:1789760778.819260:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6126
00000100:00100000:1.0:1789760778.819269:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750446641076 time 750477981621 state 0x2 ref 0
00000100:00100000:0.0:1789760778.824045:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760778.825388:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521043200
00000100:00100000:3.0:1789760778.825400:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521043200
00000100:00100000:3.0:1789760778.825475:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750446641076 time 750477981621 state 0x0 ref 1
00000100:00100000:3.0:1789760778.825491:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750478242037 time 750477981621 state 0x1 ref 1
00000100:00100000:3.0:1789760778.825570:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750478242037 time 750512252273 state 0x0 ref 1
00000100:00100000:3.0:1789760778.825585:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521043200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760778.825635:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24961024, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:3.0:1789760778.825644:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.825661:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:3.0:1789760778.825665:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760778.825671:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.825685:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760778.860974:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973414 is committed
00002000:00010000:1.0:1789760778.861083:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24961024 -> 24965120
00010000:00010000:1.0:1789760778.861100:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.861192:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.861203:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.861211:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760778.861216:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.861225:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.861246:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.861254:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60d983 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24961024->24965119] (req 24961024->24965119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760778.861379:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521043200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35794us (37339us total) trans 4294973414 rc 0/0
00000100:00100000:1.0:1789760778.861388:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6127
00000100:00100000:1.0:1789760778.861397:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750478242037 time 750512252273 state 0x2 ref 0
00000100:00100000:2.0:1789760778.867874:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760778.867950:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521043328
00000100:00100000:3.0:1789760778.867959:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521043328
00000100:00100000:3.0:1789760778.868009:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750478242037 time 750512252273 state 0x0 ref 1
00000100:00100000:3.0:1789760778.868023:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750512512689 time 750512252273 state 0x1 ref 1
00000100:00100000:3.0:1789760778.868055:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750512512689 time 750554737313 state 0x0 ref 1
00000100:00100000:3.0:1789760778.868068:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521043328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760778.868231:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24965120, mtime: 0x6aad950b, atime: 0x0, ctime: 0x6aad950b, blocks: 0xc007
00010000:00010000:3.0:1789760778.868241:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.868256:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:3.0:1789760778.868261:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760778.868267:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760778.868287:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760778.904741:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973415 is committed
00002000:00010000:2.0:1789760778.904831:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24965120 -> 24969216
00002000:00010000:2.0:1789760778.904836:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760779 -> 1789760780
00002000:00010000:2.0:1789760778.904838:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760779 -> 1789760780
00010000:00010000:2.0:1789760778.904851:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.904864:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.904872:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.904879:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760778.904885:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.904894:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.904913:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.904922:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d98a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24965120->24969215] (req 24965120->24969215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760778.905245:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521043328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37174us (37375us total) trans 4294973415 rc 0/0
00000100:00100000:2.0:1789760778.905257:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6128
00000100:00100000:2.0:1789760778.905268:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750512512689 time 750554737313 state 0x2 ref 0
00000100:00100000:1.0:1789760778.909264:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760778.909420:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521043456
00000100:00100000:2.0:1789760778.909429:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521043456
00000100:00100000:2.0:1789760778.909491:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750512512689 time 750554737313 state 0x0 ref 1
00000100:00100000:2.0:1789760778.909506:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750554997729 time 750554737313 state 0x1 ref 1
00000100:00100000:2.0:1789760778.909566:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750554997729 time 750596247765 state 0x0 ref 1
00000100:00100000:2.0:1789760778.909579:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521043456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.909625:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24969216, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:2.0:1789760778.909634:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.909650:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760778.909654:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.909661:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.909681:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760778.940077:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973416 is committed
00002000:00010000:1.0:1789760778.940219:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24969216 -> 24973312
00010000:00010000:1.0:1789760778.940235:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.940248:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.940258:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.940266:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760778.940271:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.940281:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.940299:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.940307:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60d991 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24969216->24973311] (req 24969216->24973311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760778.940414:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521043456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30833us (31155us total) trans 4294973416 rc 0/0
00000100:00100000:1.0:1789760778.940425:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6129
00000100:00100000:1.0:1789760778.940435:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750554997729 time 750596247765 state 0x2 ref 0
00000100:00100000:1.0:1789760778.944069:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760778.944352:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521043584
00000100:00100000:2.0:1789760778.944362:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521043584
00000100:00100000:2.0:1789760778.944411:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750554997729 time 750596247765 state 0x0 ref 1
00000100:00100000:2.0:1789760778.944426:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750596508181 time 750596247765 state 0x1 ref 1
00000100:00100000:2.0:1789760778.944468:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750596508181 time 750631140663 state 0x0 ref 1
00000100:00100000:2.0:1789760778.944482:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521043584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760778.944527:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24973312, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:2.0:1789760778.944536:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.944551:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760778.944556:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760778.944561:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.944574:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760778.974431:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973417 is committed
00002000:00010000:2.0:1789760778.974512:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24973312 -> 24977408
00010000:00010000:2.0:1789760778.974527:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.974540:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.974550:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.974557:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760778.974561:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.974570:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.974588:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760778.974596:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60d998 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24973312->24977407] (req 24973312->24977407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760778.974682:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521043584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30197us (30616us total) trans 4294973417 rc 0/0
00000100:00100000:2.0:1789760778.974693:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6130
00000100:00100000:2.0:1789760778.974703:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750596508181 time 750631140663 state 0x2 ref 0
00000100:00100000:2.0:1789760778.978064:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760778.978208:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521043712
00000100:00100000:1.0:1789760778.978219:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521043712
00000100:00100000:1.0:1789760778.978268:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750596508181 time 750631140663 state 0x0 ref 1
00000100:00100000:1.0:1789760778.978283:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750631401079 time 750631140663 state 0x1 ref 1
00000100:00100000:1.0:1789760778.978421:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750631401079 time 750665102152 state 0x0 ref 1
00000100:00100000:1.0:1789760778.978435:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521043712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760778.978495:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24977408, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:1.0:1789760778.978505:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.978521:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:1.0:1789760778.978525:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760778.978531:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760778.978544:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760779.010171:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24977408 -> 24981504
00010000:00010000:2.0:1789760779.010192:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.010206:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.010217:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.010225:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760779.010230:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.010239:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.010260:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.010268:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60d99f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24977408->24981503] (req 24977408->24981503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760779.010496:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521043712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32056us (32436us total) trans 4294973418 rc 0/0
00000100:00100000:2.0:1789760779.010511:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6131
00000100:00100000:2.0:1789760779.010521:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750631401079 time 750665102152 state 0x2 ref 0
00000001:00080000:2.0:1789760779.010562:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973418 is committed
00000100:00100000:2.0:1789760779.019892:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.020106:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521043840
00000100:00100000:0.0:1789760779.020117:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521043840
00000100:00100000:0.0:1789760779.020171:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750631401079 time 750665102152 state 0x0 ref 1
00000100:00100000:0.0:1789760779.020187:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750665362568 time 750665102152 state 0x1 ref 1
00000100:00100000:0.0:1789760779.020250:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750665362568 time 750706932737 state 0x0 ref 1
00000100:00100000:0.0:1789760779.020264:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521043840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.020339:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24981504, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.020349:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.020365:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:0.0:1789760779.020369:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.020375:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.020389:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760779.052532:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24981504 -> 24985600
00010000:00010000:0.0:1789760779.052551:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.052564:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.052573:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.052581:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.052586:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.052596:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.052615:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.052622:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24981504->24985599] (req 24981504->24985599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.052718:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521043840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32453us (32830us total) trans 4294973419 rc 0/0
00000100:00100000:0.0:1789760779.052729:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6132
00000100:00100000:0.0:1789760779.052738:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750665362568 time 750706932737 state 0x2 ref 0
00000001:00080000:1.0:1789760779.052813:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973419 is committed
00000100:00100000:1.0:1789760779.057976:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760779.058116:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521043968
00000100:00100000:2.0:1789760779.058126:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521043968
00000100:00100000:2.0:1789760779.058179:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750665362568 time 750706932737 state 0x0 ref 1
00000100:00100000:2.0:1789760779.058195:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750707193153 time 750706932737 state 0x1 ref 1
00000100:00100000:2.0:1789760779.058229:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750707193153 time 750744911632 state 0x0 ref 1
00000100:00100000:2.0:1789760779.058242:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521043968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760779.058289:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24985600, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:2.0:1789760779.058298:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.058417:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760779.058423:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760779.058431:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.058447:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760779.081970:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24985600 -> 24989696
00010000:00010000:0.0:1789760779.081998:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.082012:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.082020:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.082028:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.082033:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.082042:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.082060:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.082072:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60d9ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24985600->24989695] (req 24985600->24989695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.082159:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521043968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23915us (24187us total) trans 4294973420 rc 0/0
00000100:00100000:0.0:1789760779.082170:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6133
00000100:00100000:0.0:1789760779.082180:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750707193153 time 750744911632 state 0x2 ref 0
00000001:00080000:1.0:1789760779.082750:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973420 is committed
00000100:00100000:2.0:1789760779.091453:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.091567:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521044096
00000100:00100000:0.0:1789760779.091576:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521044096
00000100:00100000:0.0:1789760779.091625:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750707193153 time 750744911632 state 0x0 ref 1
00000100:00100000:0.0:1789760779.091641:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750745172048 time 750744911632 state 0x1 ref 1
00000100:00100000:0.0:1789760779.091669:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750745172048 time 750778351539 state 0x0 ref 1
00000100:00100000:0.0:1789760779.091681:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521044096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.091731:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24989696, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.091740:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.091756:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:0.0:1789760779.091760:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.091767:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.091797:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760779.123343:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973421 is committed
00002000:00010000:2.0:1789760779.123445:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24989696 -> 24993792
00010000:00010000:2.0:1789760779.123469:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.123483:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.123491:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.123498:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760779.123502:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.123511:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.123530:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.123539:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60d9b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24989696->24993791] (req 24989696->24993791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760779.123631:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521044096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31948us (32184us total) trans 4294973421 rc 0/0
00000100:00100000:2.0:1789760779.123643:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6134
00000100:00100000:2.0:1789760779.123652:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750745172048 time 750778351539 state 0x2 ref 0
00000100:00100000:2.0:1789760779.127821:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760779.127916:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521044224
00000100:00100000:1.0:1789760779.127928:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521044224
00000100:00100000:1.0:1789760779.127980:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750745172048 time 750778351539 state 0x0 ref 1
00000100:00100000:1.0:1789760779.128006:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750778611955 time 750778351539 state 0x1 ref 1
00000100:00100000:1.0:1789760779.128037:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750778611955 time 750814719829 state 0x0 ref 1
00000100:00100000:1.0:1789760779.128049:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521044224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760779.128107:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24993792, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:1.0:1789760779.128116:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.128132:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:1.0:1789760779.128137:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760779.128143:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.128158:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760779.152598:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973422 is committed
00002000:00010000:2.0:1789760779.152829:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24993792 -> 24997888
00010000:00010000:2.0:1789760779.152847:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.152861:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.152870:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.152879:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760779.152884:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.152893:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.152913:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.152921:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60d9bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24993792->24997887] (req 24993792->24997887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760779.153033:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521044224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24981us (25217us total) trans 4294973422 rc 0/0
00000100:00100000:2.0:1789760779.153044:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6135
00000100:00100000:2.0:1789760779.153055:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750778611955 time 750814719829 state 0x2 ref 0
00000100:00100000:1.0:1789760779.158962:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760779.159135:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521044352
00000100:00100000:2.0:1789760779.159145:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521044352
00000100:00100000:2.0:1789760779.159202:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750778611955 time 750814719829 state 0x0 ref 1
00000100:00100000:2.0:1789760779.159218:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750814980245 time 750814719829 state 0x1 ref 1
00000100:00100000:2.0:1789760779.159253:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750814980245 time 750845936392 state 0x0 ref 1
00000100:00100000:2.0:1789760779.159265:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521044352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760779.159344:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 24997888, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:2.0:1789760779.159352:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.159368:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760779.159373:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760779.159378:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.159391:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760779.200343:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973423 is committed
00002000:00010000:3.0:1789760779.200517:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 24997888 -> 25001984
00010000:00010000:3.0:1789760779.200534:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.200546:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.200555:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.200564:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760779.200569:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.200578:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.200597:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.200604:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60d9c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [24997888->25001983] (req 24997888->25001983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760779.200752:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521044352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41483us (41797us total) trans 4294973423 rc 0/0
00000100:00100000:3.0:1789760779.200763:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6136
00000100:00100000:3.0:1789760779.200773:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750814980245 time 750845936392 state 0x2 ref 0
00000100:00100000:3.0:1789760779.203480:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.203952:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521044480
00000100:00100000:0.0:1789760779.203961:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521044480
00000100:00100000:0.0:1789760779.204018:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750814980245 time 750845936392 state 0x0 ref 1
00000100:00100000:0.0:1789760779.204032:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750846196808 time 750845936392 state 0x1 ref 1
00000100:00100000:0.0:1789760779.204068:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750846196808 time 750890750096 state 0x0 ref 1
00000100:00100000:0.0:1789760779.204081:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521044480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.204382:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25001984, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.204392:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.204407:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:0.0:1789760779.204413:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.204419:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.204432:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760779.234382:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973424 is committed
00002000:00010000:0.0:1789760779.234489:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25001984 -> 25006080
00010000:00010000:0.0:1789760779.234505:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.234518:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.234528:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.234535:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.234541:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.234551:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.234569:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.234578:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25001984->25006079] (req 25001984->25006079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.234710:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521044480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30625us (31232us total) trans 4294973424 rc 0/0
00000100:00100000:0.0:1789760779.234724:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6137
00000100:00100000:0.0:1789760779.234735:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750846196808 time 750890750096 state 0x2 ref 0
00000100:00100000:2.0:1789760779.239813:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.239959:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521044608
00000100:00100000:0.0:1789760779.239973:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521044608
00000100:00100000:0.0:1789760779.240089:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750846196808 time 750890750096 state 0x0 ref 1
00000100:00100000:0.0:1789760779.240160:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750891010512 time 750890750096 state 0x1 ref 1
00000100:00100000:0.0:1789760779.240227:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750891010512 time 750926909171 state 0x0 ref 1
00000100:00100000:0.0:1789760779.240240:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521044608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.240293:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25006080, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.240302:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.240344:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:0.0:1789760779.240350:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.240356:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.240371:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760779.293621:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973425 is committed
00002000:00010000:0.0:1789760779.293744:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25006080 -> 25010176
00010000:00010000:0.0:1789760779.293760:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.293773:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.293783:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.293790:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.293794:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.293803:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.293822:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.293829:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25006080->25010175] (req 25006080->25010175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.294534:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521044608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54290us (54724us total) trans 4294973425 rc 0/0
00000100:00100000:0.0:1789760779.294546:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6138
00000100:00100000:0.0:1789760779.294555:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750891010512 time 750926909171 state 0x2 ref 0
00000100:00100000:1.0:1789760779.299097:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760779.299148:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521044736
00000100:00100000:2.0:1789760779.299159:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521044736
00000100:00100000:2.0:1789760779.299212:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750891010512 time 750926909171 state 0x0 ref 1
00000100:00100000:2.0:1789760779.299227:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750927169587 time 750926909171 state 0x1 ref 1
00000100:00100000:2.0:1789760779.299263:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750927169587 time 750985946093 state 0x0 ref 1
00000100:00100000:2.0:1789760779.299274:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521044736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760779.299346:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25010176, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:2.0:1789760779.299355:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.299370:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=750s v=(0 0)
00010000:00010000:2.0:1789760779.299375:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760779.299381:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.299394:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760779.331056:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973426 is committed
00002000:00010000:3.0:1789760779.331269:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25010176 -> 25014272
00010000:00010000:3.0:1789760779.331285:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.331299:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.331308:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.331333:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760779.331338:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.331347:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.331368:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.331376:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60d9d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25010176->25014271] (req 25010176->25014271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760779.331472:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521044736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32195us (32379us total) trans 4294973426 rc 0/0
00000100:00100000:3.0:1789760779.331483:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6139
00000100:00100000:3.0:1789760779.331494:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750927169587 time 750985946093 state 0x2 ref 0
00000100:00100000:3.0:1789760779.335540:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.336279:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521044864
00000100:00100000:0.0:1789760779.336289:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521044864
00000100:00100000:0.0:1789760779.336501:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750927169587 time 750985946093 state 0x0 ref 1
00000100:00100000:0.0:1789760779.336517:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750986206509 time 750985946093 state 0x1 ref 1
00000100:00100000:0.0:1789760779.336580:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750986206509 time 751023262096 state 0x0 ref 1
00000100:00100000:0.0:1789760779.336593:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521044864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.336639:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25014272, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.336648:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.336663:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760779.336667:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.336672:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.336686:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760779.361476:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25014272 -> 25018368
00010000:00010000:0.0:1789760779.361499:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.361513:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.361530:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.361537:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.361542:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.361550:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.361567:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.361575:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60d9de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25014272->25018367] (req 25014272->25018367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.361660:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521044864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25064us (26124us total) trans 4294973427 rc 0/0
00000100:00100000:0.0:1789760779.361670:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6140
00000100:00100000:0.0:1789760779.361680:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750986206509 time 751023262096 state 0x2 ref 0
00000001:00080000:1.0:1789760779.361743:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973427 is committed
00000100:00100000:2.0:1789760779.365041:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.365347:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521044992
00000100:00100000:0.0:1789760779.365355:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521044992
00000100:00100000:0.0:1789760779.365400:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 750986206509 time 751023262096 state 0x0 ref 1
00000100:00100000:0.0:1789760779.365413:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751023522512 time 751023262096 state 0x1 ref 1
00000100:00100000:0.0:1789760779.365434:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751023522512 time 751052118220 state 0x0 ref 1
00000100:00100000:0.0:1789760779.365444:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521044992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.365497:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25018368, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.365506:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.365520:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760779.365524:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.365529:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.365541:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760779.400664:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25018368 -> 25022464
00010000:00010000:0.0:1789760779.400684:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.400697:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.400705:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.400713:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.400718:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.400727:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.400747:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.400755:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25018368->25022463] (req 25018368->25022463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.400848:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521044992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35400us (35812us total) trans 4294973428 rc 0/0
00000100:00100000:0.0:1789760779.400860:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6141
00000100:00100000:0.0:1789760779.400870:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751023522512 time 751052118220 state 0x2 ref 0
00000001:00080000:3.0:1789760779.402196:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973428 is committed
00000100:00100000:2.0:1789760779.405684:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.405759:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521045120
00000100:00100000:0.0:1789760779.405768:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521045120
00000100:00100000:0.0:1789760779.405816:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751023522512 time 751052118220 state 0x0 ref 1
00000100:00100000:0.0:1789760779.405830:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751052378636 time 751052118220 state 0x1 ref 1
00000100:00100000:0.0:1789760779.405861:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751052378636 time 751092543809 state 0x0 ref 1
00000100:00100000:0.0:1789760779.405872:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521045120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.405918:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25022464, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.405928:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.405942:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760779.405947:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.405953:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.405966:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760779.451854:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25022464 -> 25026560
00010000:00010000:1.0:1789760779.451872:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.451886:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.451896:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.451908:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760779.451913:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.451921:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.451950:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.451959:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60d9ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25022464->25026559] (req 25022464->25026559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760779.452058:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521045120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46181us (46378us total) trans 4294973429 rc 0/0
00000100:00100000:1.0:1789760779.452069:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6142
00000100:00100000:1.0:1789760779.452078:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751052378636 time 751092543809 state 0x2 ref 0
00000001:00080000:2.0:1789760779.454654:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973429 is committed
00000100:00100000:2.0:1789760779.456900:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760779.457472:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521045248
00000100:00100000:1.0:1789760779.457482:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521045248
00000100:00100000:1.0:1789760779.457537:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751052378636 time 751092543809 state 0x0 ref 1
00000100:00100000:1.0:1789760779.457552:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751092804225 time 751092543809 state 0x1 ref 1
00000100:00100000:1.0:1789760779.457579:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751092804225 time 751144262401 state 0x0 ref 1
00000100:00100000:1.0:1789760779.457592:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521045248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760779.457638:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25026560, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:1.0:1789760779.457647:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.457661:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760779.457665:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760779.457671:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.457683:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760779.500725:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973430 is committed
00002000:00010000:0.0:1789760779.500878:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25026560 -> 25030656
00010000:00010000:0.0:1789760779.500898:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.500911:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.500920:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.500927:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.500932:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.500940:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.500964:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.500971:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60d9f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25026560->25030655] (req 25026560->25030655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.501076:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521045248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43482us (44183us total) trans 4294973430 rc 0/0
00000100:00100000:0.0:1789760779.501096:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6143
00000100:00100000:0.0:1789760779.501106:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751092804225 time 751144262401 state 0x2 ref 0
00000100:00100000:0.0:1789760779.504922:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760779.505009:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521045376
00000100:00100000:3.0:1789760779.505020:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521045376
00000100:00100000:3.0:1789760779.505076:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751092804225 time 751144262401 state 0x0 ref 1
00000100:00100000:3.0:1789760779.505103:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751144522817 time 751144262401 state 0x1 ref 1
00000100:00100000:3.0:1789760779.505138:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751144522817 time 751191820606 state 0x0 ref 1
00000100:00100000:3.0:1789760779.505151:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521045376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760779.505429:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25030656, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:3.0:1789760779.505438:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.505566:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:3.0:1789760779.505571:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760779.505578:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760779.505593:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760779.536877:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25030656 -> 25034752
00010000:00010000:2.0:1789760779.536896:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.536909:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.536918:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.536925:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760779.536930:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.536939:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.536956:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.536963:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60d9fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25030656->25034751] (req 25030656->25034751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760779.537064:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521045376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31910us (32147us total) trans 4294973431 rc 0/0
00000100:00100000:2.0:1789760779.537078:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6144
00000100:00100000:2.0:1789760779.537087:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751144522817 time 751191820606 state 0x2 ref 0
00000001:00080000:0.0:1789760779.537308:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973431 is committed
00000100:00100000:2.0:1789760779.540519:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.540597:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521045504
00000100:00100000:0.0:1789760779.540606:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521045504
00000100:00100000:0.0:1789760779.540660:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751144522817 time 751191820606 state 0x0 ref 1
00000100:00100000:0.0:1789760779.540675:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751192081022 time 751191820606 state 0x1 ref 1
00000100:00100000:0.0:1789760779.540702:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751192081022 time 751227385506 state 0x0 ref 1
00000100:00100000:0.0:1789760779.540713:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521045504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.540759:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25034752, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.540767:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.540786:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760779.540791:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.540797:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.540809:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760779.569294:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25034752 -> 25038848
00010000:00010000:2.0:1789760779.569338:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.569352:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.569362:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.569369:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760779.569374:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.569383:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.569402:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.569410:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60da01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25034752->25038847] (req 25034752->25038847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760779.569503:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521045504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28787us (28989us total) trans 4294973432 rc 0/0
00000100:00100000:2.0:1789760779.569513:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6145
00000100:00100000:2.0:1789760779.569522:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751192081022 time 751227385506 state 0x2 ref 0
00000001:00080000:3.0:1789760779.569934:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973432 is committed
00000100:00100000:3.0:1789760779.575053:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760779.575225:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521045632
00000100:00100000:1.0:1789760779.575236:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521045632
00000100:00100000:1.0:1789760779.575290:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751192081022 time 751227385506 state 0x0 ref 1
00000100:00100000:1.0:1789760779.575305:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751227645922 time 751227385506 state 0x1 ref 1
00000100:00100000:1.0:1789760779.575372:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751227645922 time 751262054867 state 0x0 ref 1
00000100:00100000:1.0:1789760779.575384:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521045632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760779.575435:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25038848, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:1.0:1789760779.575444:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.575468:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760779.575473:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760779.575479:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.575494:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760779.606716:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973433 is committed
00002000:00010000:0.0:1789760779.606956:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25038848 -> 25042944
00010000:00010000:0.0:1789760779.606971:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.607041:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.607052:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.607059:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.607063:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.607073:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.607091:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.607099:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25038848->25042943] (req 25038848->25042943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.607353:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521045632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31931us (32275us total) trans 4294973433 rc 0/0
00000100:00100000:0.0:1789760779.607364:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6146
00000100:00100000:0.0:1789760779.607374:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751227645922 time 751262054867 state 0x2 ref 0
00000100:00100000:0.0:1789760779.612474:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760779.612568:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521045760
00000100:00100000:1.0:1789760779.612577:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521045760
00000100:00100000:1.0:1789760779.612627:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751227645922 time 751262054867 state 0x0 ref 1
00000100:00100000:1.0:1789760779.612643:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751262315283 time 751262054867 state 0x1 ref 1
00000100:00100000:1.0:1789760779.612676:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751262315283 time 751299358035 state 0x0 ref 1
00000100:00100000:1.0:1789760779.612688:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521045760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760779.612746:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25042944, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:1.0:1789760779.612756:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.612776:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760779.612780:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760779.612786:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.612799:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760779.644438:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973434 is committed
00002000:00010000:0.0:1789760779.644546:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25042944 -> 25047040
00010000:00010000:0.0:1789760779.644562:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.644575:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.644585:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.644593:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.644597:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.644606:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.644631:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.644639:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60da0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25042944->25047039] (req 25042944->25047039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.644736:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521045760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32035us (32267us total) trans 4294973434 rc 0/0
00000100:00100000:0.0:1789760779.644746:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6147
00000100:00100000:0.0:1789760779.644756:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751262315283 time 751299358035 state 0x2 ref 0
00000100:00100000:1.0:1789760779.648603:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.648682:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521045888
00000100:00100000:0.0:1789760779.648693:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521045888
00000100:00100000:0.0:1789760779.648755:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751262315283 time 751299358035 state 0x0 ref 1
00000100:00100000:0.0:1789760779.648772:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751299618451 time 751299358035 state 0x1 ref 1
00000100:00100000:0.0:1789760779.648803:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751299618451 time 751335485131 state 0x0 ref 1
00000100:00100000:0.0:1789760779.648815:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521045888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.648867:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25047040, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.648877:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.648892:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760779.648897:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.648902:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.648917:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760779.681937:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973435 is committed
00002000:00010000:0.0:1789760779.682059:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25047040 -> 25051136
00010000:00010000:0.0:1789760779.682075:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.682088:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.682098:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.682106:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.682115:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.682124:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.682144:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.682153:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25047040->25051135] (req 25047040->25051135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.682293:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521045888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33475us (33694us total) trans 4294973435 rc 0/0
00000100:00100000:0.0:1789760779.682306:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6148
00000100:00100000:0.0:1789760779.682659:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751299618451 time 751335485131 state 0x2 ref 0
00000100:00100000:3.0:1789760779.685560:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760779.685803:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521046016
00000100:00100000:2.0:1789760779.685814:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521046016
00000100:00100000:2.0:1789760779.685871:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751299618451 time 751335485131 state 0x0 ref 1
00000100:00100000:2.0:1789760779.685889:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751335745547 time 751335485131 state 0x1 ref 1
00000100:00100000:2.0:1789760779.685952:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751335745547 time 751372633846 state 0x0 ref 1
00000100:00100000:2.0:1789760779.685965:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521046016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760779.686032:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25051136, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:2.0:1789760779.686041:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.686059:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:2.0:1789760779.686063:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760779.686071:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.686085:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760779.729797:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973436 is committed
00002000:00010000:2.0:1789760779.729949:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25051136 -> 25055232
00010000:00010000:2.0:1789760779.729965:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.729979:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.729998:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.730006:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760779.730011:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.730019:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.730038:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.730047:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60da1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25051136->25055231] (req 25051136->25055231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760779.730135:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521046016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44168us (44580us total) trans 4294973436 rc 0/0
00000100:00100000:2.0:1789760779.730151:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6149
00000100:00100000:2.0:1789760779.730160:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751335745547 time 751372633846 state 0x2 ref 0
00000100:00100000:2.0:1789760779.738430:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760779.738543:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521046144
00000100:00100000:1.0:1789760779.738552:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521046144
00000100:00100000:1.0:1789760779.738606:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751335745547 time 751372633846 state 0x0 ref 1
00000100:00100000:1.0:1789760779.738621:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751372894262 time 751372633846 state 0x1 ref 1
00000100:00100000:1.0:1789760779.738654:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751372894262 time 751425336471 state 0x0 ref 1
00000100:00100000:1.0:1789760779.738665:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521046144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760779.738708:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25055232, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:1.0:1789760779.738717:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.738796:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760779.738802:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760779.738809:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.738824:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760779.791690:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973437 is committed
00002000:00010000:2.0:1789760779.791775:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25055232 -> 25059328
00010000:00010000:2.0:1789760779.791789:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.791806:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.791816:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.791824:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760779.791829:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.791837:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.791855:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.791863:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25055232->25059327] (req 25055232->25059327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760779.792081:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521046144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53411us (53654us total) trans 4294973437 rc 0/0
00000100:00100000:2.0:1789760779.792092:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6150
00000100:00100000:2.0:1789760779.792100:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751372894262 time 751425336471 state 0x2 ref 0
00000100:00100000:1.0:1789760779.801049:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.801522:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521046272
00000100:00100000:0.0:1789760779.801532:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521046272
00000100:00100000:1.0:1789760779.801647:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751372894262 time 751425336471 state 0x0 ref 1
00000100:00100000:1.0:1789760779.801661:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751425596887 time 751425336471 state 0x1 ref 1
00000100:00100000:1.0:1789760779.801755:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751425596887 time 751488436981 state 0x0 ref 1
00000100:00100000:1.0:1789760779.801768:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521046272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760779.801809:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25059328, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:1.0:1789760779.801817:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.801832:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760779.801837:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760779.801843:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.801856:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760779.832773:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973438 is committed
00002000:00010000:2.0:1789760779.833039:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25059328 -> 25063424
00010000:00010000:2.0:1789760779.833054:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.833067:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.833076:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.833083:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760779.833088:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.833097:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.833115:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.833129:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25059328->25063423] (req 25059328->25063423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760779.833221:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521046272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31449us (32175us total) trans 4294973438 rc 0/0
00000100:00100000:2.0:1789760779.833233:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6151
00000100:00100000:2.0:1789760779.833242:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751425596887 time 751488436981 state 0x2 ref 0
00010000:00010000:0.0:1789760779.833626:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1789760779.839227:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.839509:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521046400
00000100:00100000:0.0:1789760779.839518:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521046400
00000100:00100000:0.0:1789760779.839569:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751425596887 time 751488436981 state 0x0 ref 1
00000100:00100000:0.0:1789760779.839583:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751488697397 time 751488436981 state 0x1 ref 1
00000100:00100000:0.0:1789760779.839611:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751488697397 time 751526294030 state 0x0 ref 1
00000100:00100000:0.0:1789760779.839622:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521046400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.839669:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25063424, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:0.0:1789760779.839678:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.839694:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760779.839698:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.839704:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.839723:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760779.883806:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25063424 -> 25067520
00010000:00010000:0.0:1789760779.883825:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.883837:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.883855:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.883862:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.883867:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.883876:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.883895:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.883902:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60da32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25063424->25067519] (req 25063424->25067519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.884001:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521046400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44374us (44778us total) trans 4294973439 rc 0/0
00000100:00100000:0.0:1789760779.884011:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6152
00000100:00100000:0.0:1789760779.884020:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751488697397 time 751526294030 state 0x2 ref 0
00000001:00080000:1.0:1789760779.884142:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973439 is committed
00000100:00100000:1.0:1789760779.887467:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760779.887746:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521046528
00000100:00100000:2.0:1789760779.887756:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521046528
00000100:00100000:2.0:1789760779.887811:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751488697397 time 751526294030 state 0x0 ref 1
00000100:00100000:2.0:1789760779.887827:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751526554446 time 751526294030 state 0x1 ref 1
00000100:00100000:2.0:1789760779.887898:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751526554446 time 751574580430 state 0x0 ref 1
00000100:00100000:2.0:1789760779.887911:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521046528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760779.887958:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25067520, mtime: 0x6aad950c, atime: 0x0, ctime: 0x6aad950c, blocks: 0xc007
00010000:00010000:2.0:1789760779.887976:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.887997:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:2.0:1789760779.888002:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760779.888009:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760779.888028:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760779.922167:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25067520 -> 25071616
00002000:00010000:0.0:1789760779.922176:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760780 -> 1789760781
00002000:00010000:0.0:1789760779.922178:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760780 -> 1789760781
00010000:00010000:0.0:1789760779.922190:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.922203:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.922211:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.922219:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760779.922224:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.922233:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.922253:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.922261:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60da39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25067520->25071615] (req 25067520->25071615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760779.922383:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521046528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34468us (34931us total) trans 4294973440 rc 0/0
00000100:00100000:0.0:1789760779.922392:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6153
00000100:00100000:0.0:1789760779.922402:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751526554446 time 751574580430 state 0x2 ref 0
00000001:00080000:1.0:1789760779.922843:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973440 is committed
00000100:00100000:2.0:1789760779.927528:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760779.927650:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521046656
00000100:00100000:0.0:1789760779.927664:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521046656
00000100:00100000:0.0:1789760779.927724:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751526554446 time 751574580430 state 0x0 ref 1
00000100:00100000:0.0:1789760779.927740:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751574840846 time 751574580430 state 0x1 ref 1
00000100:00100000:0.0:1789760779.927774:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751574840846 time 751614456837 state 0x0 ref 1
00000100:00100000:0.0:1789760779.927790:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521046656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760779.927850:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25071616, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:0.0:1789760779.927862:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.927881:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760779.927890:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760779.927900:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760779.927923:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760779.961392:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973441 is committed
00002000:00010000:1.0:1789760779.961723:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25071616 -> 25075712
00010000:00010000:1.0:1789760779.961739:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.961753:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.961761:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.961769:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760779.961774:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.961783:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.961803:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.961813:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60da40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25071616->25075711] (req 25071616->25075711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760779.962007:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521046656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34217us (34483us total) trans 4294973441 rc 0/0
00000100:00100000:1.0:1789760779.962019:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6154
00000100:00100000:1.0:1789760779.962028:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751574840846 time 751614456837 state 0x2 ref 0
00000100:00100000:0.0:1789760779.967608:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760779.967704:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521046784
00000100:00100000:1.0:1789760779.967714:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521046784
00000100:00100000:1.0:1789760779.967771:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751574840846 time 751614456837 state 0x0 ref 1
00000100:00100000:1.0:1789760779.967786:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751614717253 time 751614456837 state 0x1 ref 1
00000100:00100000:1.0:1789760779.967903:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751614717253 time 751654583839 state 0x0 ref 1
00000100:00100000:1.0:1789760779.967915:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521046784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760779.967962:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25075712, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760779.967972:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.967988:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760779.967992:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760779.967999:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760779.968013:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760780.010849:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973442 is committed
00002000:00010000:2.0:1789760780.011000:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25075712 -> 25079808
00010000:00010000:2.0:1789760780.011015:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.011036:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.011045:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.011053:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.011058:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.011068:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.011095:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.011103:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60da47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25075712->25079807] (req 25075712->25079807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.011194:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521046784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43276us (43591us total) trans 4294973442 rc 0/0
00000100:00100000:2.0:1789760780.011204:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6155
00000100:00100000:2.0:1789760780.011213:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751614717253 time 751654583839 state 0x2 ref 0
00000100:00100000:2.0:1789760780.019297:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760780.019441:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521046912
00000100:00100000:1.0:1789760780.019461:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521046912
00000100:00100000:1.0:1789760780.019731:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751614717253 time 751654583839 state 0x0 ref 1
00000100:00100000:1.0:1789760780.019746:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751654844255 time 751654583839 state 0x1 ref 1
00000100:00080000:0.0:1789760780.019772:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1789760780.019782:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751654844255 time 751706463776 state 0x0 ref 1
00000100:00100000:1.0:1789760780.019795:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521046912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760780.019843:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25079808, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760780.019852:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.019867:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760780.019872:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760780.019879:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.019892:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760780.072290:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973443 is committed
00002000:00010000:2.0:1789760780.072339:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25079808 -> 25083904
00010000:00010000:2.0:1789760780.072354:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.072368:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.072378:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.072385:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.072390:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.072400:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.072419:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.072432:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60da4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25079808->25083903] (req 25079808->25083903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.072532:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521046912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52734us (53240us total) trans 4294973443 rc 0/0
00000100:00100000:2.0:1789760780.072547:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6156
00000100:00100000:2.0:1789760780.072557:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751654844255 time 751706463776 state 0x2 ref 0
00000100:00100000:1.0:1789760780.076624:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760780.076721:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521047040
00000100:00100000:0.0:1789760780.076731:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521047040
00000100:00100000:0.0:1789760780.076862:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751654844255 time 751706463776 state 0x0 ref 1
00000100:00100000:0.0:1789760780.076879:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751706724192 time 751706463776 state 0x1 ref 1
00000100:00100000:0.0:1789760780.076939:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751706724192 time 751763621684 state 0x0 ref 1
00000100:00100000:0.0:1789760780.076953:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521047040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760780.077008:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25083904, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:0.0:1789760780.077017:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.077033:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760780.077037:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760780.077045:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.077059:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760780.111948:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973444 is committed
00002000:00010000:2.0:1789760780.112096:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25083904 -> 25088000
00010000:00010000:2.0:1789760780.112113:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.112125:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.112139:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.112146:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.112151:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.112163:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.112187:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.112195:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60da55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25083904->25087999] (req 25083904->25087999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.112295:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521047040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35338us (35674us total) trans 4294973444 rc 0/0
00000100:00100000:2.0:1789760780.112306:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6157
00000100:00100000:2.0:1789760780.113578:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751706724192 time 751763621684 state 0x2 ref 0
00000100:00100000:0.0:1789760780.116619:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760780.116919:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521047168
00000100:00100000:2.0:1789760780.116929:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521047168
00000100:00100000:2.0:1789760780.117094:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751706724192 time 751763621684 state 0x0 ref 1
00000100:00100000:2.0:1789760780.117109:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751763882100 time 751763621684 state 0x1 ref 1
00000100:00100000:2.0:1789760780.117182:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751763882100 time 751803865405 state 0x0 ref 1
00000100:00100000:2.0:1789760780.117192:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521047168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760780.117232:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25088000, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:2.0:1789760780.117239:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.117251:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:2.0:1789760780.117255:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760780.117259:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.117269:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760780.159157:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973445 is committed
00002000:00010000:1.0:1789760780.159236:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25088000 -> 25092096
00010000:00010000:1.0:1789760780.159252:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.159265:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.159274:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.159281:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760780.159286:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.159295:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.159332:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.159340:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60da5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25088000->25092095] (req 25088000->25092095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760780.159437:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521047168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42238us (42820us total) trans 4294973445 rc 0/0
00000100:00100000:1.0:1789760780.159448:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6158
00000100:00100000:1.0:1789760780.159466:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751763882100 time 751803865405 state 0x2 ref 0
00000100:00100000:1.0:1789760780.163249:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760780.163639:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521047296
00000100:00100000:2.0:1789760780.163650:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521047296
00000100:00100000:2.0:1789760780.163704:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751763882100 time 751803865405 state 0x0 ref 1
00000100:00100000:2.0:1789760780.163718:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751804125821 time 751803865405 state 0x1 ref 1
00000100:00100000:2.0:1789760780.163758:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751804125821 time 751850440628 state 0x0 ref 1
00000100:00100000:2.0:1789760780.163771:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521047296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760780.163821:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25092096, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:2.0:1789760780.163830:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.163847:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:2.0:1789760780.163852:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760780.163859:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.163872:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760780.207954:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973446 is committed
00002000:00010000:2.0:1789760780.208058:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25092096 -> 25096192
00010000:00010000:2.0:1789760780.208075:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.208098:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.208108:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.208116:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.208121:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.208131:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.208151:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.208159:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60da63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25092096->25096191] (req 25092096->25096191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.208250:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521047296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44476us (45005us total) trans 4294973446 rc 0/0
00000100:00100000:2.0:1789760780.208263:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6159
00000100:00100000:2.0:1789760780.208273:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751804125821 time 751850440628 state 0x2 ref 0
00000100:00100000:2.0:1789760780.211818:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760780.211894:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521047424
00000100:00100000:1.0:1789760780.211903:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521047424
00000100:00100000:1.0:1789760780.211957:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751804125821 time 751850440628 state 0x0 ref 1
00000100:00100000:1.0:1789760780.211972:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751850701044 time 751850440628 state 0x1 ref 1
00000100:00100000:1.0:1789760780.212015:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751850701044 time 751898697437 state 0x0 ref 1
00000100:00100000:1.0:1789760780.212028:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521047424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760780.212075:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25096192, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760780.212094:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.212109:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760780.212114:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760780.212121:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.212134:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760780.253690:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25096192 -> 25100288
00010000:00010000:1.0:1789760780.253710:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.253728:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.253736:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.253742:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760780.253747:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.253754:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.253772:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.253779:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25096192->25100287] (req 25096192->25100287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760780.253904:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521047424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41874us (42090us total) trans 4294973447 rc 0/0
00000100:00100000:1.0:1789760780.253915:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6160
00000100:00100000:1.0:1789760780.253925:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751850701044 time 751898697437 state 0x2 ref 0
00000001:00080000:1.0:1789760780.253962:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973447 is committed
00000100:00100000:1.0:1789760780.257802:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760780.257894:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521047552
00000100:00100000:0.0:1789760780.257903:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521047552
00000100:00100000:0.0:1789760780.257954:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751850701044 time 751898697437 state 0x0 ref 1
00000100:00100000:0.0:1789760780.257970:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751898957853 time 751898697437 state 0x1 ref 1
00000100:00100000:0.0:1789760780.258066:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751898957853 time 751944747341 state 0x0 ref 1
00000100:00100000:0.0:1789760780.258201:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521047552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760780.258250:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25100288, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:0.0:1789760780.258259:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.258274:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:0.0:1789760780.258278:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760780.258283:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.258297:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760780.285472:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25100288 -> 25104384
00010000:00010000:0.0:1789760780.285493:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.285511:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.285521:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.285528:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760780.285532:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.285541:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.285561:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.285570:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25100288->25104383] (req 25100288->25104383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760780.285660:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521047552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27577us (27861us total) trans 4294973448 rc 0/0
00000001:00080000:1.0:1789760780.285822:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973448 is committed
00000100:00100000:0.0:1789760780.286975:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6161
00000100:00100000:0.0:1789760780.287042:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751898957853 time 751944747341 state 0x2 ref 0
00000100:00100000:2.0:1789760780.293402:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760780.293991:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521047680
00000100:00100000:1.0:1789760780.294002:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521047680
00000100:00100000:1.0:1789760780.294060:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751898957853 time 751944747341 state 0x0 ref 1
00000100:00100000:1.0:1789760780.294077:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751945007757 time 751944747341 state 0x1 ref 1
00000100:00100000:1.0:1789760780.294110:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751945007757 time 751980792162 state 0x0 ref 1
00000100:00100000:1.0:1789760780.294124:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521047680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760780.294176:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25104384, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760780.294185:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.294201:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=751s v=(0 0)
00010000:00010000:1.0:1789760780.294205:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760780.294212:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.294227:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760780.339572:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973449 is committed
00002000:00010000:2.0:1789760780.339592:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25104384 -> 25108480
00010000:00010000:2.0:1789760780.339607:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.339621:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.339631:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.339638:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.339643:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.339653:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.339672:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.339680:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60da78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25104384->25108479] (req 25104384->25108479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.339765:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521047680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45640us (46369us total) trans 4294973449 rc 0/0
00000100:00100000:2.0:1789760780.339777:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6162
00000100:00100000:2.0:1789760780.339791:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751945007757 time 751980792162 state 0x2 ref 0
00000100:00100000:2.0:1789760780.344143:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760780.344268:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521047808
00000100:00100000:1.0:1789760780.344277:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521047808
00000100:00100000:1.0:1789760780.344444:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751945007757 time 751980792162 state 0x0 ref 1
00000100:00100000:1.0:1789760780.344471:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751981052578 time 751980792162 state 0x1 ref 1
00000100:00100000:1.0:1789760780.344496:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751981052578 time 752031178753 state 0x0 ref 1
00000100:00100000:1.0:1789760780.344509:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521047808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760780.344554:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25108480, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760780.344563:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.344579:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:1.0:1789760780.344583:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760780.344589:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.344603:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760780.365740:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25108480 -> 25112576
00010000:00010000:2.0:1789760780.365760:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.365774:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.365784:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.365791:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.365797:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.365805:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.365825:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.365839:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60da7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25108480->25112575] (req 25108480->25112575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.365933:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521047808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 21421us (21793us total) trans 4294973450 rc 0/0
00000100:00100000:2.0:1789760780.365945:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6163
00000100:00100000:2.0:1789760780.365955:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751981052578 time 752031178753 state 0x2 ref 0
00000001:00080000:0.0:1789760780.366155:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973450 is committed
00000100:00100000:1.0:1789760780.369659:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760780.369727:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521047936
00000100:00100000:2.0:1789760780.369737:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521047936
00000100:00100000:2.0:1789760780.369790:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 751981052578 time 752031178753 state 0x0 ref 1
00000100:00100000:2.0:1789760780.369806:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752031439169 time 752031178753 state 0x1 ref 1
00000100:00100000:2.0:1789760780.369905:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752031439169 time 752056586753 state 0x0 ref 1
00000100:00100000:2.0:1789760780.369919:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521047936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760780.369966:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25112576, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:2.0:1789760780.369975:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.369993:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:2.0:1789760780.369998:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760780.370005:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.370026:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760780.402407:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973451 is committed
00002000:00010000:3.0:1789760780.403144:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25112576 -> 25116672
00010000:00010000:3.0:1789760780.403161:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.403187:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.403195:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.403201:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760780.403205:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.403217:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.403235:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.403243:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25112576->25116671] (req 25112576->25116671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760780.403366:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521047936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33446us (33713us total) trans 4294973451 rc 0/0
00000100:00100000:3.0:1789760780.403376:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6164
00000100:00100000:3.0:1789760780.403385:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752031439169 time 752056586753 state 0x2 ref 0
00000100:00100000:1.0:1789760780.410495:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760780.411374:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521048064
00000100:00100000:0.0:1789760780.411385:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521048064
00000100:00100000:0.0:1789760780.411439:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752031439169 time 752056586753 state 0x0 ref 1
00000100:00100000:0.0:1789760780.411475:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752056847169 time 752056586753 state 0x1 ref 1
00000100:00100000:0.0:1789760780.411506:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752056847169 time 752098188538 state 0x0 ref 1
00000100:00100000:0.0:1789760780.411518:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521048064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760780.411566:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25116672, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:0.0:1789760780.411575:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.411603:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:0.0:1789760780.411609:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760780.411621:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760780.411637:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760780.438283:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973452 is committed
00002000:00010000:1.0:1789760780.438516:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25116672 -> 25120768
00010000:00010000:1.0:1789760780.438531:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.438544:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.438553:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.438566:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760780.438571:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.438579:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.438596:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.438604:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60da8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25116672->25120767] (req 25116672->25120767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760780.438736:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521048064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27215us (28246us total) trans 4294973452 rc 0/0
00000100:00100000:1.0:1789760780.438747:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6165
00000100:00100000:1.0:1789760780.438756:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752056847169 time 752098188538 state 0x2 ref 0
00000100:00100000:2.0:1789760780.454518:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760780.454785:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521048192
00000100:00100000:1.0:1789760780.454796:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521048192
00000100:00100000:1.0:1789760780.454848:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752056847169 time 752098188538 state 0x0 ref 1
00000100:00100000:1.0:1789760780.454864:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752098448954 time 752098188538 state 0x1 ref 1
00000100:00100000:1.0:1789760780.454898:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752098448954 time 752141580266 state 0x0 ref 1
00000100:00100000:1.0:1789760780.454913:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521048192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760780.454962:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25120768, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760780.454971:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.454987:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:1.0:1789760780.454991:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760780.454997:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.455011:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760780.502820:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973453 is committed
00002000:00010000:1.0:1789760780.502891:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25120768 -> 25124864
00010000:00010000:1.0:1789760780.502905:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.502917:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.502927:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.502934:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760780.502939:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.502948:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.502966:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.502973:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60da94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25120768->25124863] (req 25120768->25124863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760780.503218:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521048192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48301us (48703us total) trans 4294973453 rc 0/0
00000100:00100000:1.0:1789760780.503229:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6166
00000100:00100000:1.0:1789760780.503238:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752098448954 time 752141580266 state 0x2 ref 0
00000100:00100000:0.0:1789760780.506516:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760780.506736:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521048320
00000100:00100000:2.0:1789760780.506746:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521048320
00000100:00100000:2.0:1789760780.506803:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752098448954 time 752141580266 state 0x0 ref 1
00000100:00100000:2.0:1789760780.506818:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752141840682 time 752141580266 state 0x1 ref 1
00000100:00100000:2.0:1789760780.506849:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752141840682 time 752193531060 state 0x0 ref 1
00000100:00100000:2.0:1789760780.506861:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521048320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760780.506909:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25124864, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:2.0:1789760780.506919:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.506934:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:2.0:1789760780.506939:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760780.506945:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.506958:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760780.543922:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973454 is committed
00002000:00010000:2.0:1789760780.544021:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25124864 -> 25128960
00010000:00010000:2.0:1789760780.544036:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.544049:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.544058:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.544066:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.544071:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.544081:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.544099:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.544108:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60da9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25124864->25128959] (req 25124864->25128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.544193:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521048320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37330us (37682us total) trans 4294973454 rc 0/0
00000100:00100000:2.0:1789760780.544207:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6167
00000100:00100000:2.0:1789760780.544217:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752141840682 time 752193531060 state 0x2 ref 0
00000100:00100000:2.0:1789760780.550523:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760780.550623:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521048448
00000100:00100000:3.0:1789760780.550632:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521048448
00000100:00100000:3.0:1789760780.550684:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752141840682 time 752193531060 state 0x0 ref 1
00000100:00100000:3.0:1789760780.550699:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752193791476 time 752193531060 state 0x1 ref 1
00000100:00100000:3.0:1789760780.550775:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752193791476 time 752237456839 state 0x0 ref 1
00000100:00100000:3.0:1789760780.550789:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521048448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760780.550840:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25128960, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:3.0:1789760780.550851:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.550867:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:3.0:1789760780.550871:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760780.550878:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.550891:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760780.582423:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973455 is committed
00002000:00010000:3.0:1789760780.582560:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25128960 -> 25133056
00010000:00010000:3.0:1789760780.582577:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.582590:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.582599:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.582607:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760780.582612:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.582620:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.582638:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.582646:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60daa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25128960->25133055] (req 25128960->25133055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760780.582853:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521048448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32062us (32334us total) trans 4294973455 rc 0/0
00000100:00100000:3.0:1789760780.582864:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6168
00000100:00100000:3.0:1789760780.582874:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752193791476 time 752237456839 state 0x2 ref 0
00000100:00100000:2.0:1789760780.597154:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760780.597484:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521048576
00000100:00100000:1.0:1789760780.597495:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521048576
00000100:00100000:1.0:1789760780.597550:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752193791476 time 752237456839 state 0x0 ref 1
00000100:00100000:1.0:1789760780.597566:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752237717255 time 752237456839 state 0x1 ref 1
00000100:00100000:1.0:1789760780.597597:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752237717255 time 752284279176 state 0x0 ref 1
00000100:00100000:1.0:1789760780.597609:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521048576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760780.597662:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25133056, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760780.597672:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.597701:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:1.0:1789760780.597705:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760780.597711:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.597724:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760780.633528:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973456 is committed
00002000:00010000:2.0:1789760780.633629:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25133056 -> 25137152
00010000:00010000:2.0:1789760780.633643:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.633653:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.633661:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.633676:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.633680:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.633688:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.633706:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.633719:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60daa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25133056->25137151] (req 25133056->25137151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.633810:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b72fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521048576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36198us (36660us total) trans 4294973456 rc 0/0
00000100:00100000:2.0:1789760780.633821:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6169
00000100:00100000:2.0:1789760780.633830:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752237717255 time 752284279176 state 0x2 ref 0
00000100:00100000:0.0:1789760780.638852:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760780.639123:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521048704
00000100:00100000:1.0:1789760780.639133:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521048704
00000100:00100000:1.0:1789760780.639184:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752237717255 time 752284279176 state 0x0 ref 1
00000100:00100000:1.0:1789760780.639199:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752284539592 time 752284279176 state 0x1 ref 1
00000100:00100000:1.0:1789760780.639310:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752284539592 time 752325991490 state 0x0 ref 1
00000100:00100000:1.0:1789760780.639389:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521048704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760780.639435:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25137152, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760780.639444:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.639470:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:1.0:1789760780.639474:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760780.639481:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.639495:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760780.671572:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973457 is committed
00002000:00010000:3.0:1789760780.671671:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25137152 -> 25141248
00010000:00010000:3.0:1789760780.671686:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.671700:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.671709:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.671717:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760780.671722:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.671737:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.671758:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.671766:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dab0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25137152->25141247] (req 25137152->25141247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760780.671862:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521048704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32479us (33015us total) trans 4294973457 rc 0/0
00000100:00100000:3.0:1789760780.671873:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6170
00000100:00100000:3.0:1789760780.671882:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752284539592 time 752325991490 state 0x2 ref 0
00000100:00100000:1.0:1789760780.680106:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760780.681015:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521048832
00000100:00100000:2.0:1789760780.681026:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521048832
00000100:00100000:2.0:1789760780.681081:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752284539592 time 752325991490 state 0x0 ref 1
00000100:00100000:2.0:1789760780.681096:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752326251906 time 752325991490 state 0x1 ref 1
00000100:00100000:2.0:1789760780.681177:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752326251906 time 752367859361 state 0x0 ref 1
00000100:00100000:2.0:1789760780.681191:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521048832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760780.681238:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25141248, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:2.0:1789760780.681246:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.681261:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:2.0:1789760780.681265:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760780.681271:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.681284:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760780.721238:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973458 is committed
00002000:00010000:3.0:1789760780.721359:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25141248 -> 25145344
00010000:00010000:3.0:1789760780.721375:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.721387:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.721396:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.721403:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760780.721409:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.721419:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.721438:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.721457:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dab7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25141248->25145343] (req 25141248->25145343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760780.721549:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521048832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40356us (41449us total) trans 4294973458 rc 0/0
00000100:00100000:3.0:1789760780.721559:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6171
00000100:00100000:3.0:1789760780.721568:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752326251906 time 752367859361 state 0x2 ref 0
00000100:00100000:2.0:1789760780.725172:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760780.725389:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521048960
00000100:00100000:3.0:1789760780.725399:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521048960
00000100:00100000:3.0:1789760780.725462:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752326251906 time 752367859361 state 0x0 ref 1
00000100:00100000:3.0:1789760780.725477:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752368119777 time 752367859361 state 0x1 ref 1
00000100:00100000:3.0:1789760780.725554:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752368119777 time 752412236539 state 0x0 ref 1
00000100:00100000:3.0:1789760780.725566:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521048960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760780.725610:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25145344, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:3.0:1789760780.725619:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.725634:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:3.0:1789760780.725639:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760780.725645:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.725659:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760780.757043:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25145344 -> 25149440
00010000:00010000:2.0:1789760780.757062:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.757075:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.757095:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.757109:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760780.757114:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.757123:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.757144:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.757152:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dabe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25145344->25149439] (req 25145344->25149439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760780.757260:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521048960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31689us (32095us total) trans 4294973459 rc 0/0
00000100:00100000:2.0:1789760780.757270:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6172
00000100:00100000:2.0:1789760780.757280:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752368119777 time 752412236539 state 0x2 ref 0
00000001:00080000:1.0:1789760780.757627:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973459 is committed
00000100:00100000:1.0:1789760780.762617:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760780.762779:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521049088
00000100:00100000:2.0:1789760780.762787:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521049088
00000100:00100000:2.0:1789760780.762829:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752368119777 time 752412236539 state 0x0 ref 1
00000100:00100000:2.0:1789760780.762840:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752412496955 time 752412236539 state 0x1 ref 1
00000100:00100000:2.0:1789760780.762863:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752412496955 time 752449546738 state 0x0 ref 1
00000100:00100000:2.0:1789760780.762871:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521049088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760780.762911:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25149440, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:2.0:1789760780.762921:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.762936:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:2.0:1789760780.762940:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760780.762946:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.762961:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760780.801292:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973460 is committed
00002000:00010000:3.0:1789760780.801639:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25149440 -> 25153536
00010000:00010000:3.0:1789760780.801664:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.801681:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.801692:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.801700:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760780.801706:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.801716:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.801751:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.801764:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dac5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25149440->25153535] (req 25149440->25153535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760780.801901:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521049088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39021us (39285us total) trans 4294973460 rc 0/0
00000100:00100000:3.0:1789760780.801913:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6173
00000100:00100000:3.0:1789760780.801925:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752412496955 time 752449546738 state 0x2 ref 0
00000100:00100000:3.0:1789760780.808026:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760780.808923:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521049216
00000100:00100000:1.0:1789760780.808935:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521049216
00000100:00100000:1.0:1789760780.808987:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752412496955 time 752449546738 state 0x0 ref 1
00000100:00100000:1.0:1789760780.809001:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752449807154 time 752449546738 state 0x1 ref 1
00000100:00100000:1.0:1789760780.809031:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752449807154 time 752495713516 state 0x0 ref 1
00000100:00100000:1.0:1789760780.809044:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521049216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760780.809086:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25153536, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:1.0:1789760780.809096:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.809113:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:1.0:1789760780.809117:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760780.809124:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.809144:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760780.857485:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760780.858193:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973461 is committed
00002000:00010000:3.0:1789760780.858404:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25153536 -> 25157632
00010000:00010000:3.0:1789760780.858424:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.858441:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.858466:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.858475:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760780.858480:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.858497:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.858521:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.858530:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dacc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25153536->25157631] (req 25153536->25157631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760780.858653:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd85007b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521049216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49603us (50631us total) trans 4294973461 rc 0/0
00000100:00100000:3.0:1789760780.858666:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6174
00000100:00100000:3.0:1789760780.858678:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752449807154 time 752495713516 state 0x2 ref 0
00000100:00100000:0.0:1789760780.866644:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760780.866774:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521049344
00000100:00100000:3.0:1789760780.866794:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521049344
00000100:00100000:3.0:1789760780.866884:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752449807154 time 752495713516 state 0x0 ref 1
00000100:00100000:3.0:1789760780.866905:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752495973932 time 752495713516 state 0x1 ref 1
00000100:00100000:3.0:1789760780.866944:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752495973932 time 752553626868 state 0x0 ref 1
00000100:00100000:3.0:1789760780.866957:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521049344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760780.867268:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25157632, mtime: 0x6aad950d, atime: 0x0, ctime: 0x6aad950d, blocks: 0xc007
00010000:00010000:3.0:1789760780.867282:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.867305:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:3.0:1789760780.867311:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760780.867353:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.867436:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760780.901653:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973462 is committed
00002000:00010000:3.0:1789760780.901757:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25157632 -> 25161728
00002000:00010000:3.0:1789760780.901762:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760781 -> 1789760782
00002000:00010000:3.0:1789760780.901765:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760781 -> 1789760782
00010000:00010000:3.0:1789760780.901784:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.901800:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.901811:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.901818:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760780.901822:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.901829:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.901851:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.901859:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dad3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25157632->25161727] (req 25157632->25161727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760780.901974:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521049344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35011us (35340us total) trans 4294973462 rc 0/0
00000100:00100000:3.0:1789760780.901987:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6175
00000100:00100000:3.0:1789760780.902000:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752495973932 time 752553626868 state 0x2 ref 0
00000100:00100000:2.0:1789760780.910792:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760780.910898:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521049472
00000100:00100000:3.0:1789760780.910911:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521049472
00000100:00100000:3.0:1789760780.910988:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752495973932 time 752553626868 state 0x0 ref 1
00000100:00100000:3.0:1789760780.911019:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752553887284 time 752553626868 state 0x1 ref 1
00000100:00100000:3.0:1789760780.911056:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752553887284 time 752597738133 state 0x0 ref 1
00000100:00100000:3.0:1789760780.911070:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521049472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760780.911147:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25161728, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc007
00010000:00010000:3.0:1789760780.911159:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.911179:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:3.0:1789760780.911186:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760780.911193:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.911209:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760780.921456:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548770944:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1789760780.921563:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760780.921638:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548770944
00000100:00100000:2.0:1789760780.921649:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548770944
00000100:00100000:2.0:1789760780.921712:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457
00000100:00100000:2.0:1789760780.922227:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548770944:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:2.0:1789760780.922279:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:2.0:1789760780.922404:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548770944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 184us (840us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760780.922413:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457
00000100:00100000:1.0:1789760780.924684:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548770944:0@lo:41:osp-pre-0-1.0
00000001:00080000:1.0:1789760780.983358:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973463 is committed
00002000:00010000:3.0:1789760780.983543:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25161728 -> 25165824
00010000:00010000:3.0:1789760780.983564:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.983579:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.983589:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.983596:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760780.983602:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.983612:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.983634:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760780.983643:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dada lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25161728->25165823] (req 25161728->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760780.983777:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521049472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 72701us (73054us total) trans 4294973463 rc 0/0
00000100:00100000:3.0:1789760780.983790:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6176
00000100:00100000:3.0:1789760780.983803:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752553887284 time 752597738133 state 0x2 ref 0
00000100:00100000:1.0:1789760780.987103:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760780.988616:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521049600
00000100:00100000:2.0:1789760780.988632:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521049600
00000100:00100000:2.0:1789760780.988715:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752553887284 time 752597738133 state 0x0 ref 1
00000100:00100000:2.0:1789760780.988800:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752597998549 time 752597738133 state 0x1 ref 1
00000100:00100000:2.0:1789760780.988836:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752597998549 time 752675518577 state 0x0 ref 1
00000100:00100000:2.0:1789760780.988853:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521049600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760780.988921:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25165824, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc007
00010000:00010000:2.0:1789760780.988933:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.988954:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:2.0:1789760780.988959:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760780.988967:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760780.988984:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760781.049621:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25165824 -> 25169920
00002000:00010000:2.0:1789760781.049635:0:14638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 49159 -> 51207
00010000:00010000:2.0:1789760781.049653:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.049669:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.049680:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.049688:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.049695:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.049705:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.049731:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.049746:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dae1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25165824->25169919] (req 25165824->25169919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.049867:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521049600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61012us (62782us total) trans 4294973464 rc 0/0
00000100:00100000:2.0:1789760781.049879:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6177
00000100:00100000:2.0:1789760781.049892:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752597998549 time 752675518577 state 0x2 ref 0
00000001:00080000:0.0:1789760781.051208:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973464 is committed
00000100:00100000:0.0:1789760781.054429:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.054612:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521049728
00000100:00100000:3.0:1789760781.054625:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521049728
00000100:00100000:3.0:1789760781.054700:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752597998549 time 752675518577 state 0x0 ref 1
00000100:00100000:3.0:1789760781.054718:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752675778993 time 752675518577 state 0x1 ref 1
00000100:00100000:3.0:1789760781.054753:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752675778993 time 752741435738 state 0x0 ref 1
00000100:00100000:3.0:1789760781.054768:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521049728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.054832:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25169920, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.054844:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.054865:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:3.0:1789760781.054871:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.054879:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.054896:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760781.147156:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973465 is committed
00002000:00010000:2.0:1789760781.147410:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25169920 -> 25174016
00010000:00010000:2.0:1789760781.147431:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.148469:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.148550:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.148561:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.148566:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.148578:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.148610:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.148619:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dae8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25169920->25174015] (req 25169920->25174015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.148809:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521049728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 94036us (94391us total) trans 4294973465 rc 0/0
00000100:00100000:2.0:1789760781.148824:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6178
00000100:00100000:2.0:1789760781.148837:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752675778993 time 752741435738 state 0x2 ref 0
00000100:00100000:3.0:1789760781.153567:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760781.155159:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521049856
00000100:00100000:2.0:1789760781.155181:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521049856
00000100:00100000:2.0:1789760781.155265:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752675778993 time 752741435738 state 0x0 ref 1
00000100:00100000:2.0:1789760781.155285:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752741696154 time 752741435738 state 0x1 ref 1
00000100:00100000:2.0:1789760781.155342:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752741696154 time 752842023653 state 0x0 ref 1
00000100:00100000:2.0:1789760781.155357:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521049856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760781.155423:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25174016, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:2.0:1789760781.155436:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.155479:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:2.0:1789760781.155487:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760781.155496:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.155513:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760781.198398:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25174016 -> 25178112
00010000:00010000:2.0:1789760781.198427:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.198454:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.198465:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.198473:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.198479:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.198489:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.198512:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.198519:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60daef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25174016->25178111] (req 25174016->25178111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.198637:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521049856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43276us (45079us total) trans 4294973466 rc 0/0
00000100:00100000:2.0:1789760781.198649:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6179
00000100:00100000:2.0:1789760781.198661:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752741696154 time 752842023653 state 0x2 ref 0
00000001:00080000:3.0:1789760781.198748:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973466 is committed
00000100:00100000:2.0:1789760781.201898:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.202198:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521049984
00000100:00100000:3.0:1789760781.202210:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521049984
00000100:00100000:3.0:1789760781.202509:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752741696154 time 752842023653 state 0x0 ref 1
00000100:00100000:3.0:1789760781.202528:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752842284069 time 752842023653 state 0x1 ref 1
00000100:00100000:3.0:1789760781.202590:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752842284069 time 752889272447 state 0x0 ref 1
00000100:00100000:3.0:1789760781.202605:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521049984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.202668:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25178112, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.202678:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.202698:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:3.0:1789760781.202703:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.202710:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.202727:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760781.238071:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25178112 -> 25182208
00010000:00010000:3.0:1789760781.238111:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.238127:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.238137:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.238145:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.238151:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.238162:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.238188:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.238197:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60daf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25178112->25182207] (req 25178112->25182207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.238373:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521049984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35763us (36482us total) trans 4294973467 rc 0/0
00000100:00100000:3.0:1789760781.238384:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6180
00000100:00100000:3.0:1789760781.238397:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752842284069 time 752889272447 state 0x2 ref 0
00000001:00080000:3.0:1789760781.238456:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973467 is committed
00000100:00100000:0.0:1789760781.243115:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.243253:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521050112
00000100:00100000:3.0:1789760781.243268:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521050112
00000100:00100000:3.0:1789760781.243397:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752842284069 time 752889272447 state 0x0 ref 1
00000100:00100000:3.0:1789760781.243418:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752889532863 time 752889272447 state 0x1 ref 1
00000100:00100000:3.0:1789760781.243466:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752889532863 time 752930146562 state 0x0 ref 1
00000100:00100000:3.0:1789760781.243481:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521050112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.243555:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25182208, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.243566:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.243587:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:3.0:1789760781.243592:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.243600:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.243616:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760781.283765:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973468 is committed
00002000:00010000:2.0:1789760781.283901:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25182208 -> 25186304
00010000:00010000:2.0:1789760781.283921:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.283937:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.283947:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.283955:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.283961:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.283982:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.284007:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.284022:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dafd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25182208->25186303] (req 25182208->25186303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.284249:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521050112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40763us (41142us total) trans 4294973468 rc 0/0
00000100:00100000:2.0:1789760781.284262:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6181
00000100:00100000:2.0:1789760781.284274:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752889532863 time 752930146562 state 0x2 ref 0
00000100:00100000:2.0:1789760781.287048:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.287201:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521050240
00000100:00100000:3.0:1789760781.287214:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521050240
00000100:00100000:3.0:1789760781.287289:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752889532863 time 752930146562 state 0x0 ref 1
00000100:00100000:3.0:1789760781.287308:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752930406978 time 752930146562 state 0x1 ref 1
00000100:00100000:3.0:1789760781.287381:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752930406978 time 752974063488 state 0x0 ref 1
00000100:00100000:3.0:1789760781.287395:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521050240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.287474:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25186304, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.287493:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.287514:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=752s v=(0 0)
00010000:00010000:3.0:1789760781.287519:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.287528:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.287543:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760781.318910:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973469 is committed
00002000:00010000:3.0:1789760781.319019:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25186304 -> 25190400
00010000:00010000:3.0:1789760781.319049:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.319067:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.319081:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.319090:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.319096:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.319106:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.319136:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.319145:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25186304->25190399] (req 25186304->25190399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.319260:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521050240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31859us (32218us total) trans 4294973469 rc 0/0
00000100:00100000:3.0:1789760781.319273:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6182
00000100:00100000:3.0:1789760781.319285:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752930406978 time 752974063488 state 0x2 ref 0
00000100:00100000:1.0:1789760781.323902:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760781.324025:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521050368
00000100:00100000:2.0:1789760781.324038:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521050368
00000100:00100000:2.0:1789760781.324120:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752930406978 time 752974063488 state 0x0 ref 1
00000100:00100000:2.0:1789760781.324140:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752974323904 time 752974063488 state 0x1 ref 1
00000100:00100000:2.0:1789760781.324187:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752974323904 time 753010869519 state 0x0 ref 1
00000100:00100000:2.0:1789760781.324202:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521050368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760781.324271:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25190400, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:2.0:1789760781.324283:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.324305:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:2.0:1789760781.324463:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760781.324473:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.324573:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760781.366737:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973470 is committed
00002000:00010000:2.0:1789760781.366856:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25190400 -> 25194496
00010000:00010000:2.0:1789760781.366882:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.366898:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.366912:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.366923:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.366932:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.366946:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.367072:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.367085:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60db0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25190400->25194495] (req 25190400->25194495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.367378:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521050368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43165us (43482us total) trans 4294973470 rc 0/0
00000100:00100000:2.0:1789760781.367391:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6183
00000100:00100000:2.0:1789760781.367407:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752974323904 time 753010869519 state 0x2 ref 0
00000100:00100000:1.0:1789760781.371864:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.371916:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521050496
00000100:00100000:3.0:1789760781.371929:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521050496
00000100:00100000:3.0:1789760781.372185:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 752974323904 time 753010869519 state 0x0 ref 1
00000100:00100000:3.0:1789760781.372208:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753011129935 time 753010869519 state 0x1 ref 1
00000100:00100000:3.0:1789760781.372246:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753011129935 time 753058928341 state 0x0 ref 1
00000100:00100000:3.0:1789760781.372262:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521050496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.372365:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25194496, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.372377:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.372396:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760781.372401:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.372408:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.372424:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760781.422033:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25194496 -> 25198592
00010000:00010000:3.0:1789760781.422056:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.422070:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.422079:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.422088:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.422104:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.422115:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.422134:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.422142:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25194496->25198591] (req 25194496->25198591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.422244:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521050496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49980us (50391us total) trans 4294973471 rc 0/0
00000100:00100000:3.0:1789760781.422255:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6184
00000100:00100000:3.0:1789760781.422265:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753011129935 time 753058928341 state 0x2 ref 0
00000001:00080000:2.0:1789760781.423326:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973471 is committed
00000100:00100000:1.0:1789760781.426830:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.427715:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521050624
00000100:00100000:3.0:1789760781.427729:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521050624
00000100:00100000:0.0:1789760781.427980:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753011129935 time 753058928341 state 0x0 ref 1
00000100:00100000:0.0:1789760781.427996:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753059188757 time 753058928341 state 0x1 ref 1
00000100:00100000:0.0:1789760781.428026:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753059188757 time 753114709399 state 0x0 ref 1
00000100:00100000:0.0:1789760781.428039:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521050624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760781.428087:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25198592, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:0.0:1789760781.428096:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760781.428111:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:0.0:1789760781.428116:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760781.428122:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760781.428136:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760781.467015:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973472 is committed
00002000:00010000:3.0:1789760781.467299:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25198592 -> 25202688
00010000:00010000:3.0:1789760781.467364:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.467379:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.467389:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.467397:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.467403:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.467414:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.467451:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.467460:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60db19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25198592->25202687] (req 25198592->25202687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.467584:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521050624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39541us (40762us total) trans 4294973472 rc 0/0
00000100:00100000:3.0:1789760781.467597:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6185
00000100:00100000:3.0:1789760781.467609:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753059188757 time 753114709399 state 0x2 ref 0
00000100:00100000:1.0:1789760781.473232:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760781.473749:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521050752
00000100:00100000:2.0:1789760781.473766:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521050752
00000100:00100000:2.0:1789760781.473853:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753059188757 time 753114709399 state 0x0 ref 1
00000100:00100000:2.0:1789760781.473873:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753114969815 time 753114709399 state 0x1 ref 1
00000100:00100000:2.0:1789760781.473952:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753114969815 time 753160633769 state 0x0 ref 1
00000100:00100000:2.0:1789760781.473968:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521050752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760781.474033:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25202688, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:2.0:1789760781.474045:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.474065:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:2.0:1789760781.474080:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760781.474089:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.474105:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760781.524468:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973473 is committed
00002000:00010000:2.0:1789760781.524576:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25202688 -> 25206784
00010000:00010000:2.0:1789760781.524597:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.524613:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.524623:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.524631:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.524636:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.524647:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.524671:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.524680:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25202688->25206783] (req 25202688->25206783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.524845:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521050752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50873us (51616us total) trans 4294973473 rc 0/0
00000100:00100000:2.0:1789760781.524863:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6186
00000100:00100000:2.0:1789760781.524875:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753114969815 time 753160633769 state 0x2 ref 0
00000100:00100000:2.0:1789760781.528284:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.528356:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521050880
00000100:00100000:3.0:1789760781.528368:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521050880
00000100:00100000:3.0:1789760781.528449:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753114969815 time 753160633769 state 0x0 ref 1
00000100:00100000:3.0:1789760781.528467:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753160894185 time 753160633769 state 0x1 ref 1
00000100:00100000:3.0:1789760781.528502:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753160894185 time 753215183764 state 0x0 ref 1
00000100:00100000:3.0:1789760781.528516:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521050880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.528579:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25206784, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.528591:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.528611:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760781.528617:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.528625:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.528642:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760781.565153:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973474 is committed
00002000:00010000:2.0:1789760781.565287:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25206784 -> 25210880
00010000:00010000:2.0:1789760781.565309:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.565347:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.565358:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.565368:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.565374:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.565386:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.565412:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.565421:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25206784->25210879] (req 25206784->25210879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.565600:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521050880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37080us (37321us total) trans 4294973474 rc 0/0
00000100:00100000:2.0:1789760781.565614:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6187
00000100:00100000:2.0:1789760781.565626:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753160894185 time 753215183764 state 0x2 ref 0
00000100:00100000:1.0:1789760781.568962:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.569189:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521051008
00000100:00100000:3.0:1789760781.569202:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521051008
00000100:00100000:3.0:1789760781.569272:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753160894185 time 753215183764 state 0x0 ref 1
00000100:00100000:3.0:1789760781.569291:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753215444180 time 753215183764 state 0x1 ref 1
00000100:00100000:3.0:1789760781.569458:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753215444180 time 753256139293 state 0x0 ref 1
00000100:00100000:3.0:1789760781.569475:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.569540:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25210880, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.569550:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.569568:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760781.569573:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.569581:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.569596:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760781.599832:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973475 is committed
00002000:00010000:3.0:1789760781.599909:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25210880 -> 25214976
00010000:00010000:3.0:1789760781.599931:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.599947:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.599958:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.599966:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.599972:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.599983:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.600005:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.600014:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25210880->25214975] (req 25210880->25214975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.600297:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30815us (31337us total) trans 4294973475 rc 0/0
00000100:00100000:3.0:1789760781.600375:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6188
00000100:00100000:3.0:1789760781.600388:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753215444180 time 753256139293 state 0x2 ref 0
00000100:00100000:0.0:1789760781.604748:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.604811:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521051136
00000100:00100000:3.0:1789760781.604824:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521051136
00000100:00100000:3.0:1789760781.604965:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753215444180 time 753256139293 state 0x0 ref 1
00000100:00100000:3.0:1789760781.604987:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753256399709 time 753256139293 state 0x1 ref 1
00000100:00100000:3.0:1789760781.605025:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753256399709 time 753291707377 state 0x0 ref 1
00000100:00100000:3.0:1789760781.605041:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.605114:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25214976, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.605135:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.605156:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760781.605161:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.605169:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.605185:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760781.633877:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25214976 -> 25219072
00010000:00010000:2.0:1789760781.633905:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.633922:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.633932:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.633941:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.633947:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.633956:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.633991:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.634006:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25214976->25219071] (req 25214976->25219071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.634137:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521051136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29093us (29396us total) trans 4294973476 rc 0/0
00000100:00100000:2.0:1789760781.634150:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6189
00000100:00100000:2.0:1789760781.634162:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753256399709 time 753291707377 state 0x2 ref 0
00000001:00080000:0.0:1789760781.634434:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973476 is committed
00000100:00100000:2.0:1789760781.640086:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.640187:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521051264
00000100:00100000:3.0:1789760781.640201:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521051264
00000100:00100000:3.0:1789760781.640285:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753256399709 time 753291707377 state 0x0 ref 1
00000100:00100000:3.0:1789760781.640305:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753291967793 time 753291707377 state 0x1 ref 1
00000100:00100000:3.0:1789760781.640377:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753291967793 time 753327058202 state 0x0 ref 1
00000100:00100000:3.0:1789760781.640391:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.640479:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25219072, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.640491:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.640512:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760781.640519:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.640527:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.640543:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760781.681951:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973477 is committed
00002000:00010000:2.0:1789760781.682158:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25219072 -> 25223168
00010000:00010000:2.0:1789760781.682178:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.682194:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.682203:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.682212:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760781.682217:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.682228:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.682261:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.682269:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25219072->25223167] (req 25219072->25223167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760781.682453:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42047us (42364us total) trans 4294973477 rc 0/0
00000100:00100000:2.0:1789760781.682465:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6190
00000100:00100000:2.0:1789760781.682485:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753291967793 time 753327058202 state 0x2 ref 0
00000100:00100000:1.0:1789760781.687226:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760781.687362:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521051392
00000100:00100000:2.0:1789760781.687374:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521051392
00000100:00100000:2.0:1789760781.687457:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753291967793 time 753327058202 state 0x0 ref 1
00000100:00100000:2.0:1789760781.687487:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753327318618 time 753327058202 state 0x1 ref 1
00000100:00100000:2.0:1789760781.687524:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753327318618 time 753374206257 state 0x0 ref 1
00000100:00100000:2.0:1789760781.687539:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521051392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760781.687610:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25223168, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:2.0:1789760781.687622:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.687643:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:2.0:1789760781.687650:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760781.687658:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.687676:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760781.727249:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973478 is committed
00002000:00010000:3.0:1789760781.727376:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25223168 -> 25227264
00010000:00010000:3.0:1789760781.727392:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.727406:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.727416:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.727424:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.727430:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.727448:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.727467:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.727476:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25223168->25227263] (req 25223168->25227263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.727559:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521051392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40018us (40344us total) trans 4294973478 rc 0/0
00000100:00100000:3.0:1789760781.727569:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6191
00000100:00100000:3.0:1789760781.727580:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753327318618 time 753374206257 state 0x2 ref 0
00000100:00100000:1.0:1789760781.734746:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.735004:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521051520
00000100:00100000:3.0:1789760781.735023:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521051520
00000100:00100000:3.0:1789760781.735106:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753327318618 time 753374206257 state 0x0 ref 1
00000100:00100000:3.0:1789760781.735127:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753374466673 time 753374206257 state 0x1 ref 1
00000100:00100000:3.0:1789760781.735166:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753374466673 time 753421848577 state 0x0 ref 1
00000100:00100000:3.0:1789760781.735492:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.735634:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25227264, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.735651:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.735675:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760781.735683:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.735695:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.735718:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760781.792353:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973479 is committed
00002000:00010000:3.0:1789760781.792501:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25227264 -> 25231360
00010000:00010000:3.0:1789760781.792524:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.792538:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.792548:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.792556:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.792561:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.792573:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.792599:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.792608:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25227264->25231359] (req 25227264->25231359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.792865:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57370us (58127us total) trans 4294973479 rc 0/0
00000100:00100000:3.0:1789760781.792878:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6192
00000100:00100000:3.0:1789760781.792890:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753374466673 time 753421848577 state 0x2 ref 0
00000100:00100000:2.0:1789760781.796095:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.796255:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521051648
00000100:00100000:3.0:1789760781.796269:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521051648
00000100:00100000:3.0:1789760781.796458:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753374466673 time 753421848577 state 0x0 ref 1
00000100:00100000:3.0:1789760781.796550:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753422108993 time 753421848577 state 0x1 ref 1
00000100:00100000:3.0:1789760781.796592:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753422108993 time 753483274001 state 0x0 ref 1
00000100:00100000:3.0:1789760781.796608:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.796688:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25231360, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:3.0:1789760781.796700:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.796835:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760781.796841:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.796849:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.796867:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760781.838635:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973480 is committed
00002000:00010000:3.0:1789760781.838779:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25231360 -> 25235456
00010000:00010000:3.0:1789760781.838798:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.838813:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.838823:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.838832:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.838837:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.838848:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.838874:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.838884:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25231360->25235455] (req 25231360->25235455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.839168:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42556us (43082us total) trans 4294973480 rc 0/0
00000100:00100000:3.0:1789760781.839181:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6193
00000100:00100000:3.0:1789760781.839193:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753422108993 time 753483274001 state 0x2 ref 0
00000100:00100000:1.0:1789760781.842060:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.843153:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521051776
00000100:00100000:3.0:1789760781.843177:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521051776
00000100:00100000:2.0:1789760781.843361:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753422108993 time 753483274001 state 0x0 ref 1
00000100:00100000:2.0:1789760781.843383:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753483534417 time 753483274001 state 0x1 ref 1
00000100:00100000:2.0:1789760781.843415:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753483534417 time 753530096788 state 0x0 ref 1
00000100:00100000:2.0:1789760781.843429:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760781.843508:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25235456, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:2.0:1789760781.843520:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.843540:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:2.0:1789760781.843545:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760781.843552:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.843567:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.882507:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1789760781.905197:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25235456 -> 25239552
00010000:00010000:0.0:1789760781.905229:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760781.905525:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973481 is committed
00010000:00010000:0.0:1789760781.905592:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760781.905602:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760781.905608:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760781.905612:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760781.905620:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760781.905643:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760781.905648:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60db58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25235456->25239551] (req 25235456->25239551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760781.905757:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62324us (63705us total) trans 4294973481 rc 0/0
00000100:00100000:0.0:1789760781.905774:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6194
00000100:00100000:0.0:1789760781.905786:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753483534417 time 753530096788 state 0x2 ref 0
00000100:00100000:1.0:1789760781.908792:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760781.908929:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521051904
00000100:00100000:2.0:1789760781.908942:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521051904
00000100:00100000:2.0:1789760781.909041:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753483534417 time 753530096788 state 0x0 ref 1
00000100:00100000:2.0:1789760781.909063:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753530357204 time 753530096788 state 0x1 ref 1
00000100:00100000:2.0:1789760781.909097:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753530357204 time 753595779269 state 0x0 ref 1
00000100:00100000:2.0:1789760781.909112:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760781.909191:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25239552, mtime: 0x6aad950e, atime: 0x0, ctime: 0x6aad950e, blocks: 0xc807
00010000:00010000:2.0:1789760781.909203:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.909223:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:2.0:1789760781.909229:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760781.909238:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760781.909264:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.946044:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548771072:0@lo:41:osp-pre-1-0.0
00000100:00100000:3.0:1789760781.946237:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760781.946367:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548771072
00000100:00100000:3.0:1789760781.946378:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548771072
00000100:00100000:3.0:1789760781.946459:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458
00000100:00100000:3.0:1789760781.946484:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548771072:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:3.0:1789760781.946540:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:3.0:1789760781.946595:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548771072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (357us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760781.946603:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458
00000100:00100000:3.0:1789760781.946677:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548771072:0@lo:41:osp-pre-1-0.0
00000001:00080000:2.0:1789760781.947789:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973482 is committed
00002000:00010000:3.0:1789760781.948032:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25239552 -> 25243648
00002000:00010000:3.0:1789760781.948038:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760782 -> 1789760783
00002000:00010000:3.0:1789760781.948041:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760782 -> 1789760783
00010000:00010000:3.0:1789760781.948058:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.948072:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.948083:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.948092:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760781.948097:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.948116:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.948138:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.948144:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60db5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25239552->25243647] (req 25239552->25243647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760781.948258:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521051904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39142us (39473us total) trans 4294973482 rc 0/0
00000100:00100000:3.0:1789760781.948270:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6195
00000100:00100000:3.0:1789760781.948283:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753530357204 time 753595779269 state 0x2 ref 0
00000100:00100000:2.0:1789760781.952270:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760781.952497:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521052032
00000100:00100000:3.0:1789760781.952511:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521052032
00000100:00100000:3.0:1789760781.952586:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753530357204 time 753595779269 state 0x0 ref 1
00000100:00100000:3.0:1789760781.952604:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753596039685 time 753595779269 state 0x1 ref 1
00000100:00100000:3.0:1789760781.952641:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753596039685 time 753639323016 state 0x0 ref 1
00000100:00100000:3.0:1789760781.952656:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521052032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760781.952720:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25243648, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:3.0:1789760781.952732:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.952753:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760781.952759:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760781.952767:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760781.952792:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760781.996406:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973483 is committed
00002000:00010000:1.0:1789760781.996643:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25243648 -> 25247744
00010000:00010000:1.0:1789760781.996664:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760781.996680:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760781.996690:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760781.996698:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760781.996704:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760781.996715:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760781.996737:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760781.996745:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60db66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25243648->25247743] (req 25243648->25247743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760781.996931:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521052032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44272us (44682us total) trans 4294973483 rc 0/0
00000100:00100000:1.0:1789760781.996943:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6196
00000100:00100000:1.0:1789760781.996954:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753596039685 time 753639323016 state 0x2 ref 0
00000100:00100000:2.0:1789760782.002481:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760782.002870:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521052160
00000100:00100000:3.0:1789760782.002884:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521052160
00000100:00100000:3.0:1789760782.003025:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753596039685 time 753639323016 state 0x0 ref 1
00000100:00100000:3.0:1789760782.003053:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753639583432 time 753639323016 state 0x1 ref 1
00000100:00100000:3.0:1789760782.003111:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753639583432 time 753689792108 state 0x0 ref 1
00000100:00100000:3.0:1789760782.003127:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521052160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760782.003204:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25247744, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:3.0:1789760782.003216:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.003238:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760782.003243:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760782.003251:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.003268:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:0.0:1789760782.004068:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:2.0:1789760782.045498:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973484 is committed
00002000:00010000:3.0:1789760782.045741:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25247744 -> 25251840
00010000:00010000:3.0:1789760782.045759:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.045770:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.045778:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.045783:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760782.045788:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.045796:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.045814:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.045818:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60db6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25247744->25251839] (req 25247744->25251839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760782.046451:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521052160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43307us (43966us total) trans 4294973484 rc 0/0
00000100:00100000:3.0:1789760782.046466:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6197
00000100:00100000:3.0:1789760782.046689:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753639583432 time 753689792108 state 0x2 ref 0
00000100:00100000:3.0:1789760782.051014:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760782.051070:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521052288
00000100:00100000:2.0:1789760782.051083:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521052288
00000100:00100000:2.0:1789760782.051156:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753639583432 time 753689792108 state 0x0 ref 1
00000100:00100000:2.0:1789760782.051175:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753690052524 time 753689792108 state 0x1 ref 1
00000100:00100000:2.0:1789760782.051208:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753690052524 time 753737890211 state 0x0 ref 1
00000100:00100000:2.0:1789760782.051221:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521052288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760782.051297:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25251840, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:2.0:1789760782.051308:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.051363:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:2.0:1789760782.051368:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760782.051376:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.051392:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760782.083136:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973485 is committed
00002000:00010000:2.0:1789760782.083348:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25251840 -> 25255936
00010000:00010000:2.0:1789760782.083369:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.083385:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.083396:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.083405:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760782.083412:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.083422:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.083585:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.083594:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25251840->25255935] (req 25251840->25255935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760782.083715:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521052288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32490us (32708us total) trans 4294973485 rc 0/0
00000100:00100000:2.0:1789760782.083728:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6198
00000100:00100000:2.0:1789760782.083739:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753690052524 time 753737890211 state 0x2 ref 0
00000100:00100000:2.0:1789760782.087915:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.090625:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521052416
00000100:00100000:1.0:1789760782.090645:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521052416
00000100:00100000:1.0:1789760782.090736:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753690052524 time 753737890211 state 0x0 ref 1
00000100:00100000:1.0:1789760782.090755:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753738150627 time 753737890211 state 0x1 ref 1
00000100:00100000:1.0:1789760782.090789:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753738150627 time 753777470817 state 0x0 ref 1
00000100:00100000:1.0:1789760782.090803:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521052416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760782.090880:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25255936, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:1.0:1789760782.090893:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.090914:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:1.0:1789760782.090920:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760782.090928:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.090945:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760782.143211:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25255936 -> 25260032
00010000:00010000:1.0:1789760782.143239:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.143255:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.143266:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.143274:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760782.143280:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.143290:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.143339:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.143349:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60db7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25255936->25260031] (req 25255936->25260031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.143765:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521052416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52956us (55856us total) trans 4294973486 rc 0/0
00000100:00100000:1.0:1789760782.143780:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6199
00000100:00100000:1.0:1789760782.143791:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753738150627 time 753777470817 state 0x2 ref 0
00000001:00080000:1.0:1789760782.143841:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973486 is committed
00000100:00100000:1.0:1789760782.147456:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760782.147649:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521052544
00000100:00100000:3.0:1789760782.147663:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521052544
00000100:00100000:3.0:1789760782.147736:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753738150627 time 753777470817 state 0x0 ref 1
00000100:00100000:3.0:1789760782.147756:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753777731233 time 753777470817 state 0x1 ref 1
00000100:00100000:3.0:1789760782.147791:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753777731233 time 753834472103 state 0x0 ref 1
00000100:00100000:3.0:1789760782.147807:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521052544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760782.147872:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25260032, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:3.0:1789760782.147883:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.147903:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:3.0:1789760782.147909:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760782.147917:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.147934:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760782.170070:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760782.170115:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760782.170137:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760782.170153:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760782.170173:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760782.170203:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521052928
00000100:00100000:3.0:1789760782.170216:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521052928
00000100:00100000:3.0:1789760782.170290:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521053184
00000100:00100000:3.0:1789760782.170293:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521053184
00000100:00100000:3.0:1789760782.170309:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521052800
00000100:00100000:3.0:1789760782.170331:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521052800
00000100:00100000:3.0:1789760782.170346:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521053056
00000100:00100000:3.0:1789760782.170349:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521053056
00000100:00100000:3.0:1789760782.170368:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 953
00000100:00100000:3.0:1789760782.170380:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521052928:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760782.170481:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521052928:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 103us (365us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760782.170490:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 953
00000100:00100000:3.0:1789760782.170509:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 954
00000100:00100000:3.0:1789760782.170515:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699521053184:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760782.170540:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699521053184:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760782.170547:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 954
00000100:00100000:3.0:1789760782.170560:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 955
00000100:00100000:3.0:1789760782.170567:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2407:x1876699521052800:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760782.170592:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2407:x1876699521052800:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760782.170599:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 955
00000100:00100000:3.0:1789760782.170610:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 956
00000100:00100000:3.0:1789760782.170616:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699521053056:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760782.170637:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2407:x1876699521053056:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (464us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760782.170643:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 956
00000100:00100000:1.0:1789760782.170793:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521052672
00000100:00100000:1.0:1789760782.170798:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521052672
00000100:00100000:1.0:1789760782.170833:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 486
00000100:00100000:1.0:1789760782.170840:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2407:x1876699521052672:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760782.170869:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2407:x1876699521052672:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (813us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760782.170875:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 486
00000100:00080000:1.0:1789760782.171740:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:1.0:1789760782.171749:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000001:00080000:1.0:1789760782.191333:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973487 is committed
00002000:00010000:2.0:1789760782.191643:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25260032 -> 25264128
00010000:00010000:2.0:1789760782.191668:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.191685:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.191694:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.191702:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760782.191707:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.191716:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.191748:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.191756:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60db82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25260032->25264127] (req 25260032->25264127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760782.191885:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521052544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44076us (44449us total) trans 4294973487 rc 0/0
00000100:00100000:2.0:1789760782.191907:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6200
00000100:00100000:2.0:1789760782.191924:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753777731233 time 753834472103 state 0x2 ref 0
00000100:00100000:3.0:1789760782.200474:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760782.202504:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521053312
00000100:00100000:2.0:1789760782.202519:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521053312
00000100:00100000:2.0:1789760782.202600:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753777731233 time 753834472103 state 0x0 ref 1
00000100:00100000:2.0:1789760782.202618:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753834732519 time 753834472103 state 0x1 ref 1
00000100:00100000:2.0:1789760782.202648:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753834732519 time 753889331292 state 0x0 ref 1
00000100:00100000:2.0:1789760782.202663:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521053312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760782.204455:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25264128, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:2.0:1789760782.204476:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.204498:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:2.0:1789760782.204504:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760782.204512:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.204530:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760782.247637:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973488 is committed
00002000:00010000:1.0:1789760782.247868:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25264128 -> 25268224
00010000:00010000:1.0:1789760782.247896:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.247909:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.247918:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.247925:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760782.247930:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.247937:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.247961:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.247979:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60db89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25264128->25268223] (req 25264128->25268223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.248071:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521053312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45406us (47610us total) trans 4294973488 rc 0/0
00000100:00100000:1.0:1789760782.248091:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6201
00000100:00100000:1.0:1789760782.248101:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753834732519 time 753889331292 state 0x2 ref 0
00000100:00100000:1.0:1789760782.252162:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760782.252945:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521053440
00000100:00100000:2.0:1789760782.252956:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521053440
00000100:00100000:2.0:1789760782.253011:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753834732519 time 753889331292 state 0x0 ref 1
00000100:00100000:2.0:1789760782.253025:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753889591708 time 753889331292 state 0x1 ref 1
00000100:00100000:2.0:1789760782.253057:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753889591708 time 753939739461 state 0x0 ref 1
00000100:00100000:2.0:1789760782.253069:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521053440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760782.253113:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25268224, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:2.0:1789760782.253124:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.253139:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:2.0:1789760782.253144:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760782.253150:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.253165:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760782.284311:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25268224 -> 25272320
00000001:00080000:1.0:1789760782.284344:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973489 is committed
00010000:00010000:2.0:1789760782.284353:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.284366:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.284376:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.284383:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760782.284388:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.284398:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.284416:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.284424:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60db90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25268224->25272319] (req 25268224->25272319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760782.284561:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521053440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31489us (32403us total) trans 4294973489 rc 0/0
00000100:00100000:2.0:1789760782.284571:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6202
00000100:00100000:2.0:1789760782.284580:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753889591708 time 753939739461 state 0x2 ref 0
00000100:00100000:3.0:1789760782.286949:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.287015:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521053568
00000100:00100000:1.0:1789760782.287024:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521053568
00000100:00100000:1.0:1789760782.287077:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753889591708 time 753939739461 state 0x0 ref 1
00000100:00100000:1.0:1789760782.287092:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753939999877 time 753939739461 state 0x1 ref 1
00000100:00100000:1.0:1789760782.287123:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753939999877 time 753973805792 state 0x0 ref 1
00000100:00100000:1.0:1789760782.287135:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521053568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760782.287178:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25272320, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:1.0:1789760782.287192:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.287207:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=753s v=(0 0)
00010000:00010000:1.0:1789760782.287212:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760782.287219:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.287232:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760782.318426:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973490 is committed
00002000:00010000:3.0:1789760782.318481:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25272320 -> 25276416
00010000:00010000:3.0:1789760782.318497:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.318511:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.318534:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.318543:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760782.318548:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.318558:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.318897:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.318903:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60db97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25272320->25276415] (req 25272320->25276415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760782.318988:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521053568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31850us (32043us total) trans 4294973490 rc 0/0
00000100:00100000:3.0:1789760782.319256:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6203
00000100:00100000:3.0:1789760782.319266:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753939999877 time 753973805792 state 0x2 ref 0
00000100:00100000:3.0:1789760782.322643:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760782.322713:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521053696
00000100:00100000:0.0:1789760782.322727:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521053696
00000100:00100000:0.0:1789760782.322785:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753939999877 time 753973805792 state 0x0 ref 1
00000100:00100000:0.0:1789760782.322800:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753974066208 time 753973805792 state 0x1 ref 1
00000100:00100000:0.0:1789760782.322834:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753974066208 time 754009517320 state 0x0 ref 1
00000100:00100000:0.0:1789760782.322847:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521053696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760782.322893:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25276416, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:0.0:1789760782.322901:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.322916:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:0.0:1789760782.322920:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760782.322926:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.322939:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760782.356756:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973491 is committed
00002000:00010000:1.0:1789760782.356785:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25276416 -> 25280512
00010000:00010000:1.0:1789760782.356800:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.356812:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.356822:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.356829:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760782.356834:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.356842:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.356867:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.356879:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60db9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25276416->25280511] (req 25276416->25280511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.357306:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521053696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34456us (34673us total) trans 4294973491 rc 0/0
00000100:00100000:1.0:1789760782.357370:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6204
00000100:00100000:1.0:1789760782.357380:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753974066208 time 754009517320 state 0x2 ref 0
00000100:00100000:2.0:1789760782.361850:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.362050:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521053824
00000100:00100000:1.0:1789760782.362058:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521053824
00000100:00100000:1.0:1789760782.362108:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 753974066208 time 754009517320 state 0x0 ref 1
00000100:00100000:1.0:1789760782.362124:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754009777736 time 754009517320 state 0x1 ref 1
00000100:00100000:1.0:1789760782.362159:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754009777736 time 754048842294 state 0x0 ref 1
00000100:00100000:1.0:1789760782.362169:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521053824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760782.362834:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25280512, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:1.0:1789760782.362846:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.362862:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:1.0:1789760782.362867:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760782.362873:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.362889:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760782.391061:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973492 is committed
00002000:00010000:1.0:1789760782.391120:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25280512 -> 25284608
00010000:00010000:1.0:1789760782.391140:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.391155:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.391166:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.391174:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760782.391179:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.391189:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.391211:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.391219:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dba5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25280512->25284607] (req 25280512->25284607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.391429:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521053824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29253us (29579us total) trans 4294973492 rc 0/0
00000100:00100000:1.0:1789760782.391456:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6205
00000100:00100000:1.0:1789760782.391467:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754009777736 time 754048842294 state 0x2 ref 0
00000100:00100000:3.0:1789760782.394892:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760782.395022:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521053952
00000100:00100000:2.0:1789760782.395035:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521053952
00000100:00100000:2.0:1789760782.395116:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754009777736 time 754048842294 state 0x0 ref 1
00000100:00100000:2.0:1789760782.395135:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754049102710 time 754048842294 state 0x1 ref 1
00000100:00100000:2.0:1789760782.395204:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754049102710 time 754081885584 state 0x0 ref 1
00000100:00100000:2.0:1789760782.395218:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521053952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760782.395284:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25284608, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:2.0:1789760782.395296:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.395354:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:2.0:1789760782.395360:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760782.395369:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.395385:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760782.447148:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973493 is committed
00002000:00010000:3.0:1789760782.447230:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25284608 -> 25288704
00010000:00010000:3.0:1789760782.447246:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.447260:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.447271:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.447279:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760782.447283:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.447293:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.447331:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.447340:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60dbac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25284608->25288703] (req 25284608->25288703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760782.447479:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521053952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52259us (52597us total) trans 4294973493 rc 0/0
00000100:00100000:3.0:1789760782.447490:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6206
00000100:00100000:3.0:1789760782.447498:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754049102710 time 754081885584 state 0x2 ref 0
00000100:00100000:3.0:1789760782.452590:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.452676:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521054080
00000100:00100000:1.0:1789760782.452690:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521054080
00000100:00100000:1.0:1789760782.452753:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754049102710 time 754081885584 state 0x0 ref 1
00000100:00100000:1.0:1789760782.452770:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754082146000 time 754081885584 state 0x1 ref 1
00000100:00100000:1.0:1789760782.452806:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754082146000 time 754139487456 state 0x0 ref 1
00000100:00100000:1.0:1789760782.452820:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760782.452870:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25288704, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:1.0:1789760782.452879:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.452894:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:1.0:1789760782.452899:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760782.452906:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.452920:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.458467:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548771200:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1789760782.458546:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760782.458611:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:1.0:1789760782.458618:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548771328:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1789760782.458643:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760782.459735:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548771200
00000100:00100000:2.0:1789760782.459748:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548771200
00000100:00100000:2.0:1789760782.459817:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548771328
00000100:00100000:2.0:1789760782.459821:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548771328
00000100:00100000:2.0:1789760782.459840:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390
00000100:00100000:2.0:1789760782.459848:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548771200:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1789760782.459874:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528285696 pending 1703936 free 3832545280 avail 3805282304
00000100:00100000:2.0:1789760782.459958:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548771200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1411us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760782.459966:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390
00000100:00100000:2.0:1789760782.459982:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391
00000100:00100000:2.0:1789760782.459989:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548771328:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:2.0:1789760782.460001:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528285696 pending 1703936 free 3832545280 avail 3805282304
00000100:00100000:2.0:1789760782.460029:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548771328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (1385us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760782.460035:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391
00000100:00100000:2.0:1789760782.460101:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548771328:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1789760782.460115:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548771200:0@lo:13:osp-pre-0-1.0
00000100:00080000:3.0:1789760782.460629:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760782.491595:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973494 is committed
00002000:00010000:1.0:1789760782.491728:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25288704 -> 25292800
00010000:00010000:1.0:1789760782.491744:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.491757:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.491766:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.491774:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760782.491831:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.491844:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.491864:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.491872:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25288704->25292799] (req 25288704->25292799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.492059:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39236us (39478us total) trans 4294973494 rc 0/0
00000100:00100000:1.0:1789760782.492073:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6207
00000100:00100000:1.0:1789760782.492082:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754082146000 time 754139487456 state 0x2 ref 0
00000100:00100000:2.0:1789760782.495072:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.495169:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521054208
00000100:00100000:1.0:1789760782.495178:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521054208
00000100:00100000:1.0:1789760782.495301:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754082146000 time 754139487456 state 0x0 ref 1
00000100:00100000:1.0:1789760782.495401:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754139747872 time 754139487456 state 0x1 ref 1
00000100:00100000:1.0:1789760782.495479:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754139747872 time 754182160983 state 0x0 ref 1
00000100:00100000:1.0:1789760782.495492:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760782.495540:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25292800, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:1.0:1789760782.495549:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.495564:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:1.0:1789760782.495568:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760782.495574:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.495587:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760782.544275:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973495 is committed
00002000:00010000:1.0:1789760782.544405:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25292800 -> 25296896
00010000:00010000:1.0:1789760782.544421:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.544444:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.544453:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.544460:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760782.544465:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.544474:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.544494:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.544502:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25292800->25296895] (req 25292800->25296895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.544596:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49101us (49528us total) trans 4294973495 rc 0/0
00000100:00100000:1.0:1789760782.544607:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6208
00000100:00100000:1.0:1789760782.544616:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754139747872 time 754182160983 state 0x2 ref 0
00000100:00100000:3.0:1789760782.554451:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760782.554744:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521054336
00000100:00100000:2.0:1789760782.554755:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521054336
00000100:00100000:2.0:1789760782.554812:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754139747872 time 754182160983 state 0x0 ref 1
00000100:00100000:2.0:1789760782.554828:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754182421399 time 754182160983 state 0x1 ref 1
00000100:00100000:2.0:1789760782.554864:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754182421399 time 754241546543 state 0x0 ref 1
00000100:00100000:2.0:1789760782.554877:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760782.555128:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25296896, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:2.0:1789760782.555139:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.555155:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:2.0:1789760782.555159:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760782.555166:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.555182:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760782.614192:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973496 is committed
00002000:00010000:1.0:1789760782.614275:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25296896 -> 25300992
00010000:00010000:1.0:1789760782.614360:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.614374:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.614382:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.614389:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760782.614394:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.614402:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.614420:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.614427:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dbc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25296896->25300991] (req 25296896->25300991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.614530:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59651us (60098us total) trans 4294973496 rc 0/0
00000100:00100000:1.0:1789760782.614540:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6209
00000100:00100000:1.0:1789760782.614550:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754182421399 time 754241546543 state 0x2 ref 0
00000100:00100000:3.0:1789760782.617390:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760782.617498:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521054464
00000100:00100000:2.0:1789760782.617509:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521054464
00000100:00100000:2.0:1789760782.617566:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754182421399 time 754241546543 state 0x0 ref 1
00000100:00100000:2.0:1789760782.617583:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754241806959 time 754241546543 state 0x1 ref 1
00000100:00100000:2.0:1789760782.617609:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754241806959 time 754304292185 state 0x0 ref 1
00000100:00100000:2.0:1789760782.617622:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521054464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760782.617668:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25300992, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:2.0:1789760782.617679:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.617695:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:2.0:1789760782.617700:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760782.617706:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.617721:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760782.657926:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973497 is committed
00002000:00010000:3.0:1789760782.658759:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25300992 -> 25305088
00010000:00010000:3.0:1789760782.658777:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.658789:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.658798:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.658806:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760782.658812:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.658822:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.658841:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.658849:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dbc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25300992->25305087] (req 25300992->25305087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760782.658945:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521054464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41321us (41558us total) trans 4294973497 rc 0/0
00000100:00100000:3.0:1789760782.658959:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6210
00000100:00100000:3.0:1789760782.658968:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754241806959 time 754304292185 state 0x2 ref 0
00000100:00100000:2.0:1789760782.666694:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.666820:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521054592
00000100:00100000:1.0:1789760782.666829:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521054592
00000100:00100000:1.0:1789760782.666889:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754241806959 time 754304292185 state 0x0 ref 1
00000100:00100000:1.0:1789760782.666904:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754304552601 time 754304292185 state 0x1 ref 1
00000100:00100000:1.0:1789760782.666970:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754304552601 time 754353651888 state 0x0 ref 1
00000100:00100000:1.0:1789760782.666983:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760782.667028:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25305088, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:1.0:1789760782.667037:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.667052:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:1.0:1789760782.667056:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760782.667062:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.667074:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760782.712799:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973498 is committed
00002000:00010000:3.0:1789760782.713041:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25305088 -> 25309184
00010000:00010000:3.0:1789760782.713057:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.713195:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.713205:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.713213:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760782.713218:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.713227:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.713247:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.713255:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dbcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25305088->25309183] (req 25305088->25309183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760782.713538:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46545us (46842us total) trans 4294973498 rc 0/0
00000100:00100000:3.0:1789760782.713550:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6211
00000100:00100000:3.0:1789760782.713559:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754304552601 time 754353651888 state 0x2 ref 0
00000100:00100000:0.0:1789760782.720015:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.720401:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521054720
00000100:00100000:1.0:1789760782.720412:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521054720
00000100:00100000:1.0:1789760782.720477:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754304552601 time 754353651888 state 0x0 ref 1
00000100:00100000:1.0:1789760782.720492:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754353912304 time 754353651888 state 0x1 ref 1
00000100:00100000:1.0:1789760782.720626:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754353912304 time 754407308710 state 0x0 ref 1
00000100:00100000:1.0:1789760782.720637:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521054720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760782.720676:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25309184, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:1.0:1789760782.720682:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.720695:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:1.0:1789760782.720698:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760782.720702:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.720712:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760782.759286:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973499 is committed
00002000:00010000:1.0:1789760782.759459:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25309184 -> 25313280
00010000:00010000:1.0:1789760782.759475:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.759489:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.759498:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.759506:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760782.759511:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.759520:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.759609:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.759618:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25309184->25313279] (req 25309184->25313279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760782.759716:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521054720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39074us (39704us total) trans 4294973499 rc 0/0
00000100:00100000:1.0:1789760782.759727:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6212
00000100:00100000:1.0:1789760782.759736:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754353912304 time 754407308710 state 0x2 ref 0
00000100:00100000:1.0:1789760782.763064:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760782.763284:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521054848
00000100:00100000:2.0:1789760782.763295:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521054848
00000100:00100000:2.0:1789760782.763605:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754353912304 time 754407308710 state 0x0 ref 1
00000100:00100000:2.0:1789760782.763622:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754407569126 time 754407308710 state 0x1 ref 1
00000100:00100000:2.0:1789760782.763699:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754407569126 time 754450380955 state 0x0 ref 1
00000100:00100000:2.0:1789760782.763715:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760782.763763:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25313280, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:2.0:1789760782.763773:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.763787:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:2.0:1789760782.763792:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760782.763798:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.763812:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760782.811504:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973500 is committed
00002000:00010000:0.0:1789760782.811614:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25313280 -> 25317376
00010000:00010000:0.0:1789760782.811630:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.811643:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.811652:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.811660:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760782.811664:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.811674:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.811693:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.811701:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60dbdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25313280->25317375] (req 25313280->25317375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760782.811789:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48074us (48729us total) trans 4294973500 rc 0/0
00000100:00100000:0.0:1789760782.811797:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6213
00000100:00100000:0.0:1789760782.811805:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754407569126 time 754450380955 state 0x2 ref 0
00000100:00100000:2.0:1789760782.814809:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760782.814861:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521054976
00000100:00100000:3.0:1789760782.814870:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521054976
00000100:00100000:3.0:1789760782.814926:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754407569126 time 754450380955 state 0x0 ref 1
00000100:00100000:3.0:1789760782.814940:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754450641371 time 754450380955 state 0x1 ref 1
00000100:00100000:3.0:1789760782.815016:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754450641371 time 754501698106 state 0x0 ref 1
00000100:00100000:3.0:1789760782.815028:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521054976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760782.815075:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25317376, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:3.0:1789760782.815084:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.815100:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:3.0:1789760782.815105:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760782.815311:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.815361:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760782.843384:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25317376 -> 25321472
00010000:00010000:0.0:1789760782.843403:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.843416:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.843424:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.843443:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760782.843447:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.843456:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.843833:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.843843:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dbe4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25317376->25321471] (req 25317376->25321471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760782.843933:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521054976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28901us (29127us total) trans 4294973501 rc 0/0
00000100:00100000:0.0:1789760782.843944:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6214
00000100:00100000:0.0:1789760782.843953:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754450641371 time 754501698106 state 0x2 ref 0
00000001:00080000:3.0:1789760782.844483:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973501 is committed
00000100:00100000:3.0:1789760782.852560:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.852763:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521055104
00000100:00100000:1.0:1789760782.852773:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521055104
00000100:00100000:1.0:1789760782.852825:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754450641371 time 754501698106 state 0x0 ref 1
00000100:00100000:1.0:1789760782.852841:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754501958522 time 754501698106 state 0x1 ref 1
00000100:00100000:1.0:1789760782.852872:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754501958522 time 754539554753 state 0x0 ref 1
00000100:00100000:1.0:1789760782.852885:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521055104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760782.852938:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25321472, mtime: 0x6aad950f, atime: 0x0, ctime: 0x6aad950f, blocks: 0xc807
00010000:00010000:1.0:1789760782.852947:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.852963:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:1.0:1789760782.852967:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760782.852973:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760782.852985:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.906107:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1789760782.918260:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25321472 -> 25325568
00002000:00010000:3.0:1789760782.918268:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760783 -> 1789760784
00002000:00010000:3.0:1789760782.918271:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760783 -> 1789760784
00010000:00010000:3.0:1789760782.918284:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.918298:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.918308:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.918348:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760782.918354:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.918363:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.918389:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.918397:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60dbeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25321472->25325567] (req 25321472->25325567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760782.918492:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521055104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65605us (65938us total) trans 4294973502 rc 0/0
00000100:00100000:3.0:1789760782.918504:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6215
00000100:00100000:3.0:1789760782.918514:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754501958522 time 754539554753 state 0x2 ref 0
00000001:00080000:3.0:1789760782.918553:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973502 is committed
00000100:00100000:2.0:1789760782.922772:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760782.923134:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521055232
00000100:00100000:1.0:1789760782.923143:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521055232
00000100:00100000:1.0:1789760782.923197:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754501958522 time 754539554753 state 0x0 ref 1
00000100:00100000:1.0:1789760782.923212:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754539815169 time 754539554753 state 0x1 ref 1
00000100:00100000:0.0:1789760782.923517:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754539815169 time 754610196612 state 0x0 ref 1
00000100:00100000:0.0:1789760782.923532:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521055232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760782.923579:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25325568, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:0.0:1789760782.923588:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.923604:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:0.0:1789760782.923608:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760782.923614:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760782.923628:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760782.982552:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973503 is committed
00002000:00010000:3.0:1789760782.982658:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25325568 -> 25329664
00010000:00010000:3.0:1789760782.982678:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.982692:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.982703:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.982712:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760782.982717:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.982726:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.982856:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760782.982866:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60dbf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25325568->25329663] (req 25325568->25329663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760782.982956:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521055232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59424us (60190us total) trans 4294973503 rc 0/0
00000100:00100000:3.0:1789760782.983374:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6216
00000100:00100000:3.0:1789760782.983384:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754539815169 time 754610196612 state 0x2 ref 0
00000100:00100000:0.0:1789760782.988277:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760782.988451:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521055360
00000100:00100000:2.0:1789760782.988462:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521055360
00000100:00100000:2.0:1789760782.988520:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754539815169 time 754610196612 state 0x0 ref 1
00000100:00100000:2.0:1789760782.988536:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754610457028 time 754610196612 state 0x1 ref 1
00000100:00100000:2.0:1789760782.990290:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754610457028 time 754676964280 state 0x0 ref 1
00000100:00100000:2.0:1789760782.990329:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521055360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760782.990392:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25329664, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:2.0:1789760782.990402:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.990418:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:2.0:1789760782.990422:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760782.990437:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760782.990453:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760783.035522:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973504 is committed
00002000:00010000:2.0:1789760783.035618:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25329664 -> 25333760
00010000:00010000:2.0:1789760783.035634:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.035646:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.035655:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.035662:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760783.035666:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.035675:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.035698:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.035706:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60dbf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25329664->25333759] (req 25329664->25333759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760783.035865:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521055360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45554us (47595us total) trans 4294973504 rc 0/0
00000100:00100000:2.0:1789760783.035876:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6217
00000100:00100000:2.0:1789760783.035885:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754610457028 time 754676964280 state 0x2 ref 0
00000100:00100000:0.0:1789760783.041398:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760783.041477:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521055488
00000100:00100000:2.0:1789760783.041490:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521055488
00000100:00100000:0.0:1789760783.042063:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754610457028 time 754676964280 state 0x0 ref 1
00000100:00100000:0.0:1789760783.042079:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754677224696 time 754676964280 state 0x1 ref 1
00000100:00100000:0.0:1789760783.042111:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754677224696 time 754728793596 state 0x0 ref 1
00000100:00100000:0.0:1789760783.042124:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521055488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760783.042392:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25333760, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:0.0:1789760783.042402:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.042418:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:0.0:1789760783.042423:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760783.042441:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.042457:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760783.109551:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25333760 -> 25337856
00010000:00010000:0.0:1789760783.109570:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.109589:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.109598:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.109606:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760783.109610:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.109619:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.109637:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.109645:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d330b4cb/0x4a99e02bc60dc00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25333760->25337855] (req 25333760->25337855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760783.109733:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521055488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 67608us (68341us total) trans 4294973505 rc 0/0
00000100:00100000:0.0:1789760783.109743:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6218
00000100:00100000:0.0:1789760783.109751:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754677224696 time 754728793596 state 0x2 ref 0
00000001:00080000:3.0:1789760783.112905:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973505 is committed
00000100:00100000:2.0:1789760783.113131:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.113221:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521055616
00000100:00100000:3.0:1789760783.113230:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521055616
00000100:00100000:3.0:1789760783.113281:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754677224696 time 754728793596 state 0x0 ref 1
00000100:00100000:3.0:1789760783.113295:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754729054012 time 754728793596 state 0x1 ref 1
00000100:00100000:3.0:1789760783.113382:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754729054012 time 754800065016 state 0x0 ref 1
00000100:00100000:3.0:1789760783.113393:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521055616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.113551:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25337856, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.113561:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.113581:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:3.0:1789760783.113586:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.113592:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.113606:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760783.148474:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25337856 -> 25341952
00010000:00010000:3.0:1789760783.148493:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.148507:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.148516:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.148525:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760783.148530:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.148538:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.148558:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.148566:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25337856->25341951] (req 25337856->25341951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760783.148655:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521055616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35258us (35524us total) trans 4294973506 rc 0/0
00000100:00100000:3.0:1789760783.148665:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6219
00000100:00100000:3.0:1789760783.148675:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754729054012 time 754800065016 state 0x2 ref 0
00000001:00080000:3.0:1789760783.148711:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973506 is committed
00000100:00100000:2.0:1789760783.153035:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.153155:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521055744
00000100:00100000:3.0:1789760783.153166:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521055744
00000100:00100000:3.0:1789760783.153221:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754729054012 time 754800065016 state 0x0 ref 1
00000100:00100000:3.0:1789760783.153236:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754800325432 time 754800065016 state 0x1 ref 1
00000100:00100000:3.0:1789760783.153265:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754800325432 time 754839948300 state 0x0 ref 1
00000100:00100000:3.0:1789760783.153278:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521055744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.153370:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25341952, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.153379:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.153396:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:3.0:1789760783.153401:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.153407:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.153422:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760783.184299:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973507 is committed
00002000:00010000:3.0:1789760783.184563:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25341952 -> 25346048
00010000:00010000:3.0:1789760783.184579:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.184592:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.184601:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.184608:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760783.184613:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.184622:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.184641:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.184648:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25341952->25346047] (req 25341952->25346047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760783.184778:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521055744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31497us (31747us total) trans 4294973507 rc 0/0
00000100:00100000:3.0:1789760783.184789:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6220
00000100:00100000:3.0:1789760783.184799:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754800325432 time 754839948300 state 0x2 ref 0
00000100:00100000:0.0:1789760783.189908:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760783.190009:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521055872
00000100:00100000:2.0:1789760783.190021:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521055872
00000100:00100000:2.0:1789760783.190092:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754800325432 time 754839948300 state 0x0 ref 1
00000100:00100000:2.0:1789760783.190108:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754840208716 time 754839948300 state 0x1 ref 1
00000100:00100000:2.0:1789760783.190138:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754840208716 time 754876820531 state 0x0 ref 1
00000100:00100000:2.0:1789760783.190152:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521055872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760783.190205:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25346048, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:2.0:1789760783.190217:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.190234:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:2.0:1789760783.190238:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760783.190245:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.190259:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760783.238307:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973508 is committed
00002000:00010000:1.0:1789760783.238542:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25346048 -> 25350144
00010000:00010000:1.0:1789760783.238558:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.238572:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.238581:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.238646:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.238652:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.238662:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.238680:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.238688:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60dc15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25346048->25350143] (req 25346048->25350143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.238780:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521055872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48625us (48877us total) trans 4294973508 rc 0/0
00000100:00100000:1.0:1789760783.238790:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6221
00000100:00100000:1.0:1789760783.238800:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754840208716 time 754876820531 state 0x2 ref 0
00000100:00100000:2.0:1789760783.247151:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760783.247644:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521056000
00000100:00100000:0.0:1789760783.247655:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521056000
00000100:00100000:0.0:1789760783.247709:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754840208716 time 754876820531 state 0x0 ref 1
00000100:00100000:0.0:1789760783.247726:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754877080947 time 754876820531 state 0x1 ref 1
00000100:00100000:0.0:1789760783.247762:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754877080947 time 754934444177 state 0x0 ref 1
00000100:00100000:0.0:1789760783.247775:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521056000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760783.247822:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25350144, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:0.0:1789760783.247831:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.247847:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:0.0:1789760783.247852:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760783.247859:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.247873:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760783.298894:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973509 is committed
00002000:00010000:2.0:1789760783.299052:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25350144 -> 25354240
00010000:00010000:2.0:1789760783.299189:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.299203:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.299213:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.299222:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760783.299226:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.299235:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.299256:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.299264:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60dc1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25350144->25354239] (req 25350144->25354239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760783.299529:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521056000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51751us (52381us total) trans 4294973509 rc 0/0
00000100:00100000:0.0:1789760783.299541:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6222
00000100:00100000:0.0:1789760783.299551:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754877080947 time 754934444177 state 0x2 ref 0
00000100:00100000:2.0:1789760783.310039:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.310265:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521056128
00000100:00100000:3.0:1789760783.310275:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521056128
00000100:00100000:3.0:1789760783.310365:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754877080947 time 754934444177 state 0x0 ref 1
00000100:00100000:3.0:1789760783.310381:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754934704593 time 754934444177 state 0x1 ref 1
00000100:00100000:3.0:1789760783.310416:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754934704593 time 754997097915 state 0x0 ref 1
00000100:00100000:3.0:1789760783.310440:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521056128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.310486:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25354240, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.310495:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.310511:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=754s v=(0 0)
00010000:00010000:3.0:1789760783.310516:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.310522:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.310536:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760783.366943:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25354240 -> 25358336
00010000:00010000:3.0:1789760783.367024:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.367039:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.367049:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.367057:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760783.367061:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.367070:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.367092:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.367101:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25354240->25358335] (req 25354240->25358335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760783.367652:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973510 is committed
00000100:00100000:3.0:1789760783.367793:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521056128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57360us (57758us total) trans 4294973510 rc 0/0
00000100:00100000:3.0:1789760783.367808:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6223
00000100:00100000:3.0:1789760783.367818:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754934704593 time 754997097915 state 0x2 ref 0
00000100:00100000:2.0:1789760783.375656:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.375744:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521056256
00000100:00100000:3.0:1789760783.375753:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521056256
00000100:00100000:3.0:1789760783.375804:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754934704593 time 754997097915 state 0x0 ref 1
00000100:00100000:3.0:1789760783.375821:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754997358331 time 754997097915 state 0x1 ref 1
00000100:00100000:3.0:1789760783.375897:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754997358331 time 755062579000 state 0x0 ref 1
00000100:00100000:3.0:1789760783.375918:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521056256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.375966:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25358336, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.375975:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.375990:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:3.0:1789760783.375995:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.376001:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.376017:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760783.414680:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973511 is committed
00002000:00010000:3.0:1789760783.414767:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25358336 -> 25362432
00010000:00010000:3.0:1789760783.414782:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.414795:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.414803:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.414811:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760783.414815:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.414823:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.414839:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.414846:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25358336->25362431] (req 25358336->25362431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760783.414932:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521056256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39019us (39287us total) trans 4294973511 rc 0/0
00000100:00100000:3.0:1789760783.414941:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6224
00000100:00100000:3.0:1789760783.414950:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754997358331 time 755062579000 state 0x2 ref 0
00000100:00100000:2.0:1789760783.422556:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760783.422648:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521056384
00000100:00100000:1.0:1789760783.422658:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521056384
00000100:00100000:1.0:1789760783.422714:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 754997358331 time 755062579000 state 0x0 ref 1
00000100:00100000:1.0:1789760783.422729:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755062839416 time 755062579000 state 0x1 ref 1
00000100:00100000:1.0:1789760783.422798:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755062839416 time 755109480493 state 0x0 ref 1
00000100:00100000:1.0:1789760783.422812:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521056384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760783.422859:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25362432, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:1.0:1789760783.422869:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.422883:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:1.0:1789760783.422888:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760783.422894:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.422908:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760783.458416:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973512 is committed
00002000:00010000:3.0:1789760783.458582:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25362432 -> 25366528
00010000:00010000:3.0:1789760783.458599:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.458611:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.458620:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.458627:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760783.458632:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.458640:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.458657:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.458664:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60dc31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25362432->25366527] (req 25362432->25366527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760783.458753:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521056384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35939us (36202us total) trans 4294973512 rc 0/0
00000100:00100000:3.0:1789760783.458763:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6225
00000100:00100000:3.0:1789760783.458773:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755062839416 time 755109480493 state 0x2 ref 0
00000100:00100000:0.0:1789760783.463248:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760783.464136:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521056512
00000100:00100000:1.0:1789760783.464148:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521056512
00000100:00100000:1.0:1789760783.464203:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755062839416 time 755109480493 state 0x0 ref 1
00000100:00100000:1.0:1789760783.464218:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755109740909 time 755109480493 state 0x1 ref 1
00000100:00100000:1.0:1789760783.464284:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755109740909 time 755150965298 state 0x0 ref 1
00000100:00100000:1.0:1789760783.464298:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521056512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760783.464358:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25366528, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:1.0:1789760783.464368:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.464384:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:1.0:1789760783.464389:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760783.464395:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.464409:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.483019:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876699548771584:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483104:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483162:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3454:1876699548772096:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483186:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483208:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3454:1876699548772608:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483229:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483257:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1]
00000100:00100000:1.0:1789760783.483263:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548771456:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483290:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483311:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548771968:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483677:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483705:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548772480:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483731:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483750:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548772992:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483773:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483806:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548771712:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483829:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483851:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548772224:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483871:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483888:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548772736:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483910:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483929:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2]
00000100:00100000:1.0:1789760783.483935:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548771840:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483956:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.483967:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548772352:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.483986:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.484004:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548772864:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.484026:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760783.484274:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548771584
00000100:00100000:1.0:1789760783.484283:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548771584
00000100:00100000:1.0:1789760783.484471:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548772096
00000100:00100000:1.0:1789760783.484476:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548772096
00000100:00100000:1.0:1789760783.484506:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548772608
00000100:00100000:1.0:1789760783.484509:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548772608
00000100:00100000:1.0:1789760783.484520:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548772224
00000100:00100000:1.0:1789760783.484523:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548772224
00000100:00100000:1.0:1789760783.484534:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548772736
00000100:00100000:1.0:1789760783.484536:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548772736
00000100:00100000:1.0:1789760783.484547:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548771840
00000100:00100000:1.0:1789760783.484549:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548771840
00000100:00100000:1.0:1789760783.484565:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957
00000100:00100000:1.0:1789760783.484573:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876699548771584:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.484633:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3454:x1876699548771584:12345-0@lo:400:kworker.0 Request processed in 61us (1529us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760783.484641:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957
00000100:00100000:1.0:1789760783.484658:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958
00000100:00100000:1.0:1789760783.484664:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876699548772096:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.484692:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3454:x1876699548772096:12345-0@lo:400:kworker.0 Request processed in 29us (1506us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760783.484698:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958
00000100:00100000:1.0:1789760783.484709:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959
00000100:00100000:1.0:1789760783.484714:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3454:x1876699548772608:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.484742:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3454:x1876699548772608:12345-0@lo:400:kworker.0 Request processed in 28us (1511us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760783.484747:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959
00000100:00100000:1.0:1789760783.484756:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960
00000100:00100000:1.0:1789760783.484761:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548772224:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.484790:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3455:x1876699548772224:12345-0@lo:400:kworker.0 Request processed in 29us (917us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760783.484795:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960
00000100:00100000:1.0:1789760783.484807:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961
00000100:00100000:1.0:1789760783.484812:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548772736:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.484834:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3455:x1876699548772736:12345-0@lo:400:kworker.0 Request processed in 23us (923us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760783.484839:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961
00000100:00100000:1.0:1789760783.484850:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962
00000100:00100000:1.0:1789760783.484855:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548771840:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.484880:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548771840:12345-0@lo:400:kworker.0 Request processed in 25us (923us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760783.484885:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962
00000100:00100000:1.0:1789760783.484913:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548771456
00000100:00100000:1.0:1789760783.484917:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548771456
00000100:00100000:1.0:1789760783.484942:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487
00000100:00100000:1.0:1789760783.484948:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3454:x1876699548771456:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.484975:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3454:x1876699548771456:12345-0@lo:400:kworker.0 Request processed in 28us (1684us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760783.485133:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548772480
00000100:00100000:0.0:1789760783.485139:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548772480
00000100:00100000:0.0:1789760783.485171:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548772992
00000100:00100000:0.0:1789760783.485174:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548772992
00000100:00100000:0.0:1789760783.485190:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548772352
00000100:00100000:0.0:1789760783.485192:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548772352
00000100:00100000:0.0:1789760783.485201:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548772864
00000100:00100000:0.0:1789760783.485203:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548772864
00000100:00100000:0.0:1789760783.485215:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309
00000100:00100000:0.0:1789760783.485221:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548772480:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760783.485273:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548772480:12345-0@lo:400:kworker.0 Request processed in 52us (1540us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760783.485279:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309
00000100:00100000:0.0:1789760783.485292:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310
00000100:00100000:0.0:1789760783.485297:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548772992:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760783.485343:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548772992:12345-0@lo:400:kworker.0 Request processed in 46us (1569us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760783.485349:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310
00000100:00100000:0.0:1789760783.485360:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311
00000100:00100000:0.0:1789760783.485366:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548772352:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760783.485393:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548772352:12345-0@lo:400:kworker.0 Request processed in 28us (1406us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760783.485398:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311
00000100:00100000:0.0:1789760783.485409:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312
00000100:00100000:0.0:1789760783.485414:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548772864:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760783.485453:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548772864:12345-0@lo:400:kworker.0 Request processed in 39us (1425us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760783.485460:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312
00000100:00100000:0.0:1789760783.485530:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:0.0:1789760783.485540:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548773248:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760783.485572:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760783.485650:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548773248
00000100:00100000:0.0:1789760783.485655:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548773248
00000100:00100000:0.0:1789760783.485680:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392
00000100:00100000:0.0:1789760783.485688:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548773248:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:0.0:1789760783.485713:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760783.485746:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3456:x1876699548773248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (173us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760783.485753:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392
00000100:00100000:0.0:1789760783.485791:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3456:1876699548773248:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760783.485808:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:0.0:1789760783.485815:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548773120:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760783.485839:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760783.485885:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548773120
00000100:00100000:2.0:1789760783.485890:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548773120
00000100:00100000:2.0:1789760783.485917:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393
00000100:00100000:2.0:1789760783.485923:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548773120:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1789760783.485933:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:2.0:1789760783.485993:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548773120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (152us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760783.487262:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548771968
00000100:00100000:3.0:1789760783.487273:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548771968
00000100:00100000:3.0:1789760783.487327:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548771712
00000100:00100000:3.0:1789760783.487330:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548771712
00000100:00100000:3.0:1789760783.488954:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459
00000100:00100000:3.0:1789760783.488975:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548771968:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760783.489187:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548771968:12345-0@lo:400:kworker.0 Request processed in 221us (5509us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760783.489195:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459
00000100:00100000:3.0:1789760783.489220:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460
00000100:00100000:3.0:1789760783.489228:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548771712:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760783.489263:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3455:x1876699548771712:12345-0@lo:400:kworker.0 Request processed in 36us (5433us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760783.489269:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460
00000100:00100000:1.0:1789760783.490177:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487
00000100:00080000:1.0:1789760783.490244:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:1.0:1789760783.490251:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1789760783.490254:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1789760783.492733:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548771840:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492750:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548772352:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492761:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548772864:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492771:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548771712:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492780:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3455:1876699548772224:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492790:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3455:1876699548772736:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492832:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e2f0499-cafa-479a-9c13-a508b560cb61:3454:1876699548771456:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492843:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548771968:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492852:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548772480:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492864:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548772992:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492875:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3454:1876699548771584:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492884:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3454:1876699548772096:0@lo:400:kworker.0
00000100:00100000:1.0:1789760783.492893:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3454:1876699548772608:0@lo:400:kworker.0
00000100:00100000:0.0:1789760783.493376:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548773120:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1789760783.498725:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393
00002000:00010000:1.0:1789760783.510520:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25366528 -> 25370624
00010000:00010000:1.0:1789760783.510541:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.510555:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.510564:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.510571:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.510576:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.510585:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.510605:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.510613:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60dc38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25366528->25370623] (req 25366528->25370623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.510703:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521056512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46404us (47460us total) trans 4294973513 rc 0/0
00000100:00100000:1.0:1789760783.510714:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6226
00000100:00100000:1.0:1789760783.510723:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755109740909 time 755150965298 state 0x2 ref 0
00000001:00080000:0.0:1789760783.512123:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973513 is committed
00000100:00100000:1.0:1789760783.519554:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.520462:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521056640
00000100:00100000:3.0:1789760783.520473:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521056640
00000100:00100000:3.0:1789760783.520528:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755109740909 time 755150965298 state 0x0 ref 1
00000100:00100000:3.0:1789760783.520543:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755151225714 time 755150965298 state 0x1 ref 1
00000100:00100000:3.0:1789760783.520576:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755151225714 time 755207257870 state 0x0 ref 1
00000100:00100000:3.0:1789760783.520588:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521056640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.520636:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25370624, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.520645:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.520667:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:3.0:1789760783.520671:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.520678:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.520692:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760783.555199:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973514 is committed
00002000:00010000:1.0:1789760783.555282:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25370624 -> 25374720
00010000:00010000:1.0:1789760783.555298:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.555310:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.555691:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.555768:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.555774:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.555784:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.555803:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.555814:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dc3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25370624->25374719] (req 25370624->25374719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.555906:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521056640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35315us (36358us total) trans 4294973514 rc 0/0
00000100:00100000:1.0:1789760783.555917:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6227
00000100:00100000:1.0:1789760783.555926:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755151225714 time 755207257870 state 0x2 ref 0
00000100:00100000:2.0:1789760783.558697:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.558781:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521056768
00000100:00100000:3.0:1789760783.558791:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521056768
00000100:00100000:3.0:1789760783.558841:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755151225714 time 755207257870 state 0x0 ref 1
00000100:00100000:3.0:1789760783.558857:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755207518286 time 755207257870 state 0x1 ref 1
00000100:00100000:3.0:1789760783.558888:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755207518286 time 755245571047 state 0x0 ref 1
00000100:00100000:3.0:1789760783.558901:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521056768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.558950:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25374720, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.558959:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.558975:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:3.0:1789760783.558980:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.559058:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.559079:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760783.589404:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973515 is committed
00002000:00010000:3.0:1789760783.589610:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25374720 -> 25378816
00010000:00010000:3.0:1789760783.589626:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.589640:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.589650:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.589658:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760783.589663:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.589671:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.589689:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.589696:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25374720->25378815] (req 25374720->25378815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760783.589793:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521056768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30889us (31100us total) trans 4294973515 rc 0/0
00000100:00100000:3.0:1789760783.589803:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6228
00000100:00100000:3.0:1789760783.589812:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755207518286 time 755245571047 state 0x2 ref 0
00000100:00100000:1.0:1789760783.598345:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760783.599625:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521056896
00000100:00100000:2.0:1789760783.599638:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521056896
00000100:00100000:2.0:1789760783.599698:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755207518286 time 755245571047 state 0x0 ref 1
00000100:00100000:2.0:1789760783.599714:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755245831463 time 755245571047 state 0x1 ref 1
00000100:00100000:2.0:1789760783.599737:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755245831463 time 755286419582 state 0x0 ref 1
00000100:00100000:2.0:1789760783.599750:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521056896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760783.599800:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25378816, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:2.0:1789760783.599810:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.599825:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:2.0:1789760783.599829:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760783.599835:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.599848:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760783.636303:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973516 is committed
00002000:00010000:3.0:1789760783.636478:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25378816 -> 25382912
00010000:00010000:3.0:1789760783.636493:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.636507:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.636516:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.636524:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760783.636528:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.636537:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.636556:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.636571:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dc4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25378816->25382911] (req 25378816->25382911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760783.636702:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521056896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36950us (38394us total) trans 4294973516 rc 0/0
00000100:00100000:3.0:1789760783.636714:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6229
00000100:00100000:3.0:1789760783.636723:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755245831463 time 755286419582 state 0x2 ref 0
00000100:00100000:0.0:1789760783.640835:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760783.640933:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521057024
00000100:00100000:1.0:1789760783.640943:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521057024
00000100:00100000:1.0:1789760783.641148:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755245831463 time 755286419582 state 0x0 ref 1
00000100:00100000:1.0:1789760783.641163:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755286679998 time 755286419582 state 0x1 ref 1
00000100:00100000:1.0:1789760783.641283:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755286679998 time 755327964826 state 0x0 ref 1
00000100:00100000:1.0:1789760783.641296:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521057024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760783.641373:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25382912, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:1.0:1789760783.641383:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.641398:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:1.0:1789760783.641403:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760783.641409:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.641432:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760783.665911:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973517 is committed
00002000:00010000:1.0:1789760783.666042:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25382912 -> 25387008
00010000:00010000:1.0:1789760783.666058:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.666072:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.666082:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.666090:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.666095:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.666104:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.666122:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.666131:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25382912->25387007] (req 25382912->25387007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.666444:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521057024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25144us (25613us total) trans 4294973517 rc 0/0
00000100:00100000:1.0:1789760783.666455:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6230
00000100:00100000:1.0:1789760783.666464:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755286679998 time 755327964826 state 0x2 ref 0
00000100:00100000:2.0:1789760783.669895:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760783.669942:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521057152
00000100:00100000:1.0:1789760783.669952:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521057152
00000100:00100000:1.0:1789760783.670007:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755286679998 time 755327964826 state 0x0 ref 1
00000100:00100000:1.0:1789760783.670022:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755328225242 time 755327964826 state 0x1 ref 1
00000100:00100000:1.0:1789760783.670043:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755328225242 time 755356726295 state 0x0 ref 1
00000100:00100000:1.0:1789760783.670064:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521057152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760783.670111:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25387008, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:1.0:1789760783.670118:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.670131:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:1.0:1789760783.670134:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760783.670138:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.670148:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760783.705113:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973518 is committed
00002000:00010000:1.0:1789760783.705273:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25387008 -> 25391104
00010000:00010000:1.0:1789760783.705288:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.705310:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.705352:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.705359:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.705364:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.705374:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.705393:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.705400:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dc5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25387008->25391103] (req 25387008->25391103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760783.705637:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521057152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35574us (35741us total) trans 4294973518 rc 0/0
00000100:00100000:2.0:1789760783.705652:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6231
00000100:00100000:2.0:1789760783.705663:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755328225242 time 755356726295 state 0x2 ref 0
00000100:00100000:2.0:1789760783.720919:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.721077:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521057280
00000100:00100000:3.0:1789760783.721088:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521057280
00000100:00100000:3.0:1789760783.721153:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755328225242 time 755356726295 state 0x0 ref 1
00000100:00100000:3.0:1789760783.721168:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755356986711 time 755356726295 state 0x1 ref 1
00000100:00100000:3.0:1789760783.721203:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755356986711 time 755407885425 state 0x0 ref 1
00000100:00100000:3.0:1789760783.721217:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521057280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.721267:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25391104, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.721276:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.721292:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:3.0:1789760783.721297:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.721304:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.721339:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760783.789752:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973519 is committed
00002000:00010000:1.0:1789760783.789914:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25391104 -> 25395200
00010000:00010000:1.0:1789760783.789930:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.789945:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.789962:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.789971:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.789976:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.789985:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.790004:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.790012:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dc62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25391104->25395199] (req 25391104->25395199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.790101:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521057280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68881us (69188us total) trans 4294973519 rc 0/0
00000100:00100000:1.0:1789760783.790113:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6232
00000100:00100000:1.0:1789760783.790122:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755356986711 time 755407885425 state 0x2 ref 0
00000100:00100000:0.0:1789760783.796684:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.796791:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521057408
00000100:00100000:3.0:1789760783.796801:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521057408
00000100:00100000:3.0:1789760783.796854:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755356986711 time 755407885425 state 0x0 ref 1
00000100:00100000:3.0:1789760783.796870:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755408145841 time 755407885425 state 0x1 ref 1
00000100:00100000:3.0:1789760783.796947:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755408145841 time 755483629420 state 0x0 ref 1
00000100:00100000:3.0:1789760783.796972:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521057408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.797021:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25395200, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.797030:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.797046:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:3.0:1789760783.797051:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.797068:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.797084:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760783.829895:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973520 is committed
00002000:00010000:2.0:1789760783.830114:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25395200 -> 25399296
00010000:00010000:2.0:1789760783.830131:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.830143:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.830152:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.830158:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760783.830163:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.830172:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.830191:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760783.830198:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25395200->25399295] (req 25395200->25399295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760783.830310:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521057408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33338us (33633us total) trans 4294973520 rc 0/0
00000100:00100000:2.0:1789760783.830348:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6233
00000100:00100000:2.0:1789760783.830357:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755408145841 time 755483629420 state 0x2 ref 0
00000100:00100000:2.0:1789760783.833043:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760783.833216:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521057536
00000100:00100000:0.0:1789760783.833226:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521057536
00000100:00100000:0.0:1789760783.833274:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755408145841 time 755483629420 state 0x0 ref 1
00000100:00100000:0.0:1789760783.833285:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755483889836 time 755483629420 state 0x1 ref 1
00000100:00100000:0.0:1789760783.833309:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755483889836 time 755519992119 state 0x0 ref 1
00000100:00100000:0.0:1789760783.833385:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521057536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760783.833441:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25399296, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:0.0:1789760783.833451:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.833466:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:0.0:1789760783.833470:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760783.833476:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.833489:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760783.858553:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25399296 -> 25403392
00010000:00010000:1.0:1789760783.858574:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.858588:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.858597:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.858605:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.858609:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.858619:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.858638:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.858645:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60dc70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25399296->25403391] (req 25399296->25403391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.858735:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521057536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25349us (25696us total) trans 4294973521 rc 0/0
00000100:00100000:1.0:1789760783.858745:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6234
00000100:00100000:1.0:1789760783.858754:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755483889836 time 755519992119 state 0x2 ref 0
00000001:00080000:1.0:1789760783.858792:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973521 is committed
00000100:00100000:1.0:1789760783.861603:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760783.861691:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521057664
00000100:00100000:3.0:1789760783.861700:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521057664
00000100:00100000:3.0:1789760783.861761:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755483889836 time 755519992119 state 0x0 ref 1
00000100:00100000:3.0:1789760783.861776:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755520252535 time 755519992119 state 0x1 ref 1
00000100:00100000:3.0:1789760783.861798:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755520252535 time 755548481321 state 0x0 ref 1
00000100:00100000:3.0:1789760783.861810:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521057664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760783.861856:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25403392, mtime: 0x6aad9510, atime: 0x0, ctime: 0x6aad9510, blocks: 0xc807
00010000:00010000:3.0:1789760783.861865:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.861881:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:3.0:1789760783.861886:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760783.861892:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.861906:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760783.886880:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973522 is committed
00002000:00010000:1.0:1789760783.887476:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25403392 -> 25407488
00002000:00010000:1.0:1789760783.887481:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760784 -> 1789760785
00002000:00010000:1.0:1789760783.887484:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760784 -> 1789760785
00010000:00010000:1.0:1789760783.887496:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.888155:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.888168:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.888175:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.888179:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.888187:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.888207:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.888214:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dc77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25403392->25407487] (req 25403392->25407487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.888373:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521057664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26559us (26774us total) trans 4294973522 rc 0/0
00000100:00100000:1.0:1789760783.888383:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6235
00000100:00100000:1.0:1789760783.888393:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755520252535 time 755548481321 state 0x2 ref 0
00000100:00100000:0.0:1789760783.893298:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760783.895202:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521057792
00000100:00100000:1.0:1789760783.895217:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521057792
00000100:00100000:1.0:1789760783.895277:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755520252535 time 755548481321 state 0x0 ref 1
00000100:00100000:1.0:1789760783.895294:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755548741737 time 755548481321 state 0x1 ref 1
00000100:00100000:1.0:1789760783.895357:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755548741737 time 755582039261 state 0x0 ref 1
00000100:00100000:1.0:1789760783.895372:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521057792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760783.895438:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25407488, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:1.0:1789760783.895449:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.895467:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:1.0:1789760783.895472:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760783.895479:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.895494:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760783.930278:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760783.948500:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973523 is committed
00002000:00010000:1.0:1789760783.948601:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25407488 -> 25411584
00010000:00010000:1.0:1789760783.948622:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.948636:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.948645:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.948653:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760783.948657:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.948666:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.948684:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760783.948692:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25407488->25411583] (req 25407488->25411583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760783.948832:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521057792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53458us (55538us total) trans 4294973523 rc 0/0
00000100:00100000:1.0:1789760783.948846:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6236
00000100:00100000:1.0:1789760783.948855:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755548741737 time 755582039261 state 0x2 ref 0
00000100:00100000:2.0:1789760783.961281:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760783.961450:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521057920
00000100:00100000:0.0:1789760783.961462:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521057920
00000100:00100000:0.0:1789760783.961528:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755548741737 time 755582039261 state 0x0 ref 1
00000100:00100000:0.0:1789760783.961543:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755582299677 time 755582039261 state 0x1 ref 1
00000100:00100000:0.0:1789760783.961570:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755582299677 time 755648252255 state 0x0 ref 1
00000100:00100000:0.0:1789760783.961582:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521057920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760783.961635:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25411584, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:0.0:1789760783.961644:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.961661:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:0.0:1789760783.961665:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760783.961671:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760783.961687:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760784.003871:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973524 is committed
00002000:00010000:2.0:1789760784.004157:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25411584 -> 25415680
00010000:00010000:2.0:1789760784.004173:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.004379:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.004389:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.004396:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760784.004400:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.004409:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.004439:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.004555:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60dc85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25411584->25415679] (req 25411584->25415679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760784.004651:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521057920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43067us (43377us total) trans 4294973524 rc 0/0
00000100:00100000:2.0:1789760784.004664:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6237
00000100:00100000:2.0:1789760784.004673:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755582299677 time 755648252255 state 0x2 ref 0
00000100:00100000:3.0:1789760784.012779:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760784.013204:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521058048
00000100:00100000:0.0:1789760784.013284:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521058048
00000100:00100000:0.0:1789760784.013559:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755582299677 time 755648252255 state 0x0 ref 1
00000100:00100000:0.0:1789760784.013573:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755648512671 time 755648252255 state 0x1 ref 1
00000100:00100000:0.0:1789760784.013637:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755648512671 time 755700319324 state 0x0 ref 1
00000100:00100000:0.0:1789760784.013651:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760784.013702:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25415680, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:0.0:1789760784.013712:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.013728:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:0.0:1789760784.013732:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760784.013738:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.013752:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760784.014577:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:2.0:1789760784.046713:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973525 is committed
00002000:00010000:0.0:1789760784.046852:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25415680 -> 25419776
00010000:00010000:0.0:1789760784.046866:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.046878:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.046888:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.046895:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760784.046900:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.046909:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.046932:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.046940:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60dc8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25415680->25419775] (req 25415680->25419775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760784.047103:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33449us (34327us total) trans 4294973525 rc 0/0
00000100:00100000:0.0:1789760784.047114:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6238
00000100:00100000:0.0:1789760784.047124:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755648512671 time 755700319324 state 0x2 ref 0
00000100:00100000:0.0:1789760784.052708:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760784.052789:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521058176
00000100:00100000:1.0:1789760784.052800:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521058176
00000100:00100000:1.0:1789760784.052860:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755648512671 time 755700319324 state 0x0 ref 1
00000100:00100000:1.0:1789760784.052875:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755700579740 time 755700319324 state 0x1 ref 1
00000100:00100000:1.0:1789760784.052966:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755700579740 time 755739638848 state 0x0 ref 1
00000100:00100000:1.0:1789760784.052988:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760784.053039:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25419776, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:1.0:1789760784.053049:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.053065:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:1.0:1789760784.053069:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760784.053076:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.053090:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760784.100649:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25419776 -> 25423872
00010000:00010000:1.0:1789760784.100670:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.100683:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.100691:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.100699:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760784.100704:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.100714:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.100732:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.100740:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dc93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25419776->25423871] (req 25419776->25423871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760784.100835:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521058176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47853us (48133us total) trans 4294973526 rc 0/0
00000100:00100000:1.0:1789760784.100850:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6239
00000100:00100000:1.0:1789760784.100860:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755700579740 time 755739638848 state 0x2 ref 0
00000001:00080000:2.0:1789760784.101615:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973526 is committed
00000100:00100000:2.0:1789760784.104455:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760784.104807:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521058304
00000100:00100000:3.0:1789760784.104817:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521058304
00000100:00100000:3.0:1789760784.104871:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755700579740 time 755739638848 state 0x0 ref 1
00000100:00100000:3.0:1789760784.104886:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755739899264 time 755739638848 state 0x1 ref 1
00000100:00100000:3.0:1789760784.104917:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755739899264 time 755791599779 state 0x0 ref 1
00000100:00100000:3.0:1789760784.104931:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760784.105151:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25423872, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:3.0:1789760784.105160:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.105176:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:3.0:1789760784.105180:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760784.105187:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.105202:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760784.142692:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973527 is committed
00002000:00010000:1.0:1789760784.143539:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25423872 -> 25427968
00010000:00010000:1.0:1789760784.143558:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.143571:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.143581:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.143589:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760784.143595:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.143605:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.143623:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.143631:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60dc9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25423872->25427967] (req 25423872->25427967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760784.143776:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38842us (39325us total) trans 4294973527 rc 0/0
00000100:00100000:1.0:1789760784.143787:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6240
00000100:00100000:1.0:1789760784.143796:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755739899264 time 755791599779 state 0x2 ref 0
00000100:00100000:3.0:1789760784.148706:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760784.149027:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521058432
00000100:00100000:2.0:1789760784.149036:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521058432
00000100:00100000:2.0:1789760784.149086:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755739899264 time 755791599779 state 0x0 ref 1
00000100:00100000:2.0:1789760784.150154:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755791860195 time 755791599779 state 0x1 ref 1
00000100:00100000:2.0:1789760784.150247:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755791860195 time 755836922882 state 0x0 ref 1
00000100:00100000:2.0:1789760784.150266:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760784.150330:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25427968, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:2.0:1789760784.150338:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.150354:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:2.0:1789760784.150358:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760784.150364:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.150376:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760784.188309:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973528 is committed
00002000:00010000:2.0:1789760784.188567:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25427968 -> 25432064
00010000:00010000:2.0:1789760784.188581:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.188695:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.188702:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.188707:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760784.188710:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.188717:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.188734:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.188740:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dca1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25427968->25432063] (req 25427968->25432063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760784.188885:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38619us (40181us total) trans 4294973528 rc 0/0
00000100:00100000:2.0:1789760784.188896:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6241
00000100:00100000:2.0:1789760784.188906:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755791860195 time 755836922882 state 0x2 ref 0
00000100:00100000:0.0:1789760784.194503:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760784.194707:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521058560
00000100:00100000:2.0:1789760784.194718:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521058560
00000100:00100000:2.0:1789760784.194772:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755791860195 time 755836922882 state 0x0 ref 1
00000100:00100000:2.0:1789760784.194787:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755837183298 time 755836922882 state 0x1 ref 1
00000100:00100000:2.0:1789760784.194820:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755837183298 time 755881502534 state 0x0 ref 1
00000100:00100000:2.0:1789760784.194832:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521058560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760784.194880:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25432064, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:2.0:1789760784.194889:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.194904:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:2.0:1789760784.194908:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760784.194914:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.194928:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760784.235376:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973529 is committed
00002000:00010000:2.0:1789760784.235591:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25432064 -> 25436160
00010000:00010000:2.0:1789760784.235609:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.235623:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.235638:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.235646:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760784.235651:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.235660:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.235678:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.235686:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dca8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25432064->25436159] (req 25432064->25436159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760784.235800:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521058560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40966us (41303us total) trans 4294973529 rc 0/0
00000100:00100000:2.0:1789760784.235809:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6242
00000100:00100000:2.0:1789760784.235816:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755837183298 time 755881502534 state 0x2 ref 0
00000100:00100000:0.0:1789760784.238898:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760784.238984:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521058688
00000100:00100000:1.0:1789760784.238994:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521058688
00000100:00100000:1.0:1789760784.239048:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755837183298 time 755881502534 state 0x0 ref 1
00000100:00100000:1.0:1789760784.239074:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755881762950 time 755881502534 state 0x1 ref 1
00000100:00100000:1.0:1789760784.239105:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755881762950 time 755925786685 state 0x0 ref 1
00000100:00100000:1.0:1789760784.239118:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760784.239160:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25436160, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:1.0:1789760784.239166:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.239179:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:1.0:1789760784.239182:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760784.239186:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.239200:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760784.271772:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973530 is committed
00002000:00010000:1.0:1789760784.271947:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25436160 -> 25440256
00010000:00010000:1.0:1789760784.271978:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.271990:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.271998:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.272005:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760784.272010:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.272019:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.272039:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.272047:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25436160->25440255] (req 25436160->25440255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760784.272152:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33032us (33258us total) trans 4294973530 rc 0/0
00000100:00100000:1.0:1789760784.272163:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6243
00000100:00100000:1.0:1789760784.272172:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755881762950 time 755925786685 state 0x2 ref 0
00000100:00100000:3.0:1789760784.284364:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760784.284468:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521058816
00000100:00100000:1.0:1789760784.284478:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521058816
00000100:00100000:1.0:1789760784.284529:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755881762950 time 755925786685 state 0x0 ref 1
00000100:00100000:1.0:1789760784.284552:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755926047101 time 755925786685 state 0x1 ref 1
00000100:00100000:1.0:1789760784.284584:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755926047101 time 755971266583 state 0x0 ref 1
00000100:00100000:1.0:1789760784.284596:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521058816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760784.284656:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25440256, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:1.0:1789760784.284667:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.284685:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=755s v=(0 0)
00010000:00010000:1.0:1789760784.284690:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760784.284697:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.284717:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760784.345822:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973531 is committed
00002000:00010000:3.0:1789760784.346045:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25440256 -> 25444352
00010000:00010000:3.0:1789760784.346060:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.346072:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.346083:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.346091:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760784.346096:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.346107:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.346129:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.346149:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dcb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25440256->25444351] (req 25440256->25444351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760784.346248:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521058816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61650us (62008us total) trans 4294973531 rc 0/0
00000100:00100000:3.0:1789760784.346259:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6244
00000100:00100000:3.0:1789760784.346268:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755926047101 time 755971266583 state 0x2 ref 0
00000100:00100000:1.0:1789760784.349907:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760784.351056:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521058944
00000100:00100000:2.0:1789760784.351068:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521058944
00000100:00100000:2.0:1789760784.351123:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755926047101 time 755971266583 state 0x0 ref 1
00000100:00100000:2.0:1789760784.351138:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755971526999 time 755971266583 state 0x1 ref 1
00000100:00100000:2.0:1789760784.351185:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755971526999 time 756037862091 state 0x0 ref 1
00000100:00100000:2.0:1789760784.351199:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760784.351247:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25444352, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:2.0:1789760784.351257:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.351271:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:2.0:1789760784.351276:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760784.351283:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.351296:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760784.391176:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973532 is committed
00002000:00010000:3.0:1789760784.391285:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25444352 -> 25448448
00010000:00010000:3.0:1789760784.391301:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.391347:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.391354:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.391359:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760784.391362:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.391368:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.391384:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.391389:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60dcbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25444352->25448447] (req 25444352->25448447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760784.391488:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521058944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40286us (41584us total) trans 4294973532 rc 0/0
00000100:00100000:3.0:1789760784.391497:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6245
00000100:00100000:3.0:1789760784.392065:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755971526999 time 756037862091 state 0x2 ref 0
00000100:00100000:0.0:1789760784.393907:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760784.394045:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521059072
00000100:00100000:2.0:1789760784.394113:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521059072
00000100:00100000:2.0:1789760784.394166:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 755971526999 time 756037862091 state 0x0 ref 1
00000100:00100000:2.0:1789760784.394188:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756038122507 time 756037862091 state 0x1 ref 1
00000100:00100000:2.0:1789760784.394215:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756038122507 time 756080897457 state 0x0 ref 1
00000100:00100000:2.0:1789760784.394226:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521059072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760784.394279:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25448448, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:2.0:1789760784.394288:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.394303:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:2.0:1789760784.394308:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760784.394383:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.394398:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760784.433740:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25448448 -> 25452544
00010000:00010000:1.0:1789760784.433762:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.433775:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.433783:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.433791:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760784.433797:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.433807:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.433827:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.433837:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60dcc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25448448->25452543] (req 25448448->25452543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760784.434635:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521059072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40402us (40727us total) trans 4294973533 rc 0/0
00000100:00100000:1.0:1789760784.434649:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6246
00000100:00100000:1.0:1789760784.434660:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756038122507 time 756080897457 state 0x2 ref 0
00000001:00080000:1.0:1789760784.434704:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973533 is committed
00000100:00100000:0.0:1789760784.443612:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760784.444668:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521059200
00000100:00100000:3.0:1789760784.444685:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521059200
00000100:00100000:3.0:1789760784.444771:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756038122507 time 756080897457 state 0x0 ref 1
00000100:00100000:3.0:1789760784.444793:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756081157873 time 756080897457 state 0x1 ref 1
00000100:00100000:3.0:1789760784.444847:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756081157873 time 756131528534 state 0x0 ref 1
00000100:00100000:3.0:1789760784.444862:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521059200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760784.444942:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25452544, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:3.0:1789760784.445247:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.445268:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:3.0:1789760784.445274:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760784.445282:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.445300:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760784.487252:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973534 is committed
00002000:00010000:3.0:1789760784.487360:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25452544 -> 25456640
00010000:00010000:3.0:1789760784.487377:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.487390:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.487406:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.487414:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760784.487431:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.487441:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.487460:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.487509:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dccb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25452544->25456639] (req 25452544->25456639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760784.487645:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521059200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42781us (44047us total) trans 4294973534 rc 0/0
00000100:00100000:3.0:1789760784.487656:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6247
00000100:00100000:3.0:1789760784.487715:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756081157873 time 756131528534 state 0x2 ref 0
00000100:00100000:2.0:1789760784.491497:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760784.491580:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521059328
00000100:00100000:3.0:1789760784.491590:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521059328
00000100:00100000:3.0:1789760784.491643:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756081157873 time 756131528534 state 0x0 ref 1
00000100:00100000:3.0:1789760784.491659:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756131788950 time 756131528534 state 0x1 ref 1
00000100:00100000:3.0:1789760784.491699:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756131788950 time 756178381150 state 0x0 ref 1
00000100:00100000:3.0:1789760784.491712:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521059328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760784.491761:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25456640, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:3.0:1789760784.491770:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.491786:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:3.0:1789760784.491791:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760784.491796:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.491811:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760784.537332:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973535 is committed
00002000:00010000:3.0:1789760784.537847:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25456640 -> 25460736
00010000:00010000:3.0:1789760784.537865:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.537879:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.537889:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.537897:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760784.537902:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.537912:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.537932:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.537941:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dcd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25456640->25460735] (req 25456640->25460735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760784.538140:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521059328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46422us (46643us total) trans 4294973535 rc 0/0
00000100:00100000:3.0:1789760784.538152:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6248
00000100:00100000:3.0:1789760784.538162:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756131788950 time 756178381150 state 0x2 ref 0
00000100:00100000:0.0:1789760784.544450:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760784.544600:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521059456
00000100:00100000:2.0:1789760784.544611:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521059456
00000100:00100000:2.0:1789760784.544663:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756131788950 time 756178381150 state 0x0 ref 1
00000100:00100000:2.0:1789760784.544679:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756178641566 time 756178381150 state 0x1 ref 1
00000100:00100000:2.0:1789760784.544760:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756178641566 time 756231441032 state 0x0 ref 1
00000100:00100000:2.0:1789760784.544773:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521059456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760784.544823:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25460736, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:2.0:1789760784.544832:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.544854:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:2.0:1789760784.544858:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760784.544865:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.544880:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760784.572761:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25460736 -> 25464832
00010000:00010000:3.0:1789760784.572781:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.572796:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.572806:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.572820:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760784.572826:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.572836:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.572854:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.572863:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dcd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25460736->25464831] (req 25460736->25464831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760784.572963:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521059456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28188us (28518us total) trans 4294973536 rc 0/0
00000100:00100000:3.0:1789760784.572973:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6249
00000100:00100000:3.0:1789760784.572982:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756178641566 time 756231441032 state 0x2 ref 0
00000001:00080000:0.0:1789760784.573655:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973536 is committed
00000100:00100000:0.0:1789760784.586596:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760784.586775:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521059584
00000100:00100000:1.0:1789760784.586784:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521059584
00000100:00100000:1.0:1789760784.586838:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756178641566 time 756231441032 state 0x0 ref 1
00000100:00100000:1.0:1789760784.586853:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756231701448 time 756231441032 state 0x1 ref 1
00000100:00100000:1.0:1789760784.586927:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756231701448 time 756273609850 state 0x0 ref 1
00000100:00100000:1.0:1789760784.586951:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521059584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760784.587000:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25464832, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:1.0:1789760784.587009:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.587026:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:1.0:1789760784.587031:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760784.587036:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.587060:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760784.626619:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973537 is committed
00002000:00010000:1.0:1789760784.626812:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25464832 -> 25468928
00010000:00010000:1.0:1789760784.626828:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.626841:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.626851:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.626859:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760784.626864:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.626873:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.626892:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.626900:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60dce0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25464832->25468927] (req 25464832->25468927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760784.626998:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521059584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40049us (40407us total) trans 4294973537 rc 0/0
00000100:00100000:1.0:1789760784.627011:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6250
00000100:00100000:1.0:1789760784.627020:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756231701448 time 756273609850 state 0x2 ref 0
00000100:00100000:1.0:1789760784.630558:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760784.630640:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521059712
00000100:00100000:3.0:1789760784.630650:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521059712
00000100:00100000:3.0:1789760784.630706:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756231701448 time 756273609850 state 0x0 ref 1
00000100:00100000:3.0:1789760784.630721:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756273870266 time 756273609850 state 0x1 ref 1
00000100:00100000:3.0:1789760784.630756:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756273870266 time 756317438268 state 0x0 ref 1
00000100:00100000:3.0:1789760784.630772:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521059712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760784.630818:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25468928, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:3.0:1789760784.630827:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.630842:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:3.0:1789760784.630847:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760784.630855:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.630869:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760784.655192:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25468928 -> 25473024
00010000:00010000:3.0:1789760784.655213:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.655227:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.655236:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.655243:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760784.655248:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.655257:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.655276:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.655284:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dce7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25468928->25473023] (req 25468928->25473023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760784.655432:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521059712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24648us (24868us total) trans 4294973538 rc 0/0
00000100:00100000:3.0:1789760784.655443:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6251
00000100:00100000:3.0:1789760784.655452:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756273870266 time 756317438268 state 0x2 ref 0
00000001:00080000:0.0:1789760784.656081:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973538 is committed
00000100:00100000:0.0:1789760784.660741:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760784.660852:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521059840
00000100:00100000:3.0:1789760784.660862:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521059840
00000100:00100000:3.0:1789760784.660917:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756273870266 time 756317438268 state 0x0 ref 1
00000100:00100000:3.0:1789760784.660932:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756317698684 time 756317438268 state 0x1 ref 1
00000100:00100000:3.0:1789760784.660961:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756317698684 time 756347644081 state 0x0 ref 1
00000100:00100000:3.0:1789760784.660972:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521059840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760784.661019:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25473024, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:3.0:1789760784.661029:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.661047:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:3.0:1789760784.661051:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760784.661058:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.661072:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760784.691000:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973539 is committed
00002000:00010000:3.0:1789760784.691000:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25473024 -> 25477120
00010000:00010000:3.0:1789760784.691019:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.691032:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.691042:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.691050:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760784.691055:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.691064:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.691088:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.691097:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dcee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25473024->25477119] (req 25473024->25477119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760784.691227:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521059840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30251us (30493us total) trans 4294973539 rc 0/0
00000100:00100000:3.0:1789760784.691240:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6252
00000100:00100000:3.0:1789760784.691252:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756317698684 time 756347644081 state 0x2 ref 0
00000100:00100000:3.0:1789760784.696756:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760784.696854:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521059968
00000100:00100000:2.0:1789760784.696864:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521059968
00000100:00100000:2.0:1789760784.696916:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756317698684 time 756347644081 state 0x0 ref 1
00000100:00100000:2.0:1789760784.696931:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756347904497 time 756347644081 state 0x1 ref 1
00000100:00100000:2.0:1789760784.696991:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756347904497 time 756383673466 state 0x0 ref 1
00000100:00100000:2.0:1789760784.697008:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521059968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760784.697246:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25477120, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:2.0:1789760784.697255:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.697271:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:2.0:1789760784.697275:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760784.697281:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.697299:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760784.720448:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25477120 -> 25481216
00010000:00010000:0.0:1789760784.720530:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.720543:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.720552:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.720559:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760784.720564:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.720572:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.720591:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.720599:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dcf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25477120->25481215] (req 25477120->25481215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760784.720694:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521059968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 23682us (23942us total) trans 4294973540 rc 0/0
00000100:00100000:0.0:1789760784.720705:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6253
00000100:00100000:0.0:1789760784.720716:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756347904497 time 756383673466 state 0x2 ref 0
00000001:00080000:1.0:1789760784.721148:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973540 is committed
00000100:00100000:1.0:1789760784.727355:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760784.727845:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521060096
00000100:00100000:2.0:1789760784.727856:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521060096
00000100:00100000:2.0:1789760784.727918:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756347904497 time 756383673466 state 0x0 ref 1
00000100:00100000:2.0:1789760784.727933:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756383933882 time 756383673466 state 0x1 ref 1
00000100:00100000:2.0:1789760784.727958:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756383933882 time 756414641131 state 0x0 ref 1
00000100:00100000:2.0:1789760784.727970:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521060096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760784.728019:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25481216, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:2.0:1789760784.728027:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.728043:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:2.0:1789760784.728047:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760784.728054:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.728067:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760784.771352:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973541 is committed
00002000:00010000:3.0:1789760784.771469:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25481216 -> 25485312
00010000:00010000:3.0:1789760784.771485:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.771497:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.771506:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.771513:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760784.771517:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.771527:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.771548:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760784.771556:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dcfc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25481216->25485311] (req 25481216->25485311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760784.771649:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521060096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43675us (44336us total) trans 4294973541 rc 0/0
00000100:00100000:3.0:1789760784.771660:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6254
00000100:00100000:3.0:1789760784.771670:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756383933882 time 756414641131 state 0x2 ref 0
00000100:00100000:3.0:1789760784.777644:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760784.777797:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521060224
00000100:00100000:1.0:1789760784.777811:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521060224
00000100:00100000:1.0:1789760784.777896:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756383933882 time 756414641131 state 0x0 ref 1
00000100:00100000:1.0:1789760784.777915:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756414901547 time 756414641131 state 0x1 ref 1
00000100:00100000:1.0:1789760784.777965:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756414901547 time 756464647517 state 0x0 ref 1
00000100:00100000:1.0:1789760784.777979:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521060224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760784.778043:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25485312, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:1.0:1789760784.778126:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.778145:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:1.0:1789760784.778152:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760784.778159:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.778176:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760784.830140:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973542 is committed
00002000:00010000:0.0:1789760784.832268:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25485312 -> 25489408
00010000:00010000:0.0:1789760784.832296:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.832357:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.832369:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.832377:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760784.832382:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.832393:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.832428:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.832438:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60dd03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25485312->25489407] (req 25485312->25489407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760784.832575:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521060224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54591us (54936us total) trans 4294973542 rc 0/0
00000100:00100000:0.0:1789760784.832591:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6255
00000100:00100000:0.0:1789760784.832605:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756414901547 time 756464647517 state 0x2 ref 0
00000100:00100000:2.0:1789760784.835937:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760784.836091:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521060352
00000100:00100000:3.0:1789760784.836101:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521060352
00000100:00100000:3.0:1789760784.836155:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756414901547 time 756464647517 state 0x0 ref 1
00000100:00100000:3.0:1789760784.836169:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756464907933 time 756464647517 state 0x1 ref 1
00000100:00100000:2.0:1789760784.836289:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756464907933 time 756522969439 state 0x0 ref 1
00000100:00100000:2.0:1789760784.836304:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521060352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760784.836590:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25489408, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:2.0:1789760784.836601:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.836616:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:2.0:1789760784.836620:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760784.836627:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.836641:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760784.875169:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25489408 -> 25493504
00010000:00010000:2.0:1789760784.875190:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.875268:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.875278:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.875285:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760784.875290:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.875301:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.875791:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760784.875801:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dd0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25489408->25493503] (req 25489408->25493503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760784.875923:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521060352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39618us (39990us total) trans 4294973543 rc 0/0
00000100:00100000:2.0:1789760784.875934:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6256
00000100:00100000:2.0:1789760784.875988:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756464907933 time 756522969439 state 0x2 ref 0
00000001:00080000:1.0:1789760784.877269:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973543 is committed
00000100:00100000:1.0:1789760784.879657:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760784.879750:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521060480
00000100:00100000:0.0:1789760784.879759:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521060480
00000100:00100000:0.0:1789760784.879812:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756464907933 time 756522969439 state 0x0 ref 1
00000100:00100000:0.0:1789760784.879826:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756523229855 time 756522969439 state 0x1 ref 1
00000100:00100000:0.0:1789760784.879856:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756523229855 time 756566538361 state 0x0 ref 1
00000100:00100000:0.0:1789760784.879867:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521060480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760784.879917:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25493504, mtime: 0x6aad9511, atime: 0x0, ctime: 0x6aad9511, blocks: 0xc807
00010000:00010000:0.0:1789760784.879926:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.880004:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:0.0:1789760784.880010:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760784.880017:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.880031:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760784.929343:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973544 is committed
00002000:00010000:0.0:1789760784.929463:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25493504 -> 25497600
00002000:00010000:0.0:1789760784.929467:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760785 -> 1789760786
00002000:00010000:0.0:1789760784.929469:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760785 -> 1789760786
00010000:00010000:0.0:1789760784.929482:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.929500:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.929517:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.929525:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760784.929529:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.929538:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.929724:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.929732:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25493504->25497599] (req 25493504->25497599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760784.929828:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521060480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49957us (50175us total) trans 4294973544 rc 0/0
00000100:00100000:0.0:1789760784.929839:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6257
00000100:00100000:0.0:1789760784.929848:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756523229855 time 756566538361 state 0x2 ref 0
00000100:00100000:3.0:1789760784.938193:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760784.939270:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521060608
00000100:00100000:0.0:1789760784.939281:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521060608
00000100:00100000:0.0:1789760784.939426:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756523229855 time 756566538361 state 0x0 ref 1
00000100:00100000:0.0:1789760784.939443:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756566798777 time 756566538361 state 0x1 ref 1
00000100:00100000:0.0:1789760784.939477:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756566798777 time 756626159337 state 0x0 ref 1
00000100:00100000:0.0:1789760784.939490:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521060608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760784.939606:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25497600, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:0.0:1789760784.939616:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.939631:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:0.0:1789760784.939636:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760784.939643:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.939659:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760784.956403:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760784.994308:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973545 is committed
00002000:00010000:1.0:1789760784.994392:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25497600 -> 25501696
00010000:00010000:1.0:1789760784.994408:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.994434:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.994443:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.994452:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760784.994457:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.994467:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.994487:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760784.994496:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fb248e0/0x4a99e02bc60dd18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25497600->25501695] (req 25497600->25501695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760784.994593:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521060608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55101us (56406us total) trans 4294973545 rc 0/0
00000100:00100000:1.0:1789760784.994604:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6258
00000100:00100000:1.0:1789760784.994613:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756566798777 time 756626159337 state 0x2 ref 0
00000100:00100000:2.0:1789760785.000236:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760785.000427:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521060736
00000100:00100000:1.0:1789760785.000436:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521060736
00000100:00100000:1.0:1789760785.000494:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756566798777 time 756626159337 state 0x0 ref 1
00000100:00100000:1.0:1789760785.000510:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756626419753 time 756626159337 state 0x1 ref 1
00000100:00100000:1.0:1789760785.000542:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756626419753 time 756687224547 state 0x0 ref 1
00000100:00100000:1.0:1789760785.000555:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521060736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760785.000604:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25501696, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:1.0:1789760785.000613:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.000629:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:1.0:1789760785.000634:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760785.000640:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.000654:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760785.034368:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973546 is committed
00002000:00010000:2.0:1789760785.034657:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25501696 -> 25505792
00010000:00010000:2.0:1789760785.034673:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.034685:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.034695:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.034708:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760785.034714:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.034723:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.034740:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.034747:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dd1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25501696->25505791] (req 25501696->25505791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760785.034840:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521060736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34282us (34608us total) trans 4294973546 rc 0/0
00000100:00100000:2.0:1789760785.034859:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6259
00000100:00100000:2.0:1789760785.034869:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756626419753 time 756687224547 state 0x2 ref 0
00000100:00100000:2.0:1789760785.047085:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760785.050006:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521060864
00000100:00100000:3.0:1789760785.050021:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521060864
00000100:00100000:3.0:1789760785.050087:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756626419753 time 756687224547 state 0x0 ref 1
00000100:00100000:3.0:1789760785.050103:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756687484963 time 756687224547 state 0x1 ref 1
00000100:00100000:3.0:1789760785.050139:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756687484963 time 756736821010 state 0x0 ref 1
00000100:00100000:3.0:1789760785.050152:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521060864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760785.050198:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25505792, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:3.0:1789760785.050208:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.050222:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:3.0:1789760785.050227:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760785.050234:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.050248:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760785.081464:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973547 is committed
00002000:00010000:3.0:1789760785.081568:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25505792 -> 25509888
00010000:00010000:3.0:1789760785.081584:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.081597:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.081606:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.081613:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760785.081617:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.081626:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.081645:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.081653:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25505792->25509887] (req 25505792->25509887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760785.081746:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521060864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31592us (34771us total) trans 4294973547 rc 0/0
00000100:00100000:3.0:1789760785.081756:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6260
00000100:00100000:3.0:1789760785.081765:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756687484963 time 756736821010 state 0x2 ref 0
00000100:00100000:3.0:1789760785.091651:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760785.091753:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521060992
00000100:00100000:0.0:1789760785.091762:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521060992
00000100:00100000:0.0:1789760785.091813:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756687484963 time 756736821010 state 0x0 ref 1
00000100:00100000:0.0:1789760785.091829:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756737081426 time 756736821010 state 0x1 ref 1
00000100:00100000:0.0:1789760785.091870:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756737081426 time 756778552580 state 0x0 ref 1
00000100:00100000:0.0:1789760785.091891:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521060992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760785.091939:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25509888, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:0.0:1789760785.091957:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.092135:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:0.0:1789760785.092142:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760785.092149:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.092164:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760785.138232:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973548 is committed
00002000:00010000:0.0:1789760785.138468:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25509888 -> 25513984
00010000:00010000:0.0:1789760785.138484:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.138499:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.138509:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.138518:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760785.138524:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.138533:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.138552:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.138560:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25509888->25513983] (req 25509888->25513983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760785.138649:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521060992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46763us (47002us total) trans 4294973548 rc 0/0
00000100:00100000:0.0:1789760785.138659:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6261
00000100:00100000:0.0:1789760785.138669:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756737081426 time 756778552580 state 0x2 ref 0
00000100:00100000:0.0:1789760785.142461:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760785.142545:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521061120
00000100:00100000:1.0:1789760785.142555:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521061120
00000100:00100000:1.0:1789760785.142606:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756737081426 time 756778552580 state 0x0 ref 1
00000100:00100000:1.0:1789760785.142621:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756778812996 time 756778552580 state 0x1 ref 1
00000100:00100000:1.0:1789760785.142696:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756778812996 time 756829377741 state 0x0 ref 1
00000100:00100000:1.0:1789760785.142709:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521061120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760785.142757:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25513984, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:1.0:1789760785.142765:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.142781:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:1.0:1789760785.142785:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760785.142792:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.142805:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760785.178481:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973549 is committed
00002000:00010000:2.0:1789760785.178576:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25513984 -> 25518080
00010000:00010000:2.0:1789760785.178591:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.178604:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.178619:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.178627:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760785.178632:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.178641:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.178660:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.178668:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60dd34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25513984->25518079] (req 25513984->25518079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760785.178789:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521061120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36078us (36333us total) trans 4294973549 rc 0/0
00000100:00100000:2.0:1789760785.178799:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6262
00000100:00100000:2.0:1789760785.178809:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756778812996 time 756829377741 state 0x2 ref 0
00000100:00100000:2.0:1789760785.185177:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760785.188718:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521061248
00000100:00100000:1.0:1789760785.188732:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521061248
00000100:00100000:0.0:1789760785.189012:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756778812996 time 756829377741 state 0x0 ref 1
00000100:00100000:0.0:1789760785.189028:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756829638157 time 756829377741 state 0x1 ref 1
00000100:00100000:0.0:1789760785.189064:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756829638157 time 756875746698 state 0x0 ref 1
00000100:00100000:0.0:1789760785.189078:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521061248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760785.189126:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25518080, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:0.0:1789760785.189142:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.189158:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:0.0:1789760785.189162:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760785.189169:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.189183:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760785.240971:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973550 is committed
00002000:00010000:1.0:1789760785.241139:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25518080 -> 25522176
00010000:00010000:1.0:1789760785.241155:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.241168:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.241178:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.241186:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760785.241191:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.241200:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.241219:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.241227:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60dd3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25518080->25522175] (req 25518080->25522175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760785.241349:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521061248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52235us (56141us total) trans 4294973550 rc 0/0
00000100:00100000:1.0:1789760785.241359:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6263
00000100:00100000:1.0:1789760785.241368:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756829638157 time 756875746698 state 0x2 ref 0
00000100:00100000:3.0:1789760785.245728:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760785.246114:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521061376
00000100:00100000:2.0:1789760785.246125:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521061376
00000100:00100000:2.0:1789760785.246181:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756829638157 time 756875746698 state 0x0 ref 1
00000100:00100000:2.0:1789760785.246200:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756876007114 time 756875746698 state 0x1 ref 1
00000100:00100000:2.0:1789760785.246231:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756876007114 time 756932913354 state 0x0 ref 1
00000100:00100000:2.0:1789760785.246243:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521061376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760785.246288:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25522176, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:2.0:1789760785.246297:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.246329:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:2.0:1789760785.246335:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760785.246341:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.246355:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760785.283203:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973551 is committed
00002000:00010000:3.0:1789760785.283292:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25522176 -> 25526272
00010000:00010000:3.0:1789760785.283308:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.283387:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.283396:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.283404:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760785.283409:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.283427:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.283448:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.283456:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dd42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25522176->25526271] (req 25522176->25526271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760785.283582:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521061376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37336us (37859us total) trans 4294973551 rc 0/0
00000100:00100000:3.0:1789760785.283592:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6264
00000100:00100000:3.0:1789760785.283602:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756876007114 time 756932913354 state 0x2 ref 0
00000100:00100000:0.0:1789760785.287086:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760785.287516:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521061504
00000100:00100000:2.0:1789760785.287526:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521061504
00000100:00100000:2.0:1789760785.287689:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756876007114 time 756932913354 state 0x0 ref 1
00000100:00100000:2.0:1789760785.287708:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756933173770 time 756932913354 state 0x1 ref 1
00000100:00100000:1.0:1789760785.287826:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756933173770 time 756974506360 state 0x0 ref 1
00000100:00100000:1.0:1789760785.287841:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521061504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760785.287889:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25526272, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:1.0:1789760785.287898:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.287914:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=756s v=(0 0)
00010000:00010000:1.0:1789760785.287918:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760785.287925:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.287938:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760785.337114:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25526272 -> 25530368
00010000:00010000:1.0:1789760785.337132:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.337145:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.337154:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.337161:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760785.337166:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.337176:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.337197:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.337206:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25526272->25530367] (req 25526272->25530367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760785.337375:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521061504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49533us (50292us total) trans 4294973552 rc 0/0
00000100:00100000:1.0:1789760785.337388:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6265
00000100:00100000:1.0:1789760785.337398:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756933173770 time 756974506360 state 0x2 ref 0
00000001:00080000:1.0:1789760785.337445:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973552 is committed
00000100:00100000:2.0:1789760785.341821:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760785.341899:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521061632
00000100:00100000:3.0:1789760785.341909:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521061632
00000100:00100000:3.0:1789760785.341973:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756933173770 time 756974506360 state 0x0 ref 1
00000100:00100000:3.0:1789760785.341990:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756974766776 time 756974506360 state 0x1 ref 1
00000100:00100000:3.0:1789760785.342020:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756974766776 time 757028702522 state 0x0 ref 1
00000100:00100000:3.0:1789760785.342037:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521061632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760785.342083:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25530368, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:3.0:1789760785.342092:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.342115:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:3.0:1789760785.342119:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760785.342125:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.342137:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760785.381873:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973553 is committed
00002000:00010000:2.0:1789760785.386042:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25530368 -> 25534464
00010000:00010000:2.0:1789760785.386063:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.386078:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.386087:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.386093:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760785.386097:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.386105:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.386125:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.386131:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dd50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25530368->25534463] (req 25530368->25534463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760785.386398:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521061632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44357us (44580us total) trans 4294973553 rc 0/0
00000100:00100000:2.0:1789760785.386408:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6266
00000100:00100000:2.0:1789760785.386428:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756974766776 time 757028702522 state 0x2 ref 0
00000100:00100000:1.0:1789760785.399605:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760785.399757:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521061760
00000100:00100000:0.0:1789760785.399768:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521061760
00000100:00100000:0.0:1789760785.399822:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 756974766776 time 757028702522 state 0x0 ref 1
00000100:00100000:0.0:1789760785.399837:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757028962938 time 757028702522 state 0x1 ref 1
00000100:00100000:0.0:1789760785.399867:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757028962938 time 757086550034 state 0x0 ref 1
00000100:00100000:0.0:1789760785.399880:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521061760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760785.399930:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25534464, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:0.0:1789760785.400054:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.400071:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:0.0:1789760785.400076:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760785.400084:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.400098:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760785.436628:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25534464 -> 25538560
00010000:00010000:2.0:1789760785.436648:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.436661:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.436670:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.436677:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760785.436681:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.436689:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.436707:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.436715:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60dd57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25534464->25538559] (req 25534464->25538559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760785.436806:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521061760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36924us (37207us total) trans 4294973554 rc 0/0
00000100:00100000:2.0:1789760785.436816:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6267
00000100:00100000:2.0:1789760785.436826:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757028962938 time 757086550034 state 0x2 ref 0
00000001:00080000:3.0:1789760785.436911:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973554 is committed
00000100:00100000:2.0:1789760785.440077:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760785.440165:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521061888
00000100:00100000:3.0:1789760785.440175:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521061888
00000100:00100000:3.0:1789760785.440229:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757028962938 time 757086550034 state 0x0 ref 1
00000100:00100000:3.0:1789760785.440244:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757086810450 time 757086550034 state 0x1 ref 1
00000100:00100000:3.0:1789760785.440274:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757086810450 time 757126957018 state 0x0 ref 1
00000100:00100000:3.0:1789760785.440286:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521061888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760785.440359:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25538560, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:3.0:1789760785.440369:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.440384:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:3.0:1789760785.440393:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760785.440399:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.440421:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760785.476573:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25538560 -> 25542656
00010000:00010000:3.0:1789760785.476596:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.476609:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.476618:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.476626:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760785.476631:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.476639:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.476662:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.476670:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25538560->25542655] (req 25538560->25542655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760785.476768:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521061888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36478us (36695us total) trans 4294973555 rc 0/0
00000100:00100000:3.0:1789760785.476778:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6268
00000100:00100000:3.0:1789760785.476787:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757086810450 time 757126957018 state 0x2 ref 0
00000001:00080000:0.0:1789760785.476870:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973555 is committed
00000100:00100000:0.0:1789760785.480998:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760785.481250:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521062016
00000100:00100000:1.0:1789760785.481260:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521062016
00000100:00100000:1.0:1789760785.481353:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757086810450 time 757126957018 state 0x0 ref 1
00000100:00100000:1.0:1789760785.481369:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757127217434 time 757126957018 state 0x1 ref 1
00000100:00100000:1.0:1789760785.481398:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757127217434 time 757168080395 state 0x0 ref 1
00000100:00100000:1.0:1789760785.481420:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521062016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760785.481474:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25542656, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:1.0:1789760785.481484:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.481499:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:1.0:1789760785.481504:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760785.481510:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760785.481524:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760785.514938:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25542656 -> 25546752
00010000:00010000:0.0:1789760785.514971:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.514992:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.515008:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.515017:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760785.515022:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.515032:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.515052:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.515066:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dd65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25542656->25546751] (req 25542656->25546751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760785.515462:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521062016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34047us (34468us total) trans 4294973556 rc 0/0
00000100:00100000:0.0:1789760785.515474:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6269
00000100:00100000:0.0:1789760785.515483:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757127217434 time 757168080395 state 0x2 ref 0
00000001:00080000:0.0:1789760785.515525:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973556 is committed
00000100:00100000:2.0:1789760785.520785:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760785.520889:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521062144
00000100:00100000:3.0:1789760785.520899:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521062144
00000100:00100000:3.0:1789760785.520963:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757127217434 time 757168080395 state 0x0 ref 1
00000100:00100000:3.0:1789760785.520978:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757168340811 time 757168080395 state 0x1 ref 1
00000100:00100000:3.0:1789760785.521007:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757168340811 time 757207689616 state 0x0 ref 1
00000100:00100000:3.0:1789760785.521020:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521062144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760785.521068:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25546752, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:3.0:1789760785.521078:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.521094:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:3.0:1789760785.521098:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760785.521104:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.521117:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760785.560768:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25546752 -> 25550848
00010000:00010000:0.0:1789760785.560797:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.560810:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.560819:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.560827:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760785.560832:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.560842:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.560865:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.560873:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60dd6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25546752->25550847] (req 25546752->25550847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760785.561617:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521062144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40592us (40835us total) trans 4294973557 rc 0/0
00000100:00100000:0.0:1789760785.561630:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6270
00000100:00100000:0.0:1789760785.561639:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757168340811 time 757207689616 state 0x2 ref 0
00000001:00080000:0.0:1789760785.561689:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973557 is committed
00000100:00100000:2.0:1789760785.567956:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760785.568054:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521062272
00000100:00100000:0.0:1789760785.568065:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521062272
00000100:00100000:0.0:1789760785.568131:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757168340811 time 757207689616 state 0x0 ref 1
00000100:00100000:0.0:1789760785.568145:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757207950032 time 757207689616 state 0x1 ref 1
00000100:00100000:0.0:1789760785.568178:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757207950032 time 757254860223 state 0x0 ref 1
00000100:00100000:0.0:1789760785.568191:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521062272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760785.568240:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25550848, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:0.0:1789760785.568250:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.568269:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:0.0:1789760785.568273:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760785.568279:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.568291:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760785.628011:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973558 is committed
00002000:00010000:2.0:1789760785.628169:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25550848 -> 25554944
00010000:00010000:2.0:1789760785.628185:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.628198:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.628206:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.628213:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760785.628218:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.628226:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.628244:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.628250:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25550848->25554943] (req 25550848->25554943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760785.628376:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521062272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60182us (60424us total) trans 4294973558 rc 0/0
00000100:00100000:2.0:1789760785.628388:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6271
00000100:00100000:2.0:1789760785.628397:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757207950032 time 757254860223 state 0x2 ref 0
00000100:00100000:2.0:1789760785.640044:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760785.640133:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521062400
00000100:00100000:3.0:1789760785.640151:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521062400
00000100:00100000:3.0:1789760785.640203:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757207950032 time 757254860223 state 0x0 ref 1
00000100:00100000:3.0:1789760785.640218:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757255120639 time 757254860223 state 0x1 ref 1
00000100:00100000:3.0:1789760785.640249:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757255120639 time 757326931653 state 0x0 ref 1
00000100:00100000:3.0:1789760785.640261:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521062400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760785.640358:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25554944, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:3.0:1789760785.640369:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.640383:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:3.0:1789760785.640388:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760785.640394:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.640416:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760785.698923:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973559 is committed
00002000:00010000:2.0:1789760785.699877:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25554944 -> 25559040
00010000:00010000:2.0:1789760785.699893:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.699907:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.699916:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.699924:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760785.699928:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.700088:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.700166:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.700175:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dd7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25554944->25559039] (req 25554944->25559039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760785.700283:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521062400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60019us (60243us total) trans 4294973559 rc 0/0
00000100:00100000:2.0:1789760785.700293:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6272
00000100:00100000:2.0:1789760785.700302:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757255120639 time 757326931653 state 0x2 ref 0
00000100:00100000:1.0:1789760785.709625:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760785.709815:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521062528
00000100:00100000:0.0:1789760785.709826:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521062528
00000100:00100000:0.0:1789760785.709882:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757255120639 time 757326931653 state 0x0 ref 1
00000100:00100000:0.0:1789760785.709898:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757327192069 time 757326931653 state 0x1 ref 1
00000100:00100000:0.0:1789760785.709933:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757327192069 time 757396614840 state 0x0 ref 1
00000100:00100000:0.0:1789760785.709946:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521062528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760785.710000:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25559040, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:0.0:1789760785.710010:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.710025:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:0.0:1789760785.710029:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760785.710036:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.710051:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760785.753173:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973560 is committed
00002000:00010000:0.0:1789760785.753273:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25559040 -> 25563136
00010000:00010000:0.0:1789760785.753289:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.753301:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.753310:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.753337:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760785.753342:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.753351:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.753368:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.753376:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60dd81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25559040->25563135] (req 25559040->25563135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760785.753481:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521062528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43533us (43862us total) trans 4294973560 rc 0/0
00000100:00100000:0.0:1789760785.753490:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6273
00000100:00100000:0.0:1789760785.753499:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757327192069 time 757396614840 state 0x2 ref 0
00000100:00100000:1.0:1789760785.757979:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760785.758107:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521062656
00000100:00100000:0.0:1789760785.758117:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521062656
00000100:00100000:0.0:1789760785.758169:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757327192069 time 757396614840 state 0x0 ref 1
00000100:00100000:0.0:1789760785.758184:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757396875256 time 757396614840 state 0x1 ref 1
00000100:00100000:0.0:1789760785.758262:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757396875256 time 757444943795 state 0x0 ref 1
00000100:00100000:0.0:1789760785.758274:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521062656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760785.758358:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25563136, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:0.0:1789760785.758366:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.758379:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:0.0:1789760785.758384:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760785.758390:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.758403:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760785.800905:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25563136 -> 25567232
00010000:00010000:0.0:1789760785.800923:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.800935:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.800955:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.800962:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760785.800966:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.800975:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.800992:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.800999:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60dd88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25563136->25567231] (req 25563136->25567231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760785.801101:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521062656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42824us (43135us total) trans 4294973561 rc 0/0
00000100:00100000:0.0:1789760785.801115:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6274
00000100:00100000:0.0:1789760785.801125:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757396875256 time 757444943795 state 0x2 ref 0
00000001:00080000:2.0:1789760785.805161:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973561 is committed
00000100:00100000:0.0:1789760785.805893:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760785.805977:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521062784
00000100:00100000:3.0:1789760785.805987:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521062784
00000100:00100000:3.0:1789760785.806054:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757396875256 time 757444943795 state 0x0 ref 1
00000100:00100000:3.0:1789760785.806070:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757445204211 time 757444943795 state 0x1 ref 1
00000100:00100000:3.0:1789760785.806096:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757445204211 time 757492779150 state 0x0 ref 1
00000100:00100000:3.0:1789760785.806108:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521062784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760785.806155:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25567232, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:3.0:1789760785.806165:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.806181:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:3.0:1789760785.806186:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760785.806192:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.806206:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760785.848693:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25567232 -> 25571328
00010000:00010000:0.0:1789760785.848714:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.848728:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.848738:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.848746:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760785.848752:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.848762:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.848781:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.848789:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60dd8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25567232->25571327] (req 25567232->25571327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760785.848892:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521062784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42782us (43003us total) trans 4294973562 rc 0/0
00000100:00100000:0.0:1789760785.848904:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6275
00000100:00100000:0.0:1789760785.848913:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757445204211 time 757492779150 state 0x2 ref 0
00000001:00080000:1.0:1789760785.849209:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973562 is committed
00000100:00100000:1.0:1789760785.855173:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760785.855273:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521062912
00000100:00100000:2.0:1789760785.855283:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521062912
00000100:00100000:2.0:1789760785.855449:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757445204211 time 757492779150 state 0x0 ref 1
00000100:00100000:2.0:1789760785.855465:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757493039566 time 757492779150 state 0x1 ref 1
00000100:00100000:2.0:1789760785.855524:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757493039566 time 757542205835 state 0x0 ref 1
00000100:00100000:2.0:1789760785.855537:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521062912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760785.855587:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25571328, mtime: 0x6aad9512, atime: 0x0, ctime: 0x6aad9512, blocks: 0xc807
00010000:00010000:2.0:1789760785.855597:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.855613:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:2.0:1789760785.855618:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760785.855624:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.855637:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760785.906486:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973563 is committed
00002000:00010000:2.0:1789760785.906926:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25571328 -> 25575424
00002000:00010000:2.0:1789760785.906931:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760786 -> 1789760787
00002000:00010000:2.0:1789760785.906934:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760786 -> 1789760787
00010000:00010000:2.0:1789760785.906958:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.906970:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.906979:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.906987:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760785.906992:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.907001:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.907020:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.907028:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25571328->25575423] (req 25571328->25575423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760785.907300:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521062912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51760us (52131us total) trans 4294973563 rc 0/0
00000100:00100000:2.0:1789760785.907348:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6276
00000100:00100000:2.0:1789760785.907358:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757493039566 time 757542205835 state 0x2 ref 0
00000100:00100000:2.0:1789760785.912001:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760785.918397:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521063040
00000100:00100000:0.0:1789760785.918423:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521063040
00000100:00100000:2.0:1789760785.918578:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757493039566 time 757542205835 state 0x0 ref 1
00000100:00100000:2.0:1789760785.918595:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757542466251 time 757542205835 state 0x1 ref 1
00000100:00100000:2.0:1789760785.918626:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757542466251 time 757605308590 state 0x0 ref 1
00000100:00100000:2.0:1789760785.918639:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521063040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760785.918701:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25575424, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:2.0:1789760785.918710:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.918725:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:2.0:1789760785.918729:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760785.918735:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760785.918749:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760785.978772:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760785.979114:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973564 is committed
00002000:00010000:3.0:1789760785.979906:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25575424 -> 25579520
00010000:00010000:3.0:1789760785.979921:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.979997:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.980008:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.980015:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760785.980020:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.980029:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.980048:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.980056:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60dd9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25575424->25579519] (req 25575424->25579519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760785.980513:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521063040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61870us (68573us total) trans 4294973564 rc 0/0
00000100:00100000:3.0:1789760785.980525:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6277
00000100:00100000:3.0:1789760785.980535:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757542466251 time 757605308590 state 0x2 ref 0
00000100:00100000:0.0:1789760785.989740:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760785.989874:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521063168
00000100:00100000:3.0:1789760785.989884:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521063168
00000100:00100000:3.0:1789760785.989938:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757542466251 time 757605308590 state 0x0 ref 1
00000100:00100000:3.0:1789760785.989965:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757605569006 time 757605308590 state 0x1 ref 1
00000100:00100000:3.0:1789760785.989998:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757605569006 time 757676680425 state 0x0 ref 1
00000100:00100000:3.0:1789760785.990012:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521063168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760785.990060:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25579520, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760785.990069:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.990085:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:3.0:1789760785.990089:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760785.990096:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760785.990110:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760786.028765:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973565 is committed
00002000:00010000:3.0:1789760786.029152:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25579520 -> 25583616
00010000:00010000:3.0:1789760786.029169:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.029182:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.029197:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.029205:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.029210:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.029219:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.029238:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.029244:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dda4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25579520->25583615] (req 25579520->25583615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.029571:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521063168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39555us (39834us total) trans 4294973565 rc 0/0
00000100:00100000:3.0:1789760786.029583:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6278
00000100:00100000:3.0:1789760786.029593:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757605569006 time 757676680425 state 0x2 ref 0
00000100:00100000:1.0:1789760786.033971:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760786.034121:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521063296
00000100:00100000:0.0:1789760786.034130:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521063296
00000100:00100000:0.0:1789760786.034205:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757605569006 time 757676680425 state 0x0 ref 1
00000100:00100000:0.0:1789760786.034220:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757676940841 time 757676680425 state 0x1 ref 1
00000100:00100000:0.0:1789760786.034290:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757676940841 time 757720972580 state 0x0 ref 1
00000100:00100000:0.0:1789760786.034303:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521063296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760786.034386:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25583616, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:0.0:1789760786.034396:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.034425:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:0.0:1789760786.034430:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760786.034437:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.034451:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760786.035374:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1789760786.044138:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548773376:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760786.044282:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760786.044553:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548773376
00000100:00100000:3.0:1789760786.044563:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548773376
00000100:00100000:3.0:1789760786.044616:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461
00000100:00100000:3.0:1789760786.044627:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548773376:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1789760786.044670:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:3.0:1789760786.046540:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548773376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1906us (2249us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760786.046554:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461
00000100:00100000:1.0:1789760786.047980:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dabb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548773376:0@lo:41:osp-pre-0-1.0
00000001:00080000:2.0:1789760786.086810:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973566 is committed
00002000:00010000:3.0:1789760786.087038:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25583616 -> 25587712
00010000:00010000:3.0:1789760786.087055:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.087068:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.087077:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.087084:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.087088:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.087097:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.087117:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.087123:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60ddab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25583616->25587711] (req 25583616->25587711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.087218:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521063296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52913us (53252us total) trans 4294973566 rc 0/0
00000100:00100000:3.0:1789760786.087229:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6279
00000100:00100000:3.0:1789760786.087238:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757676940841 time 757720972580 state 0x2 ref 0
00000100:00100000:1.0:1789760786.092240:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760786.092341:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521063424
00000100:00100000:2.0:1789760786.092351:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521063424
00000100:00100000:2.0:1789760786.092420:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757676940841 time 757720972580 state 0x0 ref 1
00000100:00100000:2.0:1789760786.092435:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757721232996 time 757720972580 state 0x1 ref 1
00000100:00100000:2.0:1789760786.092462:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757721232996 time 757779145061 state 0x0 ref 1
00000100:00100000:2.0:1789760786.092474:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521063424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760786.092529:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25587712, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:2.0:1789760786.092538:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.092553:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:2.0:1789760786.092558:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760786.092565:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.092579:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760786.142183:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973567 is committed
00002000:00010000:3.0:1789760786.143058:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25587712 -> 25591808
00010000:00010000:3.0:1789760786.143074:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.143086:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.143095:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.143102:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.143107:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.143117:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.143135:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.143149:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60ddb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25587712->25591807] (req 25587712->25591807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.143244:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521063424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50768us (51009us total) trans 4294973567 rc 0/0
00000100:00100000:3.0:1789760786.143254:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6280
00000100:00100000:3.0:1789760786.143264:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757721232996 time 757779145061 state 0x2 ref 0
00000100:00100000:0.0:1789760786.146418:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.146841:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521063552
00000100:00100000:3.0:1789760786.146853:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521063552
00000100:00100000:0.0:1789760786.147017:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757721232996 time 757779145061 state 0x0 ref 1
00000100:00100000:0.0:1789760786.147033:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757779405477 time 757779145061 state 0x1 ref 1
00000100:00100000:0.0:1789760786.147065:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757779405477 time 757833747549 state 0x0 ref 1
00000100:00100000:0.0:1789760786.147078:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521063552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760786.147128:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25591808, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:0.0:1789760786.147138:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.147155:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:0.0:1789760786.147160:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760786.147172:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.147186:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760786.208545:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973568 is committed
00002000:00010000:3.0:1789760786.208921:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25591808 -> 25595904
00010000:00010000:3.0:1789760786.208949:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.208963:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.208972:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.208980:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.208984:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.208994:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.209019:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.209027:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60ddb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25591808->25595903] (req 25591808->25595903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.210629:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521063552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63541us (64219us total) trans 4294973568 rc 0/0
00000100:00100000:3.0:1789760786.210644:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6281
00000100:00100000:3.0:1789760786.210653:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757779405477 time 757833747549 state 0x2 ref 0
00000100:00100000:1.0:1789760786.215354:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.215491:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521063680
00000100:00100000:3.0:1789760786.215501:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521063680
00000100:00100000:3.0:1789760786.215722:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757779405477 time 757833747549 state 0x0 ref 1
00000100:00100000:3.0:1789760786.215739:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757834007965 time 757833747549 state 0x1 ref 1
00000100:00100000:3.0:1789760786.215825:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757834007965 time 757902505463 state 0x0 ref 1
00000100:00100000:3.0:1789760786.215838:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521063680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.215892:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25595904, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760786.215902:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.215917:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:3.0:1789760786.215923:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.215929:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.215955:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760786.297904:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973569 is committed
00002000:00010000:3.0:1789760786.298126:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25595904 -> 25600000
00010000:00010000:3.0:1789760786.298141:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.298152:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.298162:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.298169:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.298174:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.298183:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.298202:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.298210:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25595904->25599999] (req 25595904->25599999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.298415:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521063680:12345-192.168.203.16@tcp:4:dd.0 Request processed in 82562us (83054us total) trans 4294973569 rc 0/0
00000100:00100000:3.0:1789760786.298427:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6282
00000100:00100000:3.0:1789760786.298436:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757834007965 time 757902505463 state 0x2 ref 0
00000100:00100000:1.0:1789760786.302502:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.302588:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521063808
00000100:00100000:3.0:1789760786.302598:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521063808
00000100:00100000:3.0:1789760786.302649:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757834007965 time 757902505463 state 0x0 ref 1
00000100:00100000:3.0:1789760786.302663:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757902765879 time 757902505463 state 0x1 ref 1
00000100:00100000:3.0:1789760786.302732:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757902765879 time 757989411587 state 0x0 ref 1
00000100:00100000:3.0:1789760786.302745:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521063808:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.302795:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25600000, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760786.302805:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.302820:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=757s v=(0 0)
00010000:00010000:3.0:1789760786.302825:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.302831:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.302844:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760786.330812:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973570 is committed
00002000:00010000:0.0:1789760786.330908:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25600000 -> 25604096
00010000:00010000:0.0:1789760786.330923:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.330944:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.330953:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.330960:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760786.330965:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.330974:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.330995:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.331004:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25600000->25604095] (req 25600000->25604095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760786.331101:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521063808:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28354us (28604us total) trans 4294973570 rc 0/0
00000100:00100000:0.0:1789760786.331111:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6283
00000100:00100000:0.0:1789760786.331120:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757902765879 time 757989411587 state 0x2 ref 0
00000100:00100000:2.0:1789760786.334988:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.335077:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521063936
00000100:00100000:3.0:1789760786.335088:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521063936
00000100:00100000:3.0:1789760786.335143:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757902765879 time 757989411587 state 0x0 ref 1
00000100:00100000:3.0:1789760786.335158:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757989672003 time 757989411587 state 0x1 ref 1
00000100:00100000:3.0:1789760786.335189:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757989672003 time 758021871908 state 0x0 ref 1
00000100:00100000:3.0:1789760786.335201:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521063936:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.335246:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25604096, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760786.335255:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.335270:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:3.0:1789760786.335275:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.335282:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.335295:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760786.365584:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973571 is committed
00002000:00010000:3.0:1789760786.365707:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25604096 -> 25608192
00010000:00010000:3.0:1789760786.365723:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.365750:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.365759:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.365767:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.365772:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.365781:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.365801:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.365808:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60ddce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25604096->25608191] (req 25604096->25608191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.365896:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521063936:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30692us (30912us total) trans 4294973571 rc 0/0
00000100:00100000:3.0:1789760786.365906:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6284
00000100:00100000:3.0:1789760786.365916:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757989672003 time 758021871908 state 0x2 ref 0
00000100:00100000:3.0:1789760786.369886:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760786.371420:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521064064
00000100:00100000:0.0:1789760786.371433:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521064064
00000100:00100000:0.0:1789760786.371489:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 757989672003 time 758021871908 state 0x0 ref 1
00000100:00100000:0.0:1789760786.371503:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758022132324 time 758021871908 state 0x1 ref 1
00000100:00100000:0.0:1789760786.371567:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758022132324 time 758058249220 state 0x0 ref 1
00000100:00100000:0.0:1789760786.371580:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521064064:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760786.371626:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25608192, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:0.0:1789760786.371637:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.371652:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:0.0:1789760786.371656:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760786.371662:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.371685:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760786.405425:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25608192 -> 25612288
00010000:00010000:2.0:1789760786.405454:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.405467:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.405475:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.405483:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760786.405487:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.405495:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.405515:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.405523:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60ddd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25608192->25612287] (req 25608192->25612287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760786.405616:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521064064:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34033us (35733us total) trans 4294973572 rc 0/0
00000100:00100000:2.0:1789760786.405625:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6285
00000100:00100000:2.0:1789760786.405634:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758022132324 time 758058249220 state 0x2 ref 0
00000001:00080000:1.0:1789760786.406678:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973572 is committed
00000100:00100000:0.0:1789760786.409501:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.409930:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521064192
00000100:00100000:3.0:1789760786.409950:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521064192
00000100:00100000:3.0:1789760786.410005:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758022132324 time 758058249220 state 0x0 ref 1
00000100:00100000:3.0:1789760786.410020:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758058509636 time 758058249220 state 0x1 ref 1
00000100:00100000:3.0:1789760786.410102:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758058509636 time 758096784356 state 0x0 ref 1
00000100:00100000:3.0:1789760786.410111:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521064192:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.410151:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25612288, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760786.410160:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.410175:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:3.0:1789760786.410179:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.410186:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.410200:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760786.437941:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25612288 -> 25616384
00010000:00010000:2.0:1789760786.437962:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.437977:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.437985:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.437992:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760786.437997:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.438006:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.438026:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.438034:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dddc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25612288->25616383] (req 25612288->25616383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760786.438131:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521064192:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28016us (28636us total) trans 4294973573 rc 0/0
00000100:00100000:2.0:1789760786.438142:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6286
00000100:00100000:2.0:1789760786.438152:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758058509636 time 758096784356 state 0x2 ref 0
00000001:00080000:1.0:1789760786.438172:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973573 is committed
00000100:00100000:3.0:1789760786.441052:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760786.441147:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521064320
00000100:00100000:0.0:1789760786.441157:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521064320
00000100:00100000:0.0:1789760786.441207:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758058509636 time 758096784356 state 0x0 ref 1
00000100:00100000:0.0:1789760786.441220:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758097044772 time 758096784356 state 0x1 ref 1
00000100:00100000:0.0:1789760786.441249:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758097044772 time 758127932357 state 0x0 ref 1
00000100:00100000:0.0:1789760786.441261:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521064320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760786.441308:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25616384, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:0.0:1789760786.441346:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.441365:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:0.0:1789760786.441370:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760786.441378:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.441518:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760786.473955:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973574 is committed
00002000:00010000:1.0:1789760786.474086:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25616384 -> 25620480
00010000:00010000:1.0:1789760786.474101:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.474114:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.474122:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.474129:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760786.474134:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.474142:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.474161:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.474169:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60dde3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25616384->25620479] (req 25616384->25620479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760786.474302:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521064320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33037us (33254us total) trans 4294973574 rc 0/0
00000100:00100000:1.0:1789760786.474349:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6287
00000100:00100000:1.0:1789760786.474359:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758097044772 time 758127932357 state 0x2 ref 0
00000100:00100000:0.0:1789760786.481227:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.481371:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521064448
00000100:00100000:3.0:1789760786.481380:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521064448
00000100:00100000:3.0:1789760786.481446:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758097044772 time 758127932357 state 0x0 ref 1
00000100:00100000:3.0:1789760786.481460:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758128192773 time 758127932357 state 0x1 ref 1
00000100:00100000:3.0:1789760786.481492:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758128192773 time 758168175112 state 0x0 ref 1
00000100:00100000:3.0:1789760786.481503:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521064448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.481544:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25620480, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760786.481553:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.481567:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:3.0:1789760786.481571:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.481577:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.481591:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760786.507863:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973575 is committed
00002000:00010000:1.0:1789760786.508130:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25620480 -> 25624576
00010000:00010000:1.0:1789760786.508145:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.508159:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.508168:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.508175:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760786.508180:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.508189:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.508208:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.508217:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60ddea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25620480->25624575] (req 25620480->25624575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760786.508425:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521064448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26918us (27204us total) trans 4294973575 rc 0/0
00000100:00100000:1.0:1789760786.508436:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6288
00000100:00100000:1.0:1789760786.508446:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758128192773 time 758168175112 state 0x2 ref 0
00000100:00100000:0.0:1789760786.511919:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760786.512156:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521064576
00000100:00100000:2.0:1789760786.512167:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521064576
00000100:00100000:2.0:1789760786.512217:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758128192773 time 758168175112 state 0x0 ref 1
00000100:00100000:2.0:1789760786.512232:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758168435528 time 758168175112 state 0x1 ref 1
00000100:00100000:2.0:1789760786.512292:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758168435528 time 758198973770 state 0x0 ref 1
00000100:00100000:2.0:1789760786.512305:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521064576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760786.512380:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25624576, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:2.0:1789760786.512390:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.512415:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:2.0:1789760786.512420:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760786.512426:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.512441:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760786.542911:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973576 is committed
00002000:00010000:3.0:1789760786.543356:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25624576 -> 25628672
00010000:00010000:3.0:1789760786.543371:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.543384:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.543392:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.543414:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.543419:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.543428:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.543447:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.543455:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60ddf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25624576->25628671] (req 25624576->25628671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.543547:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521064576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31239us (31634us total) trans 4294973576 rc 0/0
00000100:00100000:3.0:1789760786.543557:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6289
00000100:00100000:3.0:1789760786.543567:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758168435528 time 758198973770 state 0x2 ref 0
00000100:00100000:3.0:1789760786.546926:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760786.547294:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521064704
00000100:00100000:0.0:1789760786.547304:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521064704
00000100:00100000:0.0:1789760786.547416:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758168435528 time 758198973770 state 0x0 ref 1
00000100:00100000:0.0:1789760786.547436:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758199234186 time 758198973770 state 0x1 ref 1
00000100:00100000:0.0:1789760786.547457:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758199234186 time 758234140517 state 0x0 ref 1
00000100:00100000:0.0:1789760786.547470:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521064704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760786.547521:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25628672, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:0.0:1789760786.547530:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.547545:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:0.0:1789760786.547550:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760786.547557:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.547570:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760786.580605:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973577 is committed
00002000:00010000:0.0:1789760786.580701:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25628672 -> 25632768
00010000:00010000:0.0:1789760786.580716:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.580728:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.580737:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.580743:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760786.580749:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.580758:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.580776:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.580784:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60ddf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25628672->25632767] (req 25628672->25632767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760786.580876:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521064704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33403us (33954us total) trans 4294973577 rc 0/0
00000100:00100000:0.0:1789760786.580887:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6290
00000100:00100000:0.0:1789760786.580896:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758199234186 time 758234140517 state 0x2 ref 0
00000100:00100000:0.0:1789760786.584275:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760786.584394:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521064832
00000100:00100000:1.0:1789760786.584416:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521064832
00000100:00100000:1.0:1789760786.584469:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758199234186 time 758234140517 state 0x0 ref 1
00000100:00100000:1.0:1789760786.584484:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758234400933 time 758234140517 state 0x1 ref 1
00000100:00100000:1.0:1789760786.586049:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758234400933 time 758272714895 state 0x0 ref 1
00000100:00100000:1.0:1789760786.586074:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521064832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760786.586129:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25632768, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:1.0:1789760786.586137:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.586151:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:1.0:1789760786.586156:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760786.586161:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.586174:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760786.624181:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973578 is committed
00002000:00010000:3.0:1789760786.624240:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25632768 -> 25636864
00010000:00010000:3.0:1789760786.624255:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.624266:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.624276:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.624283:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.624289:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.624297:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.624353:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.624362:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60ddff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25632768->25636863] (req 25632768->25636863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.624466:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521064832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38396us (40195us total) trans 4294973578 rc 0/0
00000100:00100000:3.0:1789760786.624476:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6291
00000100:00100000:3.0:1789760786.624486:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758234400933 time 758272714895 state 0x2 ref 0
00000100:00100000:1.0:1789760786.628415:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.628513:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521064960
00000100:00100000:3.0:1789760786.628525:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521064960
00000100:00100000:3.0:1789760786.628578:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758234400933 time 758272714895 state 0x0 ref 1
00000100:00100000:3.0:1789760786.628593:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758272975311 time 758272714895 state 0x1 ref 1
00000100:00100000:3.0:1789760786.628614:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758272975311 time 758315297261 state 0x0 ref 1
00000100:00100000:3.0:1789760786.628626:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521064960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.628674:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25636864, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760786.628683:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.628702:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:3.0:1789760786.628707:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.628714:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.628726:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760786.665623:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25636864 -> 25640960
00010000:00010000:3.0:1789760786.665642:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.665655:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.665665:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.665673:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.665678:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.665687:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.665705:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.665713:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25636864->25640959] (req 25636864->25640959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.666573:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521064960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37942us (38172us total) trans 4294973579 rc 0/0
00000100:00100000:3.0:1789760786.666586:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6292
00000100:00100000:3.0:1789760786.666595:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758272975311 time 758315297261 state 0x2 ref 0
00000001:00080000:3.0:1789760786.666633:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973579 is committed
00000100:00100000:2.0:1789760786.674181:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.674417:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521065088
00000100:00100000:3.0:1789760786.674427:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521065088
00000100:00100000:3.0:1789760786.674480:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758272975311 time 758315297261 state 0x0 ref 1
00000100:00100000:3.0:1789760786.674496:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758315557677 time 758315297261 state 0x1 ref 1
00000100:00100000:3.0:1789760786.674530:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758315557677 time 758361213089 state 0x0 ref 1
00000100:00100000:3.0:1789760786.674543:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521065088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.674610:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25640960, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760786.674620:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.674636:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:3.0:1789760786.674640:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.674647:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.674660:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760786.707393:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973580 is committed
00002000:00010000:3.0:1789760786.707456:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25640960 -> 25645056
00010000:00010000:3.0:1789760786.707472:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.707485:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.707494:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.707502:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.707507:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.707515:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.707535:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.707543:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25640960->25645055] (req 25640960->25645055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.707622:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521065088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33076us (33447us total) trans 4294973580 rc 0/0
00000100:00100000:3.0:1789760786.707633:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6293
00000100:00100000:3.0:1789760786.707642:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758315557677 time 758361213089 state 0x2 ref 0
00000100:00100000:1.0:1789760786.713746:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760786.714158:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521065216
00000100:00100000:0.0:1789760786.714167:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521065216
00000100:00100000:0.0:1789760786.714219:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758315557677 time 758361213089 state 0x0 ref 1
00000100:00100000:0.0:1789760786.714234:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758361473505 time 758361213089 state 0x1 ref 1
00000100:00100000:0.0:1789760786.714300:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758361473505 time 758400981101 state 0x0 ref 1
00000100:00100000:0.0:1789760786.714354:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521065216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760786.714418:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25645056, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:0.0:1789760786.714428:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.714445:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:0.0:1789760786.714455:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760786.714462:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.714476:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760786.761027:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973581 is committed
00002000:00010000:1.0:1789760786.761109:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25645056 -> 25649152
00010000:00010000:1.0:1789760786.761126:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.761139:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.761149:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.761156:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760786.761162:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.761171:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.761191:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760786.761199:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60de14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25645056->25649151] (req 25645056->25649151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760786.764059:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521065216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49734us (50309us total) trans 4294973581 rc 0/0
00000100:00100000:1.0:1789760786.764074:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6294
00000100:00100000:1.0:1789760786.764086:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758361473505 time 758400981101 state 0x2 ref 0
00000100:00100000:1.0:1789760786.768923:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.769038:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521065344
00000100:00100000:3.0:1789760786.769050:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521065344
00000100:00100000:3.0:1789760786.769167:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758361473505 time 758400981101 state 0x0 ref 1
00000100:00100000:3.0:1789760786.769181:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758401241517 time 758400981101 state 0x1 ref 1
00000100:00100000:3.0:1789760786.769214:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758401241517 time 758455896104 state 0x0 ref 1
00000100:00100000:3.0:1789760786.769226:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521065344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.769706:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25649152, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:3.0:1789760786.769716:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.769738:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:3.0:1789760786.769742:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.769747:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.769760:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760786.794788:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973582 is committed
00002000:00010000:2.0:1789760786.794893:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25649152 -> 25653248
00010000:00010000:2.0:1789760786.794909:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.794923:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.794944:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.794951:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760786.794956:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.794965:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.794983:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.794991:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60de1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25649152->25653247] (req 25649152->25653247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760786.795086:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521065344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 25857us (26167us total) trans 4294973582 rc 0/0
00000100:00100000:2.0:1789760786.795097:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6295
00000100:00100000:2.0:1789760786.795107:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758401241517 time 758455896104 state 0x2 ref 0
00000100:00100000:3.0:1789760786.799424:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760786.799587:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521065472
00000100:00100000:1.0:1789760786.799597:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521065472
00000100:00100000:1.0:1789760786.799649:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758401241517 time 758455896104 state 0x0 ref 1
00000100:00100000:1.0:1789760786.799664:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758456156520 time 758455896104 state 0x1 ref 1
00000100:00100000:0.0:1789760786.799837:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758456156520 time 758486517077 state 0x0 ref 1
00000100:00100000:0.0:1789760786.799852:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521065472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760786.799909:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25653248, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:0.0:1789760786.799918:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.799946:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:0.0:1789760786.799950:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760786.799956:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760786.799970:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760786.843138:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973583 is committed
00002000:00010000:3.0:1789760786.845749:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25653248 -> 25657344
00010000:00010000:3.0:1789760786.845770:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.845784:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.845794:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.845801:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.845806:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.845815:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.845851:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.845859:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60de22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25653248->25657343] (req 25653248->25657343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.845961:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521065472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46109us (46541us total) trans 4294973583 rc 0/0
00000100:00100000:3.0:1789760786.845971:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6296
00000100:00100000:3.0:1789760786.845994:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758456156520 time 758486517077 state 0x2 ref 0
00000100:00100000:3.0:1789760786.853957:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760786.854113:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521065600
00000100:00100000:2.0:1789760786.854123:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521065600
00000100:00100000:2.0:1789760786.854176:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758456156520 time 758486517077 state 0x0 ref 1
00000100:00100000:2.0:1789760786.854191:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758486777493 time 758486517077 state 0x1 ref 1
00000100:00100000:2.0:1789760786.854260:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758486777493 time 758540941927 state 0x0 ref 1
00000100:00100000:2.0:1789760786.854273:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521065600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760786.854357:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25657344, mtime: 0x6aad9513, atime: 0x0, ctime: 0x6aad9513, blocks: 0xc807
00010000:00010000:2.0:1789760786.854366:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.854381:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:2.0:1789760786.854385:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760786.854392:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.854416:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760786.890725:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973584 is committed
00002000:00010000:3.0:1789760786.890939:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25657344 -> 25661440
00002000:00010000:3.0:1789760786.890944:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760787 -> 1789760788
00002000:00010000:3.0:1789760786.890946:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760787 -> 1789760788
00010000:00010000:3.0:1789760786.890959:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.890972:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.890981:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.890988:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.890994:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.891002:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.891023:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.891032:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60de29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25657344->25661439] (req 25657344->25661439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.891127:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521065600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36852us (37174us total) trans 4294973584 rc 0/0
00000100:00100000:3.0:1789760786.891138:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6297
00000100:00100000:3.0:1789760786.891148:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758486777493 time 758540941927 state 0x2 ref 0
00000100:00100000:1.0:1789760786.903881:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760786.904929:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521065728
00000100:00100000:2.0:1789760786.904941:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521065728
00000100:00100000:2.0:1789760786.904997:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758486777493 time 758540941927 state 0x0 ref 1
00000100:00100000:2.0:1789760786.905012:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758541202343 time 758540941927 state 0x1 ref 1
00000100:00100000:2.0:1789760786.905049:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758541202343 time 758591731848 state 0x0 ref 1
00000100:00100000:2.0:1789760786.905062:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521065728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760786.905110:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25661440, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:2.0:1789760786.905119:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.905133:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:2.0:1789760786.905137:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760786.905143:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760786.905250:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760786.959071:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973585 is committed
00002000:00010000:3.0:1789760786.959346:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25661440 -> 25665536
00010000:00010000:3.0:1789760786.959363:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.959386:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.960074:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.960093:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760786.960099:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.960109:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.960138:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.960147:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60de30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25661440->25665535] (req 25661440->25665535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760786.960394:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521065728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55329us (56515us total) trans 4294973585 rc 0/0
00000100:00100000:3.0:1789760786.960693:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6298
00000100:00100000:3.0:1789760786.960704:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758541202343 time 758591731848 state 0x2 ref 0
00000100:00100000:0.0:1789760786.965197:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760786.965521:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521065856
00000100:00100000:3.0:1789760786.965530:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521065856
00000100:00100000:3.0:1789760786.965583:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758541202343 time 758591731848 state 0x0 ref 1
00000100:00100000:3.0:1789760786.965597:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758591992264 time 758591731848 state 0x1 ref 1
00000100:00100000:3.0:1789760786.965675:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758591992264 time 758652356983 state 0x0 ref 1
00000100:00100000:3.0:1789760786.965691:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521065856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760786.965739:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25665536, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760786.965749:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.965903:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:3.0:1789760786.965908:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760786.965916:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760786.965931:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.001665:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760787.013577:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973586 is committed
00002000:00010000:1.0:1789760787.013683:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25665536 -> 25669632
00010000:00010000:1.0:1789760787.013710:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.013724:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.013734:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.013741:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760787.013745:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.013754:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.013779:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.013788:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60de37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25665536->25669631] (req 25665536->25669631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760787.013892:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521065856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48198us (48698us total) trans 4294973586 rc 0/0
00000100:00100000:1.0:1789760787.013903:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6299
00000100:00100000:1.0:1789760787.013913:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758591992264 time 758652356983 state 0x2 ref 0
00000100:00100000:1.0:1789760787.022707:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760787.022818:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521065984
00000100:00100000:3.0:1789760787.022829:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521065984
00000100:00100000:3.0:1789760787.022881:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758591992264 time 758652356983 state 0x0 ref 1
00000100:00100000:3.0:1789760787.022897:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758652617399 time 758652356983 state 0x1 ref 1
00000100:00100000:3.0:1789760787.022990:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758652617399 time 758709611204 state 0x0 ref 1
00000100:00100000:3.0:1789760787.023007:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521065984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760787.023142:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25669632, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760787.023152:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.023167:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:3.0:1789760787.023172:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760787.023178:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.023193:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760787.067138:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:1.0:1789760787.067163:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda617fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548773504:0@lo:41:osp-pre-1-0.0
00000100:00100000:1.0:1789760787.067233:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760787.067500:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548773504
00000100:00100000:2.0:1789760787.067509:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548773504
00000100:00100000:2.0:1789760787.067563:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462
00000100:00100000:2.0:1789760787.067574:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548773504:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1789760787.067611:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:2.0:1789760787.067687:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548773504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (452us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760787.067695:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462
00000100:00100000:3.0:1789760787.067713:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda617fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548773504:0@lo:41:osp-pre-1-0.0
00002000:00010000:1.0:1789760787.069626:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25669632 -> 25673728
00010000:00010000:1.0:1789760787.069646:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.069658:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.069668:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.069682:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760787.069686:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.069695:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.069713:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.069721:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25669632->25673727] (req 25669632->25673727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760787.069806:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521065984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46798us (47115us total) trans 4294973587 rc 0/0
00000100:00100000:1.0:1789760787.069817:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6300
00000100:00100000:1.0:1789760787.069828:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758652617399 time 758709611204 state 0x2 ref 0
00000001:00080000:2.0:1789760787.070009:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973587 is committed
00000100:00100000:3.0:1789760787.074526:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760787.074690:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521066112
00000100:00100000:0.0:1789760787.074700:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521066112
00000100:00100000:0.0:1789760787.074756:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758652617399 time 758709611204 state 0x0 ref 1
00000100:00100000:0.0:1789760787.074772:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758709871620 time 758709611204 state 0x1 ref 1
00000100:00100000:0.0:1789760787.074792:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758709871620 time 758761475614 state 0x0 ref 1
00000100:00100000:0.0:1789760787.074804:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521066112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760787.074850:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25673728, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:0.0:1789760787.074860:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.074875:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:0.0:1789760787.074879:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760787.074885:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.074900:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760787.153347:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25673728 -> 25677824
00010000:00010000:1.0:1789760787.153367:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.153380:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.153395:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.153413:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760787.153418:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.153427:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.153446:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.153465:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25673728->25677823] (req 25673728->25677823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760787.153552:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521066112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 78744us (79032us total) trans 4294973588 rc 0/0
00000100:00100000:1.0:1789760787.153562:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6301
00000100:00100000:1.0:1789760787.153572:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758709871620 time 758761475614 state 0x2 ref 0
00000001:00080000:2.0:1789760787.153751:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973588 is committed
00000100:00100000:0.0:1789760787.158045:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760787.161207:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521066240
00000100:00100000:2.0:1789760787.161223:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521066240
00000100:00100000:2.0:1789760787.161288:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758709871620 time 758761475614 state 0x0 ref 1
00000100:00100000:2.0:1789760787.161302:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758761736030 time 758761475614 state 0x1 ref 1
00000100:00100000:2.0:1789760787.161436:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758761736030 time 758848116527 state 0x0 ref 1
00000100:00100000:2.0:1789760787.161451:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521066240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760787.161498:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25677824, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:2.0:1789760787.161508:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.161524:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:2.0:1789760787.161528:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760787.161534:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.161550:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760787.270759:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973589 is committed
00002000:00010000:3.0:1789760787.271004:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25677824 -> 25681920
00010000:00010000:3.0:1789760787.271021:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.271106:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.271116:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.271123:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760787.271128:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.271143:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.271162:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.271381:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60de4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25677824->25681919] (req 25677824->25681919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760787.271605:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521066240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 110153us (113573us total) trans 4294973589 rc 0/0
00000100:00100000:3.0:1789760787.271617:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6302
00000100:00100000:3.0:1789760787.271626:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758761736030 time 758848116527 state 0x2 ref 0
00000100:00100000:0.0:1789760787.278163:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760787.278608:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521066368
00000100:00100000:1.0:1789760787.278620:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521066368
00000100:00100000:1.0:1789760787.278672:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758761736030 time 758848116527 state 0x0 ref 1
00000100:00100000:1.0:1789760787.278685:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758848376943 time 758848116527 state 0x1 ref 1
00000100:00100000:1.0:1789760787.278715:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758848376943 time 758965398141 state 0x0 ref 1
00000100:00100000:1.0:1789760787.278726:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521066368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760787.278772:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25681920, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:1.0:1789760787.278780:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.278795:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=758s v=(0 0)
00010000:00010000:1.0:1789760787.278799:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760787.278805:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.278819:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760787.293501:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760787.293542:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760787.293570:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760787.293589:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760787.293609:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760787.293634:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521066624
00000100:00100000:1.0:1789760787.293643:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521066624
00000100:00100000:1.0:1789760787.293692:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521066880
00000100:00100000:1.0:1789760787.293695:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521066880
00000100:00100000:1.0:1789760787.293709:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521066752
00000100:00100000:1.0:1789760787.293711:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521066752
00000100:00100000:1.0:1789760787.293724:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521067008
00000100:00100000:1.0:1789760787.293727:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521067008
00000100:00100000:1.0:1789760787.293742:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 963
00000100:00100000:1.0:1789760787.293751:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699521066624:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760787.293819:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699521066624:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (327us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760787.293827:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 963
00000100:00100000:1.0:1789760787.293843:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 964
00000100:00100000:1.0:1789760787.293849:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521066880:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760787.293875:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521066880:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760787.293882:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 964
00000100:00100000:1.0:1789760787.293893:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 965
00000100:00100000:1.0:1789760787.293899:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521066752:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760787.293923:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521066752:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (333us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760787.293929:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 965
00000100:00100000:1.0:1789760787.293941:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 966
00000100:00100000:1.0:1789760787.293947:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521067008:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760787.293970:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521067008:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (359us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760787.293976:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 966
00000100:00100000:1.0:1789760787.293992:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521066496
00000100:00100000:1.0:1789760787.293996:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521066496
00000100:00100000:1.0:1789760787.294018:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 488
00000100:00100000:1.0:1789760787.294023:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699521066496:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:1.0:1789760787.294047:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699521066496:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (477us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760787.294052:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 488
00000100:00080000:1.0:1789760787.294084:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00080000:1.0:1789760787.294088:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000001:00080000:0.0:1789760787.361132:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973590 is committed
00002000:00010000:0.0:1789760787.361357:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25681920 -> 25686016
00010000:00010000:0.0:1789760787.361372:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.361384:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.361394:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.361554:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760787.361560:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.361570:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.361591:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.361599:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60de53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25681920->25686015] (req 25681920->25686015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760787.361687:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521066368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 82958us (83529us total) trans 4294973590 rc 0/0
00000100:00100000:0.0:1789760787.361697:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6303
00000100:00100000:0.0:1789760787.361707:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758848376943 time 758965398141 state 0x2 ref 0
00000100:00100000:1.0:1789760787.370224:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760787.370555:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521067136
00000100:00100000:3.0:1789760787.370565:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521067136
00000100:00100000:3.0:1789760787.370623:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758848376943 time 758965398141 state 0x0 ref 1
00000100:00100000:3.0:1789760787.370639:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758965658557 time 758965398141 state 0x1 ref 1
00000100:00100000:3.0:1789760787.370662:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758965658557 time 759057344969 state 0x0 ref 1
00000100:00100000:3.0:1789760787.370674:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521067136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760787.370722:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25686016, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760787.370731:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.370747:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760787.370751:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760787.370757:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.370771:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760787.452086:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973591 is committed
00002000:00010000:3.0:1789760787.452183:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25686016 -> 25690112
00010000:00010000:3.0:1789760787.452197:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.452209:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.452219:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.452226:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760787.452232:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.452241:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.452258:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.452267:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25686016->25690111] (req 25686016->25690111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760787.452580:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521067136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 81902us (82359us total) trans 4294973591 rc 0/0
00000100:00100000:2.0:1789760787.452590:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6304
00000100:00100000:2.0:1789760787.452600:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758965658557 time 759057344969 state 0x2 ref 0
00000100:00100000:2.0:1789760787.456050:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760787.456115:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521067264
00000100:00100000:0.0:1789760787.456125:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521067264
00000100:00100000:0.0:1789760787.456173:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 758965658557 time 759057344969 state 0x0 ref 1
00000100:00100000:0.0:1789760787.456188:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759057605385 time 759057344969 state 0x1 ref 1
00000100:00100000:0.0:1789760787.456216:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759057605385 time 759142898923 state 0x0 ref 1
00000100:00100000:0.0:1789760787.456227:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521067264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760787.456271:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25690112, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:0.0:1789760787.456280:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.456295:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:0.0:1789760787.456299:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760787.456305:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.456343:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760787.483452:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973592 is committed
00002000:00010000:0.0:1789760787.483593:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25690112 -> 25694208
00010000:00010000:0.0:1789760787.483609:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.483628:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.483638:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.483645:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760787.483650:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.483659:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.483678:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.483684:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60de61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25690112->25694207] (req 25690112->25694207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760787.483776:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521067264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27546us (27729us total) trans 4294973592 rc 0/0
00000100:00100000:0.0:1789760787.483796:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6305
00000100:00100000:0.0:1789760787.483805:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759057605385 time 759142898923 state 0x2 ref 0
00000100:00100000:1.0:1789760787.488576:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760787.489497:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521067392
00000100:00100000:0.0:1789760787.489552:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521067392
00000100:00100000:2.0:1789760787.489765:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759057605385 time 759142898923 state 0x0 ref 1
00000100:00100000:2.0:1789760787.489780:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759143159339 time 759142898923 state 0x1 ref 1
00000100:00100000:2.0:1789760787.489852:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759143159339 time 759176534019 state 0x0 ref 1
00000100:00100000:2.0:1789760787.489865:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521067392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760787.489913:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25694208, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:2.0:1789760787.489922:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.489938:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:2.0:1789760787.489942:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760787.489947:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.489961:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760787.534611:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973593 is committed
00002000:00010000:2.0:1789760787.534778:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25694208 -> 25698304
00010000:00010000:2.0:1789760787.534803:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.534817:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.534827:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.534841:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760787.534847:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.534856:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.534876:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760787.534884:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60de68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25694208->25698303] (req 25694208->25698303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760787.535018:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521067392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45150us (46445us total) trans 4294973593 rc 0/0
00000100:00100000:2.0:1789760787.535029:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6306
00000100:00100000:2.0:1789760787.535039:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759143159339 time 759176534019 state 0x2 ref 0
00000100:00100000:1.0:1789760787.538555:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760787.538656:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521067520
00000100:00100000:3.0:1789760787.538665:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521067520
00000100:00100000:3.0:1789760787.538733:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759143159339 time 759176534019 state 0x0 ref 1
00000100:00100000:3.0:1789760787.538748:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759176794435 time 759176534019 state 0x1 ref 1
00000100:00100000:3.0:1789760787.538823:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759176794435 time 759225505399 state 0x0 ref 1
00000100:00100000:3.0:1789760787.538835:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521067520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760787.538885:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25698304, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760787.538894:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.538910:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760787.538914:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760787.538920:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.538944:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760787.565529:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973594 is committed
00002000:00010000:0.0:1789760787.565641:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25698304 -> 25702400
00010000:00010000:0.0:1789760787.565656:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.565671:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.565680:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.565907:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760787.565912:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.565924:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.565952:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.565960:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25698304->25702399] (req 25698304->25702399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760787.566053:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521067520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27216us (27503us total) trans 4294973594 rc 0/0
00000100:00100000:0.0:1789760787.566064:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6307
00000100:00100000:0.0:1789760787.566074:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759176794435 time 759225505399 state 0x2 ref 0
00000100:00100000:3.0:1789760787.578361:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548773632:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760787.578456:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760787.578591:0:12677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548773632
00000100:00100000:0.0:1789760787.578601:0:12677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548773632
00000100:00100000:0.0:1789760787.578666:0:12677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394
00000100:00100000:0.0:1789760787.578677:0:12677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548773632:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:0.0:1789760787.578700:0:12677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 526057472 pending 0 free 3832545280 avail 3826253824
00000100:00100000:0.0:1789760787.578749:0:12677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3454:x1876699548773632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (292us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760787.578757:0:12677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394
00000100:00100000:0.0:1789760787.578806:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3454:1876699548773632:0@lo:13:osp-pre-0-0.0
00000100:00080000:3.0:1789760787.578876:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1789760787.579938:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760787.580052:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521067648
00000100:00100000:3.0:1789760787.580058:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521067648
00000100:00100000:3.0:1789760787.580099:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759176794435 time 759225505399 state 0x0 ref 1
00000100:00100000:3.0:1789760787.580113:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759225765815 time 759225505399 state 0x1 ref 1
00000100:00100000:3.0:1789760787.580142:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759225765815 time 759266825129 state 0x0 ref 1
00000100:00100000:3.0:1789760787.580153:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521067648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760787.580203:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25702400, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760787.580212:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.580227:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760787.580231:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760787.580238:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.580252:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760787.580559:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1789760787.580572:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548773760:0@lo:13:osp-pre-0-1.0
00000100:00100000:1.0:1789760787.580613:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760787.580842:0:8102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548773760
00000100:00100000:2.0:1789760787.580848:0:8102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548773760
00000100:00100000:2.0:1789760787.581031:0:8102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395
00000100:00100000:2.0:1789760787.581041:0:8102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548773760:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:2.0:1789760787.581143:0:8102:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528154624 pending 1703936 free 3832545280 avail 3826253824
00000100:00100000:2.0:1789760787.581205:0:8102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3456:x1876699548773760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 166us (589us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760787.581216:0:8102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395
00000100:00080000:2.0:1789760787.581236:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789760787.581272:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548773760:0@lo:13:osp-pre-0-1.0
00000001:00080000:0.0:1789760787.628723:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973595 is committed
00002000:00010000:3.0:1789760787.628814:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25702400 -> 25706496
00010000:00010000:3.0:1789760787.628829:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.628843:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.628853:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.629165:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760787.629171:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.629182:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.629202:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.629210:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25702400->25706495] (req 25702400->25706495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760787.629303:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521067648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49146us (49365us total) trans 4294973595 rc 0/0
00000100:00100000:3.0:1789760787.629535:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6308
00000100:00100000:3.0:1789760787.629546:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759225765815 time 759266825129 state 0x2 ref 0
00000100:00100000:2.0:1789760787.632838:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760787.632916:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521067776
00000100:00100000:3.0:1789760787.632925:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521067776
00000100:00100000:3.0:1789760787.632978:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759225765815 time 759266825129 state 0x0 ref 1
00000100:00100000:3.0:1789760787.632992:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759267085545 time 759266825129 state 0x1 ref 1
00000100:00100000:3.0:1789760787.633019:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759267085545 time 759319702516 state 0x0 ref 1
00000100:00100000:3.0:1789760787.633030:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521067776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760787.633079:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25706496, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760787.633088:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.633103:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760787.633107:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760787.633113:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.633127:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760787.665348:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25706496 -> 25710592
00010000:00010000:0.0:1789760787.665366:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.665379:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.665390:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.665409:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760787.665415:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.665424:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.665444:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.665452:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60de7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25706496->25710591] (req 25706496->25710591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760787.665548:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521067776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32514us (32715us total) trans 4294973596 rc 0/0
00000100:00100000:0.0:1789760787.665560:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6309
00000100:00100000:0.0:1789760787.665569:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759267085545 time 759319702516 state 0x2 ref 0
00000001:00080000:0.0:1789760787.665608:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973596 is committed
00000100:00100000:2.0:1789760787.669486:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760787.669564:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521067904
00000100:00100000:0.0:1789760787.669574:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521067904
00000100:00100000:0.0:1789760787.669631:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759267085545 time 759319702516 state 0x0 ref 1
00000100:00100000:0.0:1789760787.669646:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759319962932 time 759319702516 state 0x1 ref 1
00000100:00100000:0.0:1789760787.669672:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759319962932 time 759356355174 state 0x0 ref 1
00000100:00100000:0.0:1789760787.669685:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521067904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760787.669735:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25710592, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:0.0:1789760787.669745:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.669779:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:0.0:1789760787.669784:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760787.669790:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.669804:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760787.724441:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25710592 -> 25714688
00010000:00010000:1.0:1789760787.724463:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760787.724512:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973597 is committed
00010000:00010000:1.0:1789760787.724753:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.724764:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.724771:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760787.724776:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.724785:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.724805:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.724812:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60de84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25710592->25714687] (req 25710592->25714687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760787.724953:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521067904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55266us (55472us total) trans 4294973597 rc 0/0
00000100:00100000:1.0:1789760787.724963:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6310
00000100:00100000:1.0:1789760787.724973:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759319962932 time 759356355174 state 0x2 ref 0
00000100:00100000:2.0:1789760787.728199:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760787.728605:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521068032
00000100:00100000:0.0:1789760787.728615:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521068032
00000100:00100000:0.0:1789760787.728670:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759319962932 time 759356355174 state 0x0 ref 1
00000100:00100000:0.0:1789760787.728693:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759356615590 time 759356355174 state 0x1 ref 1
00000100:00100000:0.0:1789760787.728775:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759356615590 time 759415456155 state 0x0 ref 1
00000100:00100000:0.0:1789760787.728789:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760787.728837:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25714688, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:0.0:1789760787.728846:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.728860:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:0.0:1789760787.728864:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760787.728870:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.728888:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760787.763760:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973598 is committed
00002000:00010000:0.0:1789760787.764116:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25714688 -> 25718784
00010000:00010000:0.0:1789760787.764132:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.764145:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.764155:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.764163:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760787.764168:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.764177:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.764197:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.764204:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60de8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25714688->25718783] (req 25714688->25718783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760787.764375:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35584us (36180us total) trans 4294973598 rc 0/0
00000100:00100000:0.0:1789760787.764385:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6311
00000100:00100000:0.0:1789760787.764403:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759356615590 time 759415456155 state 0x2 ref 0
00000100:00100000:2.0:1789760787.768839:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760787.769089:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521068160
00000100:00100000:3.0:1789760787.769098:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521068160
00000100:00100000:3.0:1789760787.769147:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759356615590 time 759415456155 state 0x0 ref 1
00000100:00100000:3.0:1789760787.769161:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759415716571 time 759415456155 state 0x1 ref 1
00000100:00100000:3.0:1789760787.769189:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759415716571 time 759455871922 state 0x0 ref 1
00000100:00100000:3.0:1789760787.769199:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760787.769248:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25718784, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760787.769256:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.769272:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760787.769276:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760787.769283:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.769297:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760787.817602:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973599 is committed
00002000:00010000:0.0:1789760787.817962:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25718784 -> 25722880
00010000:00010000:0.0:1789760787.817980:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.817992:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.818002:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.818009:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760787.818014:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.818081:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.818100:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.818114:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60de92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25718784->25722879] (req 25718784->25722879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760787.818252:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49049us (49419us total) trans 4294973599 rc 0/0
00000100:00100000:0.0:1789760787.818262:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6312
00000100:00100000:0.0:1789760787.818272:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759415716571 time 759455871922 state 0x2 ref 0
00000100:00100000:2.0:1789760787.825796:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760787.825981:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521068288
00000100:00100000:3.0:1789760787.825992:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521068288
00000100:00100000:3.0:1789760787.826047:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759415716571 time 759455871922 state 0x0 ref 1
00000100:00100000:3.0:1789760787.826062:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759456132338 time 759455871922 state 0x1 ref 1
00000100:00100000:3.0:1789760787.826265:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759456132338 time 759512946897 state 0x0 ref 1
00000100:00100000:3.0:1789760787.826278:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760787.826352:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25722880, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760787.826361:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.826376:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760787.826380:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760787.826386:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.826411:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760787.894591:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25722880 -> 25726976
00010000:00010000:0.0:1789760787.894609:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.894622:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.894631:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.894639:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760787.894643:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.894651:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.894675:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.894683:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60de99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25722880->25726975] (req 25722880->25726975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760787.894782:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521068288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68501us (68990us total) trans 4294973600 rc 0/0
00000100:00100000:0.0:1789760787.894793:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6313
00000100:00100000:0.0:1789760787.894803:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759456132338 time 759512946897 state 0x2 ref 0
00000100:00100000:0.0:1789760787.898221:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760787.898294:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521068416
00000100:00100000:3.0:1789760787.898304:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521068416
00000100:00100000:3.0:1789760787.898388:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759456132338 time 759512946897 state 0x0 ref 1
00000100:00100000:3.0:1789760787.898415:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759513207313 time 759512946897 state 0x1 ref 1
00000100:00100000:3.0:1789760787.898441:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759513207313 time 759585123232 state 0x0 ref 1
00000100:00100000:3.0:1789760787.898453:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521068416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760787.898502:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25726976, mtime: 0x6aad9514, atime: 0x0, ctime: 0x6aad9514, blocks: 0xc807
00010000:00010000:3.0:1789760787.898511:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.898528:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760787.898533:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760787.898539:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.898554:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760787.899418:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973600 is committed
00000001:00080000:2.0:1789760787.940529:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973601 is committed
00002000:00010000:0.0:1789760787.940631:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25726976 -> 25731072
00002000:00010000:0.0:1789760787.940636:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760788 -> 1789760789
00002000:00010000:0.0:1789760787.940639:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760788 -> 1789760789
00010000:00010000:0.0:1789760787.940652:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.940666:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.940676:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.940684:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760787.940689:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.940697:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.940715:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760787.940723:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dea0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25726976->25731071] (req 25726976->25731071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760787.941104:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42647us (42885us total) trans 4294973601 rc 0/0
00000100:00100000:0.0:1789760787.941114:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6314
00000100:00100000:0.0:1789760787.941124:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759513207313 time 759585123232 state 0x2 ref 0
00000100:00100000:2.0:1789760787.945141:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760787.945248:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521068544
00000100:00100000:1.0:1789760787.945258:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521068544
00000100:00100000:1.0:1789760787.945426:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759513207313 time 759585123232 state 0x0 ref 1
00000100:00100000:1.0:1789760787.945444:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759585383648 time 759585123232 state 0x1 ref 1
00000100:00100000:1.0:1789760787.945498:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759585383648 time 759632180483 state 0x0 ref 1
00000100:00100000:1.0:1789760787.945512:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760787.945558:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25731072, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:1.0:1789760787.945566:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.945582:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:1.0:1789760787.945588:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760787.945594:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760787.945608:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760787.994407:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973602 is committed
00002000:00010000:3.0:1789760787.994517:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25731072 -> 25735168
00010000:00010000:3.0:1789760787.994533:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.994546:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.994556:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.994563:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760787.994568:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.994577:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.994596:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760787.994605:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60dea7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25731072->25735167] (req 25731072->25735167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760787.994701:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49187us (49564us total) trans 4294973602 rc 0/0
00000100:00100000:3.0:1789760787.994712:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6315
00000100:00100000:3.0:1789760787.994720:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759585383648 time 759632180483 state 0x2 ref 0
00000100:00100000:2.0:1789760788.001533:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760788.001628:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521068672
00000100:00100000:0.0:1789760788.001637:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521068672
00000100:00100000:0.0:1789760788.001709:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759585383648 time 759632180483 state 0x0 ref 1
00000100:00100000:0.0:1789760788.001725:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759632440899 time 759632180483 state 0x1 ref 1
00000100:00100000:0.0:1789760788.001757:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759632440899 time 759688439122 state 0x0 ref 1
00000100:00100000:0.0:1789760788.001770:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521068672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760788.001819:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25735168, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:0.0:1789760788.001829:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.001845:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:0.0:1789760788.001849:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760788.001856:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.001871:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:2.0:1789760788.002464:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00010000:00010000:3.0:1789760788.032383:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760788.039575:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973603 is committed
00002000:00010000:0.0:1789760788.039647:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25735168 -> 25739264
00010000:00010000:0.0:1789760788.039664:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.039677:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.039688:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.039695:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760788.039700:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.039716:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.039735:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.039743:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25735168->25739263] (req 25735168->25739263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760788.039832:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521068672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38061us (38303us total) trans 4294973603 rc 0/0
00000100:00100000:0.0:1789760788.039843:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6316
00000100:00100000:0.0:1789760788.039853:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759632440899 time 759688439122 state 0x2 ref 0
00000100:00100000:0.0:1789760788.044160:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760788.044247:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521068800
00000100:00100000:3.0:1789760788.044257:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521068800
00000100:00100000:3.0:1789760788.044310:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759632440899 time 759688439122 state 0x0 ref 1
00000100:00100000:3.0:1789760788.044382:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759688699538 time 759688439122 state 0x1 ref 1
00000100:00100000:3.0:1789760788.044516:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759688699538 time 759731197414 state 0x0 ref 1
00000100:00100000:3.0:1789760788.044528:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760788.044575:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25739264, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:3.0:1789760788.044585:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.044601:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760788.044605:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760788.044611:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.044626:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760788.078561:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973604 is committed
00002000:00010000:3.0:1789760788.078666:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25739264 -> 25743360
00010000:00010000:3.0:1789760788.078682:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.078695:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.078704:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.078711:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760788.078715:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.078724:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.078742:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.078750:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60deb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25739264->25743359] (req 25739264->25743359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760788.078841:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34310us (34686us total) trans 4294973604 rc 0/0
00000100:00100000:3.0:1789760788.078854:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6317
00000100:00100000:3.0:1789760788.078863:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759688699538 time 759731197414 state 0x2 ref 0
00000100:00100000:2.0:1789760788.083370:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760788.083472:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521068928
00000100:00100000:3.0:1789760788.083481:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521068928
00000100:00100000:3.0:1789760788.083534:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759688699538 time 759731197414 state 0x0 ref 1
00000100:00100000:3.0:1789760788.083548:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759731457830 time 759731197414 state 0x1 ref 1
00000100:00100000:3.0:1789760788.083570:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759731457830 time 759770253576 state 0x0 ref 1
00000100:00100000:3.0:1789760788.083582:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521068928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760788.083630:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25743360, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:3.0:1789760788.083639:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.083655:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760788.083660:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760788.083666:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.083681:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760788.120546:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25743360 -> 25747456
00010000:00010000:2.0:1789760788.120566:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.120579:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.120588:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.120602:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760788.120608:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.120617:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.120637:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.120646:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60debc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25743360->25747455] (req 25743360->25747455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760788.120744:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521068928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37159us (37378us total) trans 4294973605 rc 0/0
00000100:00100000:2.0:1789760788.120754:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6318
00000100:00100000:2.0:1789760788.120765:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759731457830 time 759770253576 state 0x2 ref 0
00000001:00080000:2.0:1789760788.123884:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973605 is committed
00000100:00100000:2.0:1789760788.124592:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760788.124682:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521069056
00000100:00100000:1.0:1789760788.124693:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521069056
00000100:00100000:1.0:1789760788.124748:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759731457830 time 759770253576 state 0x0 ref 1
00000100:00100000:1.0:1789760788.124763:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759770513992 time 759770253576 state 0x1 ref 1
00000100:00100000:1.0:1789760788.124827:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759770513992 time 759811507823 state 0x0 ref 1
00000100:00100000:1.0:1789760788.124840:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521069056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760788.124889:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25747456, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:1.0:1789760788.124899:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.124914:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:1.0:1789760788.124929:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760788.124937:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.124951:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760788.161534:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25747456 -> 25751552
00010000:00010000:3.0:1789760788.161554:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.161568:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.161578:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.161585:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760788.161591:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.161600:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.161620:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.161628:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60dec3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25747456->25751551] (req 25747456->25751551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760788.161727:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521069056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36884us (37134us total) trans 4294973606 rc 0/0
00000100:00100000:3.0:1789760788.161738:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6319
00000100:00100000:3.0:1789760788.161749:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759770513992 time 759811507823 state 0x2 ref 0
00000001:00080000:2.0:1789760788.163355:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973606 is committed
00000100:00100000:1.0:1789760788.165708:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760788.165807:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521069184
00000100:00100000:0.0:1789760788.165818:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521069184
00000100:00100000:0.0:1789760788.165867:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759770513992 time 759811507823 state 0x0 ref 1
00000100:00100000:0.0:1789760788.165882:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759811768239 time 759811507823 state 0x1 ref 1
00000100:00100000:0.0:1789760788.165911:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759811768239 time 759852593226 state 0x0 ref 1
00000100:00100000:0.0:1789760788.165924:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521069184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760788.165970:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25751552, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:0.0:1789760788.165980:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.165995:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:0.0:1789760788.166000:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760788.166007:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.166020:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760788.195360:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25751552 -> 25755648
00010000:00010000:2.0:1789760788.195380:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.195401:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.195412:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.195419:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760788.195424:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.195432:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.195451:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.195459:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003deb033a/0x4a99e02bc60deca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25751552->25755647] (req 25751552->25755647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760788.195547:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521069184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29621us (29842us total) trans 4294973607 rc 0/0
00000100:00100000:2.0:1789760788.195557:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6320
00000100:00100000:2.0:1789760788.195566:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759811768239 time 759852593226 state 0x2 ref 0
00000001:00080000:3.0:1789760788.195637:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973607 is committed
00000100:00100000:1.0:1789760788.199732:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760788.199808:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521069312
00000100:00100000:3.0:1789760788.199817:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521069312
00000100:00100000:3.0:1789760788.199868:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759811768239 time 759852593226 state 0x0 ref 1
00000100:00100000:3.0:1789760788.199882:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759852853642 time 759852593226 state 0x1 ref 1
00000100:00100000:3.0:1789760788.199914:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759852853642 time 759886596330 state 0x0 ref 1
00000100:00100000:3.0:1789760788.199935:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521069312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760788.199983:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25755648, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:3.0:1789760788.199992:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.200007:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760788.200011:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760788.200017:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.200043:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760788.243503:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973608 is committed
00002000:00010000:0.0:1789760788.243618:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25755648 -> 25759744
00010000:00010000:0.0:1789760788.243631:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.243640:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.243646:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.243650:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760788.243653:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.243659:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.243679:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.243684:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60ded1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25755648->25759743] (req 25755648->25759743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760788.243760:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521069312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43823us (44032us total) trans 4294973608 rc 0/0
00000100:00100000:0.0:1789760788.243770:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6321
00000100:00100000:0.0:1789760788.243779:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759852853642 time 759886596330 state 0x2 ref 0
00000100:00100000:0.0:1789760788.247209:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760788.248524:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521069440
00000100:00100000:2.0:1789760788.248538:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521069440
00000100:00100000:2.0:1789760788.248598:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759852853642 time 759886596330 state 0x0 ref 1
00000100:00100000:2.0:1789760788.248614:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759886856746 time 759886596330 state 0x1 ref 1
00000100:00100000:2.0:1789760788.248644:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759886856746 time 759935326789 state 0x0 ref 1
00000100:00100000:2.0:1789760788.248656:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521069440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760788.248703:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25759744, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:2.0:1789760788.248713:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.248728:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:2.0:1789760788.248732:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760788.248738:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.248750:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760788.275834:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973609 is committed
00002000:00010000:2.0:1789760788.276005:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25759744 -> 25763840
00010000:00010000:2.0:1789760788.276022:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.276035:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.276044:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.276050:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760788.276057:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.276065:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.276084:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.276091:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60ded8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25759744->25763839] (req 25759744->25763839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760788.276218:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521069440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27559us (29023us total) trans 4294973609 rc 0/0
00000100:00100000:2.0:1789760788.276229:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6322
00000100:00100000:2.0:1789760788.276238:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759886856746 time 759935326789 state 0x2 ref 0
00000100:00100000:1.0:1789760788.280896:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760788.281203:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521069568
00000100:00100000:3.0:1789760788.281212:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521069568
00000100:00100000:3.0:1789760788.281264:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759886856746 time 759935326789 state 0x0 ref 1
00000100:00100000:3.0:1789760788.281278:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759935587205 time 759935326789 state 0x1 ref 1
00000100:00100000:3.0:1789760788.281403:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759935587205 time 759968085081 state 0x0 ref 1
00000100:00100000:3.0:1789760788.281416:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521069568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760788.281462:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25763840, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:3.0:1789760788.281471:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.281486:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=759s v=(0 0)
00010000:00010000:3.0:1789760788.281490:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760788.281496:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.281518:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760788.315844:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25763840 -> 25767936
00010000:00010000:3.0:1789760788.315864:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.315877:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.315887:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.315894:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760788.315900:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.315910:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.315996:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.316005:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60dedf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25763840->25767935] (req 25763840->25767935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760788.316099:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973610 is committed
00000100:00100000:3.0:1789760788.316289:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521069568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34871us (35398us total) trans 4294973610 rc 0/0
00000100:00100000:3.0:1789760788.316300:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6323
00000100:00100000:3.0:1789760788.316310:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759935587205 time 759968085081 state 0x2 ref 0
00000100:00100000:1.0:1789760788.333810:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760788.333904:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521069696
00000100:00100000:0.0:1789760788.333915:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521069696
00000100:00100000:0.0:1789760788.333982:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759935587205 time 759968085081 state 0x0 ref 1
00000100:00100000:0.0:1789760788.333999:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759968345497 time 759968085081 state 0x1 ref 1
00000100:00100000:0.0:1789760788.334038:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759968345497 time 760020720590 state 0x0 ref 1
00000100:00100000:0.0:1789760788.334052:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521069696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760788.334104:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25767936, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:0.0:1789760788.334114:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.334137:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:0.0:1789760788.334142:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760788.334364:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.334382:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760788.371733:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973611 is committed
00002000:00010000:0.0:1789760788.371798:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25767936 -> 25772032
00010000:00010000:0.0:1789760788.371813:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.371825:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.371834:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.371841:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760788.371845:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.371854:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.371877:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.371884:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60dee6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25767936->25772031] (req 25767936->25772031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760788.372103:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521069696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38047us (38296us total) trans 4294973611 rc 0/0
00000100:00100000:0.0:1789760788.372114:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6324
00000100:00100000:0.0:1789760788.372123:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759968345497 time 760020720590 state 0x2 ref 0
00000100:00100000:2.0:1789760788.384232:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760788.389147:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521069824
00000100:00100000:0.0:1789760788.389161:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521069824
00000100:00100000:0.0:1789760788.389238:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 759968345497 time 760020720590 state 0x0 ref 1
00000100:00100000:0.0:1789760788.389253:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760020981006 time 760020720590 state 0x1 ref 1
00000100:00100000:0.0:1789760788.389276:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760020981006 time 760075959803 state 0x0 ref 1
00000100:00100000:0.0:1789760788.389289:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521069824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760788.389363:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25772032, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:0.0:1789760788.389371:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.389395:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:0.0:1789760788.389400:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760788.389407:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.389420:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760788.431856:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973612 is committed
00002000:00010000:1.0:1789760788.431890:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25772032 -> 25776128
00010000:00010000:1.0:1789760788.431906:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.431927:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.431935:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.431950:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760788.431955:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.431965:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.431984:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.431995:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60deed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25772032->25776127] (req 25772032->25776127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760788.432194:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521069824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42903us (47968us total) trans 4294973612 rc 0/0
00000100:00100000:1.0:1789760788.432205:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6325
00000100:00100000:1.0:1789760788.432214:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760020981006 time 760075959803 state 0x2 ref 0
00000100:00100000:1.0:1789760788.437401:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760788.437458:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521069952
00000100:00100000:2.0:1789760788.437467:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521069952
00000100:00100000:2.0:1789760788.437647:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760020981006 time 760075959803 state 0x0 ref 1
00000100:00100000:2.0:1789760788.437739:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760076220219 time 760075959803 state 0x1 ref 1
00000100:00100000:2.0:1789760788.437773:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760076220219 time 760124455761 state 0x0 ref 1
00000100:00100000:2.0:1789760788.437785:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521069952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760788.437838:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25776128, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:2.0:1789760788.437848:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.437863:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:2.0:1789760788.437880:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760788.437887:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.437905:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760788.474996:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25776128 -> 25780224
00010000:00010000:3.0:1789760788.475014:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.475037:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.475047:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.475058:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760788.475062:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.475070:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.475087:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.475093:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60def4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25776128->25780223] (req 25776128->25780223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760788.475185:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521069952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37396us (37799us total) trans 4294973613 rc 0/0
00000100:00100000:3.0:1789760788.475196:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6326
00000100:00100000:3.0:1789760788.475204:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760076220219 time 760124455761 state 0x2 ref 0
00000001:00080000:1.0:1789760788.475636:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973613 is committed
00000100:00100000:0.0:1789760788.477948:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760788.478068:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521070080
00000100:00100000:1.0:1789760788.478078:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521070080
00000100:00100000:1.0:1789760788.478144:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760076220219 time 760124455761 state 0x0 ref 1
00000100:00100000:1.0:1789760788.478159:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760124716177 time 760124455761 state 0x1 ref 1
00000100:00100000:1.0:1789760788.478187:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760124716177 time 760164869411 state 0x0 ref 1
00000100:00100000:1.0:1789760788.478200:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521070080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760788.478252:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25780224, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:1.0:1789760788.478261:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.478277:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760788.478281:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760788.478287:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.478305:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760788.541268:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25780224 -> 25784320
00010000:00010000:1.0:1789760788.541300:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.541331:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.541342:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.541350:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760788.541365:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.541376:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.541406:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.541415:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60defb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25780224->25784319] (req 25780224->25784319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760788.541515:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521070080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63313us (63571us total) trans 4294973614 rc 0/0
00000100:00100000:1.0:1789760788.541526:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6327
00000100:00100000:1.0:1789760788.541535:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760124716177 time 760164869411 state 0x2 ref 0
00000001:00080000:2.0:1789760788.542009:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973614 is committed
00000100:00100000:2.0:1789760788.544778:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760788.544860:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521070208
00000100:00100000:1.0:1789760788.544870:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521070208
00000100:00100000:1.0:1789760788.544928:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760124716177 time 760164869411 state 0x0 ref 1
00000100:00100000:1.0:1789760788.544955:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760165129827 time 760164869411 state 0x1 ref 1
00000100:00100000:1.0:1789760788.544983:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760165129827 time 760231665386 state 0x0 ref 1
00000100:00100000:1.0:1789760788.544996:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521070208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760788.545051:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25784320, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:1.0:1789760788.545062:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.545079:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760788.545084:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760788.545091:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.545107:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760788.579846:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973615 is committed
00002000:00010000:1.0:1789760788.579956:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25784320 -> 25788416
00010000:00010000:1.0:1789760788.579972:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.579985:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.579995:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.580002:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760788.580008:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.580018:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.580039:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.580047:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25784320->25788415] (req 25784320->25788415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760788.580185:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521070208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35185us (35411us total) trans 4294973615 rc 0/0
00000100:00100000:1.0:1789760788.580201:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6328
00000100:00100000:1.0:1789760788.580212:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760165129827 time 760231665386 state 0x2 ref 0
00000100:00100000:0.0:1789760788.584476:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760788.584606:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521070336
00000100:00100000:1.0:1789760788.584616:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521070336
00000100:00100000:1.0:1789760788.584667:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760165129827 time 760231665386 state 0x0 ref 1
00000100:00100000:1.0:1789760788.584683:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760231925802 time 760231665386 state 0x1 ref 1
00000100:00100000:1.0:1789760788.584737:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760231925802 time 760271418452 state 0x0 ref 1
00000100:00100000:1.0:1789760788.584749:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521070336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760788.584800:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25788416, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:1.0:1789760788.584809:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.584825:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760788.584829:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760788.584836:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.584849:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760788.603695:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548774272:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.603767:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760788.603840:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548774784:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.603870:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760788.603894:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548775296:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.603922:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760788.603952:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2]
00000100:00100000:2.0:1789760788.603959:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548773888:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.604000:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760788.604729:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548773888
00000100:00100000:1.0:1789760788.604739:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548773888
00000100:00100000:1.0:1789760788.604786:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489
00000100:00100000:1.0:1789760788.604795:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548773888:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760788.604854:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548773888:12345-0@lo:400:kworker.0 Request processed in 61us (854us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760788.604862:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489
00000100:00100000:1.0:1789760788.604892:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548774784
00000100:00100000:1.0:1789760788.604896:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548774784
00000100:00100000:3.0:1789760788.605876:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548775296
00000100:00100000:3.0:1789760788.605886:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548775296
00000100:00100000:3.0:1789760788.605951:0:7586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548774272
00000100:00100000:3.0:1789760788.605954:0:7586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548774272
00000100:00100000:3.0:1789760788.605995:0:7586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967
00000100:00100000:3.0:1789760788.606004:0:7586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548774272:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.606077:0:7586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3455:x1876699548774272:12345-0@lo:400:kworker.0 Request processed in 74us (2310us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760788.606084:0:7586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967
00000100:00100000:3.0:1789760788.606111:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548774144:0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.606147:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760788.606375:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548773888:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.606384:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548774400:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.606423:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760788.606447:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548774912:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.606477:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760788.606499:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548775424:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.606523:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760788.606553:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3455:1876699548774272:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.606586:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548774144
00000100:00100000:2.0:1789760788.606589:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548774144
00000100:00100000:2.0:1789760788.606617:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548774400
00000100:00100000:2.0:1789760788.606620:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548774400
00000100:00100000:2.0:1789760788.606636:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463
00000100:00100000:2.0:1789760788.606642:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548774144:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.606684:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548774144:12345-0@lo:400:kworker.0 Request processed in 41us (537us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760788.606690:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463
00000100:00100000:2.0:1789760788.606702:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464
00000100:00100000:2.0:1789760788.606708:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548774400:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.606740:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548774400:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760788.606745:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464
00000100:00100000:2.0:1789760788.606762:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548774912
00000100:00100000:2.0:1789760788.606764:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548774912
00000100:00100000:1.0:1789760788.608140:0:9637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548775424
00000100:00100000:1.0:1789760788.608151:0:9637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548775424
00000100:00100000:2.0:1789760788.611211:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313
00000100:00100000:2.0:1789760788.611234:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548774784:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.611365:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548774784:12345-0@lo:400:kworker.0 Request processed in 142us (7494us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760788.611376:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313
00000100:00100000:2.0:1789760788.611406:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314
00000100:00100000:2.0:1789760788.611413:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548774912:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.611452:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548774912:12345-0@lo:400:kworker.0 Request processed in 39us (4974us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760788.611458:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314
00000100:00100000:3.0:1789760788.612547:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548774016:0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.612651:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760788.612689:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548774528:0@lo:400:kworker.0
00000100:00100000:0.0:1789760788.612691:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548774016
00000100:00100000:0.0:1789760788.612699:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548774016
00000100:00100000:3.0:1789760788.612710:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760788.612734:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548775040:0@lo:400:kworker.0
00000100:00100000:0.0:1789760788.612736:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548774528
00000100:00100000:0.0:1789760788.612739:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548774528
00000100:00100000:3.0:1789760788.612755:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760788.612759:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548775040
00000100:00100000:0.0:1789760788.612761:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548775040
00000100:00100000:3.0:1789760788.612765:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548775552:0@lo:13:osp-pre-1-0.0
00000100:00100000:0.0:1789760788.612791:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968
00000100:00100000:3.0:1789760788.612791:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760788.612799:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548774016:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.612812:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1789760788.612818:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8cc6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548775680:0@lo:13:osp-pre-1-1.0
00000100:00100000:0.0:1789760788.612837:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3453:x1876699548774016:12345-0@lo:400:kworker.0 Request processed in 39us (187us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760788.612838:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760788.612844:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968
00000100:00100000:0.0:1789760788.612858:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969
00000100:00100000:0.0:1789760788.612864:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548774528:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.612873:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3453:1876699548774016:0@lo:400:kworker.0
00000100:00100000:0.0:1789760788.612887:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3453:x1876699548774528:12345-0@lo:400:kworker.0 Request processed in 24us (176us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760788.612893:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969
00000100:00100000:3.0:1789760788.612894:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3453:1876699548774528:0@lo:400:kworker.0
00000100:00100000:0.0:1789760788.612904:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970
00000100:00100000:0.0:1789760788.612910:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548775040:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.612917:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548775552
00000100:00100000:3.0:1789760788.612920:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548775552
00000100:00100000:3.0:1789760788.612946:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548775680
00000100:00100000:3.0:1789760788.612949:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548775680
00000100:00100000:3.0:1789760788.612972:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396
00000100:00100000:3.0:1789760788.612978:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3453:x1876699548775552:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:3.0:1789760788.613006:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1789760788.613023:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3453:x1876699548775040:12345-0@lo:400:kworker.0 Request processed in 112us (266us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760788.613029:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970
00000100:00100000:3.0:1789760788.613295:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3453:x1876699548775552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 317us (503us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760788.613303:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396
00000100:00100000:3.0:1789760788.613346:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397
00000100:00100000:3.0:1789760788.613353:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548775680:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:3.0:1789760788.613363:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:3.0:1789760788.613397:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548775680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (547us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760788.613404:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397
00000100:00080000:2.0:1789760788.613466:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:2.0:1789760788.613472:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1789760788.613512:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548774400:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.613526:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548774912:0@lo:400:kworker.0
00000100:00100000:2.0:1789760788.613539:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548774784:0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613611:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8cc6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548775680:0@lo:13:osp-pre-1-1.0
00000100:00100000:3.0:1789760788.613623:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3453:1876699548775040:0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613635:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dabbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548775552:0@lo:13:osp-pre-1-0.0
00000100:00100000:3.0:1789760788.613665:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548774144:0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613672:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3454:1876699548774656:0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613697:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760788.613726:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3454:1876699548775168:0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613745:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760788.613763:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315
00000100:00100000:3.0:1789760788.613763:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548774656
00000100:00100000:3.0:1789760788.613766:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548774656
00000100:00100000:0.0:1789760788.613769:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548775296:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613791:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548775168
00000100:00100000:3.0:1789760788.613794:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548775168
00000100:00100000:3.0:1789760788.613809:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971
00000100:00100000:3.0:1789760788.613814:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3454:x1876699548774656:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613845:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3454:x1876699548774656:12345-0@lo:400:kworker.0 Request processed in 30us (147us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760788.613853:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971
00000100:00100000:3.0:1789760788.613865:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972
00000100:00100000:3.0:1789760788.613871:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876699548775168:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613897:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3454:x1876699548775168:12345-0@lo:400:kworker.0 Request processed in 26us (151us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760788.613903:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972
00000100:00100000:3.0:1789760788.613929:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3454:1876699548775168:0@lo:400:kworker.0
00000100:00100000:3.0:1789760788.613947:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3454:1876699548774656:0@lo:400:kworker.0
00000100:00080000:2.0:1789760788.614409:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:1.0:1789760788.615226:0:8098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316
00000100:00100000:1.0:1789760788.615239:0:8098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548775424:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760788.615306:0:8098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548775424:12345-0@lo:400:kworker.0 Request processed in 71us (8782us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760788.615329:0:8098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316
00000100:00100000:3.0:1789760788.615543:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548775424:0@lo:400:kworker.0
00000100:00100000:0.0:1789760788.615656:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8ae45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548775296:12345-0@lo:400:kworker.0 Request processed in 1885us (11737us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760788.615665:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315
00000100:00100000:3.0:1789760788.615686:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548775296:0@lo:400:kworker.0
00000001:00080000:3.0:1789760788.652090:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973616 is committed
00002000:00010000:2.0:1789760788.652208:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25788416 -> 25792512
00010000:00010000:2.0:1789760788.652224:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.652236:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.652249:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.652257:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760788.652261:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.652273:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.652292:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.652300:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60df09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25788416->25792511] (req 25788416->25792511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760788.654494:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521070336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 69736us (70018us total) trans 4294973616 rc 0/0
00000100:00100000:2.0:1789760788.654508:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6329
00000100:00100000:2.0:1789760788.654518:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760231925802 time 760271418452 state 0x2 ref 0
00000100:00100000:0.0:1789760788.665170:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760788.665542:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521070464
00000100:00100000:3.0:1789760788.665552:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521070464
00000100:00100000:3.0:1789760788.665611:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760231925802 time 760271418452 state 0x0 ref 1
00000100:00100000:3.0:1789760788.665627:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760271678868 time 760271418452 state 0x1 ref 1
00000100:00100000:3.0:1789760788.665665:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760271678868 time 760352346759 state 0x0 ref 1
00000100:00100000:3.0:1789760788.665678:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521070464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760788.665724:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25792512, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:3.0:1789760788.665806:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.665826:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:3.0:1789760788.665830:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760788.665837:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.665851:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760788.744710:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25792512 -> 25796608
00010000:00010000:3.0:1789760788.744795:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.744811:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.744821:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.744828:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760788.744833:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.744842:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.744863:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.744871:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25792512->25796607] (req 25792512->25796607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760788.745119:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521070464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 79437us (79951us total) trans 4294973617 rc 0/0
00000100:00100000:3.0:1789760788.745131:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6330
00000100:00100000:3.0:1789760788.745141:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760271678868 time 760352346759 state 0x2 ref 0
00000001:00080000:3.0:1789760788.745182:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973617 is committed
00000100:00100000:0.0:1789760788.755182:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760788.755376:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521070592
00000100:00100000:1.0:1789760788.755394:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521070592
00000100:00100000:1.0:1789760788.755526:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760271678868 time 760352346759 state 0x0 ref 1
00000100:00100000:1.0:1789760788.755543:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760352607175 time 760352346759 state 0x1 ref 1
00000100:00100000:1.0:1789760788.755574:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760352607175 time 760442256706 state 0x0 ref 1
00000100:00100000:1.0:1789760788.755588:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521070592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760788.755638:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25796608, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:1.0:1789760788.755647:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.755668:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760788.755673:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760788.755679:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.755692:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760788.796375:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25796608 -> 25800704
00010000:00010000:0.0:1789760788.796406:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.796420:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.796429:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.796435:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760788.796440:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.796447:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.796465:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760788.796473:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60df17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25796608->25800703] (req 25796608->25800703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760788.796555:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521070592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40965us (41377us total) trans 4294973618 rc 0/0
00000100:00100000:0.0:1789760788.796565:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6331
00000100:00100000:0.0:1789760788.796576:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760352607175 time 760442256706 state 0x2 ref 0
00000001:00080000:3.0:1789760788.799540:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973618 is committed
00000100:00100000:0.0:1789760788.799875:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760788.800103:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521070720
00000100:00100000:1.0:1789760788.800113:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521070720
00000100:00100000:1.0:1789760788.800165:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760352607175 time 760442256706 state 0x0 ref 1
00000100:00100000:1.0:1789760788.800180:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760442517122 time 760442256706 state 0x1 ref 1
00000100:00100000:1.0:1789760788.800252:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760442517122 time 760486933822 state 0x0 ref 1
00000100:00100000:1.0:1789760788.800265:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521070720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760788.800349:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25800704, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:1.0:1789760788.800358:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.800375:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760788.800380:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760788.800398:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.800419:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760788.841619:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25800704 -> 25804800
00010000:00010000:1.0:1789760788.841640:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.841654:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.841662:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.841670:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760788.841675:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.841684:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.841704:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.841710:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25800704->25804799] (req 25800704->25804799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760788.841809:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521070720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41540us (41933us total) trans 4294973619 rc 0/0
00000100:00100000:1.0:1789760788.841819:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6332
00000100:00100000:1.0:1789760788.841829:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760442517122 time 760486933822 state 0x2 ref 0
00000001:00080000:3.0:1789760788.844520:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973619 is committed
00000100:00100000:0.0:1789760788.845461:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760788.845543:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521070848
00000100:00100000:2.0:1789760788.845552:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521070848
00000100:00100000:2.0:1789760788.845598:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760442517122 time 760486933822 state 0x0 ref 1
00000100:00100000:2.0:1789760788.845612:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760487194238 time 760486933822 state 0x1 ref 1
00000100:00100000:2.0:1789760788.845637:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760487194238 time 760532320321 state 0x0 ref 1
00000100:00100000:2.0:1789760788.845647:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521070848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760788.845690:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25804800, mtime: 0x6aad9515, atime: 0x0, ctime: 0x6aad9515, blocks: 0xc807
00010000:00010000:2.0:1789760788.845699:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.845714:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:2.0:1789760788.845718:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760788.845724:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760788.845736:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760788.899932:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973620 is committed
00002000:00010000:1.0:1789760788.900477:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25804800 -> 25808896
00002000:00010000:1.0:1789760788.900482:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760789 -> 1789760790
00002000:00010000:1.0:1789760788.900485:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760789 -> 1789760790
00010000:00010000:1.0:1789760788.900498:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.900512:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.900521:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.900528:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760788.900533:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.900542:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.900568:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.900577:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60df25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25804800->25808895] (req 25804800->25808895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760788.900718:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521070848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55065us (55255us total) trans 4294973620 rc 0/0
00000100:00100000:1.0:1789760788.900729:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6333
00000100:00100000:1.0:1789760788.900739:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760487194238 time 760532320321 state 0x2 ref 0
00000100:00100000:0.0:1789760788.908471:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760788.908711:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521070976
00000100:00100000:3.0:1789760788.908721:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521070976
00000100:00100000:3.0:1789760788.908794:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760487194238 time 760532320321 state 0x0 ref 1
00000100:00100000:3.0:1789760788.908810:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760532580737 time 760532320321 state 0x1 ref 1
00000100:00100000:3.0:1789760788.908843:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760532580737 time 760595525617 state 0x0 ref 1
00000100:00100000:3.0:1789760788.908856:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521070976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760788.908927:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25808896, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:3.0:1789760788.908937:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.908953:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:3.0:1789760788.908959:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760788.908966:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760788.908980:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760788.954569:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973621 is committed
00002000:00010000:1.0:1789760788.957152:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25808896 -> 25812992
00010000:00010000:1.0:1789760788.957177:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.957192:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.957201:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.957208:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760788.957213:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.957222:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.957247:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.957255:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25808896->25812991] (req 25808896->25812991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760788.957574:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521070976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48716us (49109us total) trans 4294973621 rc 0/0
00000100:00100000:1.0:1789760788.957586:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6334
00000100:00100000:1.0:1789760788.957596:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760532580737 time 760595525617 state 0x2 ref 0
00000100:00100000:0.0:1789760788.962812:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760788.962974:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521071104
00000100:00100000:1.0:1789760788.962983:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521071104
00000100:00100000:1.0:1789760788.963446:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760532580737 time 760595525617 state 0x0 ref 1
00000100:00100000:1.0:1789760788.963464:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760595786033 time 760595525617 state 0x1 ref 1
00000100:00100000:1.0:1789760788.963542:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760595786033 time 760650223057 state 0x0 ref 1
00000100:00100000:1.0:1789760788.963556:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521071104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760788.963603:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25812992, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760788.963612:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.963630:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760788.963635:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760788.963642:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760788.963655:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760789.022519:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973622 is committed
00002000:00010000:1.0:1789760789.023375:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25812992 -> 25817088
00010000:00010000:1.0:1789760789.023401:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.023413:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.023421:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.023427:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.023432:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.023441:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.023459:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.023466:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25812992->25817087] (req 25812992->25817087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.023558:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521071104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60001us (60751us total) trans 4294973622 rc 0/0
00000100:00100000:1.0:1789760789.023569:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6335
00000100:00100000:1.0:1789760789.023578:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760595786033 time 760650223057 state 0x2 ref 0
00000100:00100000:0.0:1789760789.027698:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.027797:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521071232
00000100:00100000:1.0:1789760789.027806:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521071232
00000100:00100000:1.0:1789760789.027918:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760595786033 time 760650223057 state 0x0 ref 1
00000100:00100000:1.0:1789760789.027935:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760650483473 time 760650223057 state 0x1 ref 1
00000100:00100000:1.0:1789760789.027974:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760650483473 time 760714656277 state 0x0 ref 1
00000100:00100000:1.0:1789760789.027988:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521071232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.028039:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25817088, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.028048:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.028063:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760789.028068:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.028075:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.028088:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.051632:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:1.0:1789760789.092342:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25817088 -> 25821184
00010000:00010000:1.0:1789760789.092365:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.092378:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.092397:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.092405:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.092410:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.092418:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.092437:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.092445:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25817088->25821183] (req 25817088->25821183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.092537:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521071232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64546us (64848us total) trans 4294973623 rc 0/0
00000100:00100000:1.0:1789760789.092551:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6336
00000100:00100000:1.0:1789760789.092561:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760650483473 time 760714656277 state 0x2 ref 0
00000001:00080000:2.0:1789760789.092632:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973623 is committed
00000100:00100000:2.0:1789760789.098714:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.102141:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521071360
00000100:00100000:1.0:1789760789.102157:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521071360
00000100:00100000:1.0:1789760789.102226:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760650483473 time 760714656277 state 0x0 ref 1
00000100:00100000:1.0:1789760789.102242:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760714916693 time 760714656277 state 0x1 ref 1
00000100:00100000:1.0:1789760789.102343:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760714916693 time 760789024913 state 0x0 ref 1
00000100:00100000:1.0:1789760789.102359:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521071360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.102419:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25821184, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.102428:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.102445:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760789.102449:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.102456:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.102469:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760789.133255:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973624 is committed
00002000:00010000:1.0:1789760789.133361:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25821184 -> 25825280
00010000:00010000:1.0:1789760789.133377:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.133400:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.133409:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.133417:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.133421:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.133440:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.133463:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.133471:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60df41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25821184->25825279] (req 25821184->25825279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.133558:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521071360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31199us (34853us total) trans 4294973624 rc 0/0
00000100:00100000:1.0:1789760789.133569:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6337
00000100:00100000:1.0:1789760789.133578:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760714916693 time 760789024913 state 0x2 ref 0
00000100:00100000:0.0:1789760789.140783:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760789.141156:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521071488
00000100:00100000:3.0:1789760789.141215:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521071488
00000100:00100000:3.0:1789760789.141489:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760714916693 time 760789024913 state 0x0 ref 1
00000100:00100000:3.0:1789760789.141506:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760789285329 time 760789024913 state 0x1 ref 1
00000100:00100000:3.0:1789760789.141539:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760789285329 time 760828221666 state 0x0 ref 1
00000100:00100000:3.0:1789760789.141553:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521071488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760789.141600:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25825280, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:3.0:1789760789.141609:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.141624:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:3.0:1789760789.141629:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760789.141635:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.141648:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760789.170637:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25825280 -> 25829376
00010000:00010000:3.0:1789760789.170657:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.170671:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.170680:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.170688:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760789.170693:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.170702:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.170721:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.170728:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25825280->25829375] (req 25825280->25829375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760789.170878:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973625 is committed
00000100:00100000:3.0:1789760789.170994:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521071488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29439us (30216us total) trans 4294973625 rc 0/0
00000100:00100000:3.0:1789760789.171010:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6338
00000100:00100000:3.0:1789760789.171020:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760789285329 time 760828221666 state 0x2 ref 0
00000100:00100000:0.0:1789760789.177169:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.177276:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521071616
00000100:00100000:1.0:1789760789.177286:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521071616
00000100:00100000:1.0:1789760789.177380:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760789285329 time 760828221666 state 0x0 ref 1
00000100:00100000:1.0:1789760789.177407:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760828482082 time 760828221666 state 0x1 ref 1
00000100:00100000:1.0:1789760789.177438:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760828482082 time 760864121091 state 0x0 ref 1
00000100:00100000:1.0:1789760789.177451:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521071616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.177501:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25829376, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.177510:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.177526:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:1.0:1789760789.177531:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.177537:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.177552:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760789.222859:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973626 is committed
00002000:00010000:1.0:1789760789.223193:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25829376 -> 25833472
00010000:00010000:1.0:1789760789.223210:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.223224:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.223239:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.223247:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.223253:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.223262:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.223283:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.223292:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25829376->25833471] (req 25829376->25833471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.223476:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521071616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46022us (46311us total) trans 4294973626 rc 0/0
00000100:00100000:1.0:1789760789.223488:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6339
00000100:00100000:1.0:1789760789.223502:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760828482082 time 760864121091 state 0x2 ref 0
00000100:00100000:1.0:1789760789.226561:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760789.226665:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521071744
00000100:00100000:0.0:1789760789.226675:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521071744
00000100:00100000:0.0:1789760789.226769:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760828482082 time 760864121091 state 0x0 ref 1
00000100:00100000:0.0:1789760789.226785:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760864381507 time 760864121091 state 0x1 ref 1
00000100:00100000:0.0:1789760789.227181:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760864381507 time 760913861035 state 0x0 ref 1
00000100:00100000:0.0:1789760789.227197:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521071744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760789.227247:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25833472, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:0.0:1789760789.227257:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.227272:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:0.0:1789760789.227276:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760789.227282:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.227295:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760789.268486:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973627 is committed
00002000:00010000:0.0:1789760789.268756:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25833472 -> 25837568
00010000:00010000:0.0:1789760789.268775:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.268788:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.268798:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.268806:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760789.268812:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.268822:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.268841:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.268849:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25833472->25837567] (req 25833472->25837567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760789.268990:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521071744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41790us (42432us total) trans 4294973627 rc 0/0
00000100:00100000:0.0:1789760789.269001:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6340
00000100:00100000:0.0:1789760789.269011:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760864381507 time 760913861035 state 0x2 ref 0
00000100:00100000:3.0:1789760789.275169:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760789.275260:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521071872
00000100:00100000:2.0:1789760789.275268:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521071872
00000100:00100000:2.0:1789760789.275397:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760864381507 time 760913861035 state 0x0 ref 1
00000100:00100000:2.0:1789760789.275414:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760914121451 time 760913861035 state 0x1 ref 1
00000100:00100000:2.0:1789760789.275488:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760914121451 time 760962169977 state 0x0 ref 1
00000100:00100000:2.0:1789760789.275501:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521071872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760789.275548:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25837568, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:2.0:1789760789.275557:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.275572:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=760s v=(0 0)
00010000:00010000:2.0:1789760789.275577:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760789.275585:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.275598:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760789.336449:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973628 is committed
00002000:00010000:1.0:1789760789.339041:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25837568 -> 25841664
00010000:00010000:1.0:1789760789.339060:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.339074:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.339082:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.339090:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.339095:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.339103:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.339124:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.339131:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60df5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25837568->25841663] (req 25837568->25841663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.339299:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521071872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63795us (64135us total) trans 4294973628 rc 0/0
00000100:00100000:1.0:1789760789.339311:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6341
00000100:00100000:1.0:1789760789.339358:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760914121451 time 760962169977 state 0x2 ref 0
00000100:00100000:2.0:1789760789.343235:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760789.350989:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521072000
00000100:00100000:3.0:1789760789.351004:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521072000
00000100:00100000:2.0:1789760789.351244:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760914121451 time 760962169977 state 0x0 ref 1
00000100:00100000:2.0:1789760789.351261:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760962430393 time 760962169977 state 0x1 ref 1
00000100:00100000:2.0:1789760789.351298:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760962430393 time 761037979914 state 0x0 ref 1
00000100:00100000:2.0:1789760789.351331:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521072000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760789.351396:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25841664, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:2.0:1789760789.351406:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.351423:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:2.0:1789760789.351428:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760789.351433:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.351447:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760789.414615:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973629 is committed
00002000:00010000:0.0:1789760789.415039:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25841664 -> 25845760
00010000:00010000:0.0:1789760789.415056:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.415069:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.415079:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.415092:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760789.415098:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.415107:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.415127:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.415136:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60df64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25841664->25845759] (req 25841664->25845759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760789.415229:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521072000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63915us (71999us total) trans 4294973629 rc 0/0
00000100:00100000:0.0:1789760789.415241:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6342
00000100:00100000:0.0:1789760789.415250:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760962430393 time 761037979914 state 0x2 ref 0
00000100:00100000:2.0:1789760789.419658:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.419727:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521072128
00000100:00100000:1.0:1789760789.419736:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521072128
00000100:00100000:1.0:1789760789.419781:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 760962430393 time 761037979914 state 0x0 ref 1
00000100:00100000:1.0:1789760789.419795:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761038240330 time 761037979914 state 0x1 ref 1
00000100:00100000:1.0:1789760789.419823:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761038240330 time 761106506612 state 0x0 ref 1
00000100:00100000:1.0:1789760789.419834:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521072128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.419876:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25845760, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.419885:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.419900:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:1.0:1789760789.419905:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.419911:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.419924:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760789.493092:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973630 is committed
00002000:00010000:1.0:1789760789.493464:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25845760 -> 25849856
00010000:00010000:1.0:1789760789.493480:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.493492:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.493506:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.493514:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.493519:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.493528:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.493546:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.493553:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25845760->25849855] (req 25845760->25849855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.493649:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521072128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73811us (73996us total) trans 4294973630 rc 0/0
00000100:00100000:1.0:1789760789.493661:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6343
00000100:00100000:1.0:1789760789.493673:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761038240330 time 761106506612 state 0x2 ref 0
00000100:00100000:3.0:1789760789.504684:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760789.505119:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521072256
00000100:00100000:0.0:1789760789.505133:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521072256
00000100:00100000:0.0:1789760789.505266:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761038240330 time 761106506612 state 0x0 ref 1
00000100:00100000:0.0:1789760789.505281:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761106767028 time 761106506612 state 0x1 ref 1
00000100:00100000:0.0:1789760789.505429:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761106767028 time 761192110478 state 0x0 ref 1
00000100:00100000:0.0:1789760789.505454:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521072256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760789.505503:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25849856, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:0.0:1789760789.505512:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.505528:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:0.0:1789760789.505533:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760789.505539:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.505561:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760789.573755:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973631 is committed
00002000:00010000:1.0:1789760789.573896:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25849856 -> 25853952
00010000:00010000:1.0:1789760789.573910:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.573929:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.573939:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.573945:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.573949:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.573958:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.573976:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.573983:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60df72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25849856->25853951] (req 25849856->25853951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.574075:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521072256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68619us (69402us total) trans 4294973631 rc 0/0
00000100:00100000:1.0:1789760789.574085:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6344
00000100:00100000:1.0:1789760789.574094:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761106767028 time 761192110478 state 0x2 ref 0
00000100:00100000:2.0:1789760789.577823:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.577908:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521072384
00000100:00100000:1.0:1789760789.577924:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521072384
00000100:00100000:1.0:1789760789.577983:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761106767028 time 761192110478 state 0x0 ref 1
00000100:00100000:1.0:1789760789.577999:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761192370894 time 761192110478 state 0x1 ref 1
00000100:00100000:1.0:1789760789.578037:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761192370894 time 761264720796 state 0x0 ref 1
00000100:00100000:1.0:1789760789.578050:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521072384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.578095:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25853952, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.578104:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.578119:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:1.0:1789760789.578123:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.578130:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.578143:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760789.618245:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25853952 -> 25858048
00010000:00010000:1.0:1789760789.618265:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.618279:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.618294:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.618302:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.618307:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.618351:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.618371:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.618398:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25853952->25858047] (req 25853952->25858047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.618485:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521072384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40432us (40681us total) trans 4294973632 rc 0/0
00000100:00100000:1.0:1789760789.618495:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6345
00000100:00100000:1.0:1789760789.618505:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761192370894 time 761264720796 state 0x2 ref 0
00000001:00080000:3.0:1789760789.618923:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973632 is committed
00000100:00100000:2.0:1789760789.627876:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760789.628064:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521072512
00000100:00100000:3.0:1789760789.628074:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521072512
00000100:00100000:3.0:1789760789.628131:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761192370894 time 761264720796 state 0x0 ref 1
00000100:00100000:3.0:1789760789.628146:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761264981212 time 761264720796 state 0x1 ref 1
00000100:00100000:3.0:1789760789.628177:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761264981212 time 761314859955 state 0x0 ref 1
00000100:00100000:3.0:1789760789.628189:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521072512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760789.628237:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25858048, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:3.0:1789760789.628246:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.628262:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:3.0:1789760789.628266:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760789.628274:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.628288:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760789.668860:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973633 is committed
00002000:00010000:2.0:1789760789.669580:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25858048 -> 25862144
00010000:00010000:2.0:1789760789.669597:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.669612:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.669622:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.669629:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760789.669634:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.669644:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.669663:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.669671:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60df80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25858048->25862143] (req 25858048->25862143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760789.669766:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521072512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41574us (41894us total) trans 4294973633 rc 0/0
00000100:00100000:2.0:1789760789.669781:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6346
00000100:00100000:2.0:1789760789.669790:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761264981212 time 761314859955 state 0x2 ref 0
00000100:00100000:0.0:1789760789.680371:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.680512:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521072640
00000100:00100000:1.0:1789760789.680522:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521072640
00000100:00100000:1.0:1789760789.680575:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761264981212 time 761314859955 state 0x0 ref 1
00000100:00100000:1.0:1789760789.680591:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761315120371 time 761314859955 state 0x1 ref 1
00000100:00100000:1.0:1789760789.680623:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761315120371 time 761367305811 state 0x0 ref 1
00000100:00100000:1.0:1789760789.680637:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521072640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.680685:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25862144, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.680695:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.680711:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:1.0:1789760789.680716:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.680723:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.680738:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760789.714193:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973634 is committed
00002000:00010000:3.0:1789760789.714306:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25862144 -> 25866240
00010000:00010000:3.0:1789760789.714343:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.714357:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.714366:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.714374:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760789.714389:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.714400:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.714419:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.714427:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60df87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25862144->25866239] (req 25862144->25866239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760789.714519:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521072640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33880us (34155us total) trans 4294973634 rc 0/0
00000100:00100000:3.0:1789760789.714530:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6347
00000100:00100000:3.0:1789760789.714539:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761315120371 time 761367305811 state 0x2 ref 0
00000100:00100000:0.0:1789760789.718252:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.718427:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521072768
00000100:00100000:1.0:1789760789.718436:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521072768
00000100:00100000:1.0:1789760789.718488:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761315120371 time 761367305811 state 0x0 ref 1
00000100:00100000:1.0:1789760789.718503:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761367566227 time 761367305811 state 0x1 ref 1
00000100:00100000:1.0:1789760789.718535:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761367566227 time 761405217287 state 0x0 ref 1
00000100:00100000:1.0:1789760789.718546:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521072768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.718592:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25866240, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.718601:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.718616:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:1.0:1789760789.718620:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.718626:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.718639:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760789.764673:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973635 is committed
00002000:00010000:1.0:1789760789.764755:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25866240 -> 25870336
00010000:00010000:1.0:1789760789.764770:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.764782:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.764792:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.764800:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.764804:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.764813:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.764840:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.764848:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60df8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25866240->25870335] (req 25866240->25870335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760789.765120:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521072768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46569us (46870us total) trans 4294973635 rc 0/0
00000100:00100000:1.0:1789760789.765131:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6348
00000100:00100000:1.0:1789760789.765141:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761367566227 time 761405217287 state 0x2 ref 0
00000100:00100000:2.0:1789760789.768623:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.768713:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521072896
00000100:00100000:1.0:1789760789.768723:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521072896
00000100:00100000:1.0:1789760789.768773:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761367566227 time 761405217287 state 0x0 ref 1
00000100:00100000:1.0:1789760789.768787:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761405477703 time 761405217287 state 0x1 ref 1
00000100:00100000:1.0:1789760789.768851:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761405477703 time 761455532583 state 0x0 ref 1
00000100:00100000:1.0:1789760789.768864:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521072896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.768923:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25870336, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.768932:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.768947:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:1.0:1789760789.768952:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.768958:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.768972:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760789.807931:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973636 is committed
00002000:00010000:2.0:1789760789.808003:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25870336 -> 25874432
00010000:00010000:2.0:1789760789.808019:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.808032:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.808041:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.808049:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760789.808054:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.808064:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.808086:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.808100:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60df95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25870336->25874431] (req 25870336->25874431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760789.808257:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521072896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39391us (39639us total) trans 4294973636 rc 0/0
00000100:00100000:2.0:1789760789.808267:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6349
00000100:00100000:2.0:1789760789.808276:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761405477703 time 761455532583 state 0x2 ref 0
00000100:00100000:1.0:1789760789.817194:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760789.819062:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521073024
00000100:00100000:2.0:1789760789.819079:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521073024
00000100:00100000:3.0:1789760789.819252:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761405477703 time 761455532583 state 0x0 ref 1
00000100:00100000:3.0:1789760789.819271:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761455792999 time 761455532583 state 0x1 ref 1
00000100:00100000:3.0:1789760789.819394:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761455792999 time 761506076106 state 0x0 ref 1
00000100:00100000:3.0:1789760789.819409:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521073024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760789.819456:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25874432, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:3.0:1789760789.819465:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.819480:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:3.0:1789760789.819483:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760789.819489:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.819502:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760789.866368:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973637 is committed
00002000:00010000:3.0:1789760789.866729:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25874432 -> 25878528
00010000:00010000:3.0:1789760789.866745:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.866757:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.866766:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.866774:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760789.866779:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.866789:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.866807:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760789.866815:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60df9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25874432->25878527] (req 25874432->25878527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760789.866924:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521073024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47513us (49733us total) trans 4294973637 rc 0/0
00000100:00100000:3.0:1789760789.866934:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6350
00000100:00100000:3.0:1789760789.866943:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761455792999 time 761506076106 state 0x2 ref 0
00000100:00100000:3.0:1789760789.870426:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.870522:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521073152
00000100:00100000:1.0:1789760789.870532:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521073152
00000100:00100000:1.0:1789760789.870593:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761455792999 time 761506076106 state 0x0 ref 1
00000100:00100000:1.0:1789760789.870613:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761506336522 time 761506076106 state 0x1 ref 1
00000100:00100000:1.0:1789760789.870647:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761506336522 time 761557329753 state 0x0 ref 1
00000100:00100000:1.0:1789760789.870659:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521073152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760789.870713:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25878528, mtime: 0x6aad9516, atime: 0x0, ctime: 0x6aad9516, blocks: 0xc807
00010000:00010000:1.0:1789760789.870725:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.870743:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:1.0:1789760789.870748:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760789.870757:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.870772:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760789.910173:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973638 is committed
00002000:00010000:1.0:1789760789.910260:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25878528 -> 25882624
00002000:00010000:1.0:1789760789.910265:0:14638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760790 -> 1789760791
00002000:00010000:1.0:1789760789.910268:0:14638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760790 -> 1789760791
00010000:00010000:1.0:1789760789.910280:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.910293:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.910302:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.910309:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760789.912480:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.912500:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.912522:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760789.912531:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25878528->25882623] (req 25878528->25882623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760789.916201:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521073152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45533us (45775us total) trans 4294973638 rc 0/0
00000100:00100000:2.0:1789760789.916215:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6351
00000100:00100000:2.0:1789760789.916225:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761506336522 time 761557329753 state 0x2 ref 0
00000100:00100000:2.0:1789760789.921823:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760789.923048:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521073280
00000100:00100000:1.0:1789760789.923061:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521073280
00000100:00100000:2.0:1789760789.923416:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761506336522 time 761557329753 state 0x0 ref 1
00000100:00100000:2.0:1789760789.923431:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761557590169 time 761557329753 state 0x1 ref 1
00000100:00100000:2.0:1789760789.923463:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761557590169 time 761610145858 state 0x0 ref 1
00000100:00100000:2.0:1789760789.923476:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521073280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760789.923520:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25882624, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760789.923529:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.923555:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:2.0:1789760789.923560:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760789.923567:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.923582:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760789.963567:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973639 is committed
00002000:00010000:0.0:1789760789.963665:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25882624 -> 25886720
00010000:00010000:0.0:1789760789.963679:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.963691:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.963700:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.963709:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760789.963713:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.963722:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.963741:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760789.963750:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60dfaa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25882624->25886719] (req 25882624->25886719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760789.963872:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521073280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40393us (42054us total) trans 4294973639 rc 0/0
00000100:00100000:0.0:1789760789.963883:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6352
00000100:00100000:0.0:1789760789.963893:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761557590169 time 761610145858 state 0x2 ref 0
00000100:00100000:3.0:1789760789.973221:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760789.973336:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521073408
00000100:00100000:2.0:1789760789.973346:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521073408
00000100:00100000:2.0:1789760789.973406:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761557590169 time 761610145858 state 0x0 ref 1
00000100:00100000:2.0:1789760789.973421:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761610406274 time 761610145858 state 0x1 ref 1
00000100:00100000:2.0:1789760789.973453:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761610406274 time 761660135456 state 0x0 ref 1
00000100:00100000:2.0:1789760789.973569:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521073408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760789.973624:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25886720, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760789.973633:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.973649:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:2.0:1789760789.973653:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760789.973660:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760789.973678:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760790.010953:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973640 is committed
00002000:00010000:3.0:1789760790.013004:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25886720 -> 25890816
00010000:00010000:3.0:1789760790.013025:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.013095:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.013106:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.013114:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.013118:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.013126:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.013144:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.013151:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60dfb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25886720->25890815] (req 25886720->25890815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.013352:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521073408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39783us (40136us total) trans 4294973640 rc 0/0
00000100:00100000:3.0:1789760790.013364:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6353
00000100:00100000:3.0:1789760790.013374:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761610406274 time 761660135456 state 0x2 ref 0
00000100:00100000:3.0:1789760790.022388:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760790.022527:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521073536
00000100:00100000:2.0:1789760790.022536:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521073536
00000100:00100000:2.0:1789760790.022607:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761610406274 time 761660135456 state 0x0 ref 1
00000100:00100000:2.0:1789760790.022622:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761660395872 time 761660135456 state 0x1 ref 1
00000100:00080000:0.0:1789760790.022705:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1789760790.023115:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761660395872 time 761709795958 state 0x0 ref 1
00000100:00100000:2.0:1789760790.023131:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521073536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760790.023177:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25890816, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760790.023186:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.023202:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:2.0:1789760790.023207:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760790.023214:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.023227:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760790.055466:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25890816 -> 25894912
00010000:00010000:2.0:1789760790.055485:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.055498:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.055506:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.055513:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760790.055518:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.055527:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.055545:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.055553:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60dfb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25890816->25894911] (req 25890816->25894911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760790.055643:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521073536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32511us (33269us total) trans 4294973641 rc 0/0
00000100:00100000:2.0:1789760790.055656:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6354
00000100:00100000:2.0:1789760790.055665:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761660395872 time 761709795958 state 0x2 ref 0
00000001:00080000:3.0:1789760790.056249:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973641 is committed
00000100:00100000:2.0:1789760790.060691:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760790.063187:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521073664
00000100:00100000:3.0:1789760790.063200:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521073664
00000100:00100000:3.0:1789760790.063262:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761660395872 time 761709795958 state 0x0 ref 1
00000100:00100000:3.0:1789760790.063278:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761710056374 time 761709795958 state 0x1 ref 1
00000100:00100000:3.0:1789760790.063386:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761710056374 time 761750058019 state 0x0 ref 1
00000100:00100000:3.0:1789760790.063399:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521073664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760790.063444:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25894912, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:3.0:1789760790.063453:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.063468:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:3.0:1789760790.063472:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760790.063478:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.063492:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.074181:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760790.103405:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973642 is committed
00002000:00010000:3.0:1789760790.103576:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25894912 -> 25899008
00010000:00010000:3.0:1789760790.103592:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.103605:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.103615:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.103622:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.103627:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.103637:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.103654:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.103662:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25894912->25899007] (req 25894912->25899007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.103781:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521073664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40380us (43096us total) trans 4294973642 rc 0/0
00000100:00100000:3.0:1789760790.103797:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6355
00000100:00100000:3.0:1789760790.103806:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761710056374 time 761750058019 state 0x2 ref 0
00000100:00100000:0.0:1789760790.110254:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760790.110353:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521073792
00000100:00100000:1.0:1789760790.110363:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521073792
00000100:00100000:1.0:1789760790.110424:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761710056374 time 761750058019 state 0x0 ref 1
00000100:00100000:1.0:1789760790.110439:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761750318435 time 761750058019 state 0x1 ref 1
00000100:00100000:1.0:1789760790.110528:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761750318435 time 761797209471 state 0x0 ref 1
00000100:00100000:1.0:1789760790.110541:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521073792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760790.110583:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25899008, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:1.0:1789760790.110592:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.110609:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:1.0:1789760790.110613:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760790.110620:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.110634:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760790.166068:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973643 is committed
00002000:00010000:3.0:1789760790.166610:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25899008 -> 25903104
00010000:00010000:3.0:1789760790.166628:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.166641:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.166650:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.166658:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.166664:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.166673:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.166692:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.166699:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60dfc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25899008->25903103] (req 25899008->25903103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.166860:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521073792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56316us (56610us total) trans 4294973643 rc 0/0
00000100:00100000:3.0:1789760790.166871:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6356
00000100:00100000:3.0:1789760790.166880:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761750318435 time 761797209471 state 0x2 ref 0
00000100:00100000:0.0:1789760790.181237:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760790.181509:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521073920
00000100:00100000:2.0:1789760790.181519:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521073920
00000100:00100000:2.0:1789760790.181692:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761750318435 time 761797209471 state 0x0 ref 1
00000100:00100000:2.0:1789760790.181707:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761797469887 time 761797209471 state 0x1 ref 1
00000100:00100000:2.0:1789760790.181739:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761797469887 time 761868421575 state 0x0 ref 1
00000100:00100000:2.0:1789760790.181751:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521073920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760790.181809:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25903104, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760790.181818:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.181834:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:2.0:1789760790.181838:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760790.181844:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.181858:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760790.211724:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973644 is committed
00002000:00010000:3.0:1789760790.211821:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25903104 -> 25907200
00010000:00010000:3.0:1789760790.211837:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.211860:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.211869:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.211878:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.211883:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.211893:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.212018:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.212034:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60dfcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25903104->25907199] (req 25903104->25907199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.212124:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521073920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30370us (30893us total) trans 4294973644 rc 0/0
00000100:00100000:3.0:1789760790.212134:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6357
00000100:00100000:3.0:1789760790.212144:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761797469887 time 761868421575 state 0x2 ref 0
00000100:00100000:2.0:1789760790.228281:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760790.230464:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521074048
00000100:00100000:3.0:1789760790.230479:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521074048
00000100:00100000:2.0:1789760790.230761:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761797469887 time 761868421575 state 0x0 ref 1
00000100:00100000:2.0:1789760790.230778:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761868681991 time 761868421575 state 0x1 ref 1
00000100:00100000:2.0:1789760790.230850:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761868681991 time 761917531648 state 0x0 ref 1
00000100:00100000:2.0:1789760790.230864:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521074048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760790.230928:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25907200, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760790.230937:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.230954:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:2.0:1789760790.230959:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760790.230965:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.230980:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760790.262810:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973645 is committed
00002000:00010000:3.0:1789760790.262926:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25907200 -> 25911296
00010000:00010000:3.0:1789760790.262942:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.262955:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.262964:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.262972:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.262977:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.262986:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.263069:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.263077:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60dfd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25907200->25911295] (req 25907200->25911295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.263152:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521074048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32288us (34878us total) trans 4294973645 rc 0/0
00000100:00100000:3.0:1789760790.263160:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6358
00000100:00100000:3.0:1789760790.263166:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761868681991 time 761917531648 state 0x2 ref 0
00000100:00100000:0.0:1789760790.266096:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760790.266232:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521074176
00000100:00100000:3.0:1789760790.266241:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521074176
00000100:00100000:3.0:1789760790.266556:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761868681991 time 761917531648 state 0x0 ref 1
00000100:00100000:3.0:1789760790.266572:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761917792064 time 761917531648 state 0x1 ref 1
00000100:00100000:3.0:1789760790.266608:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761917792064 time 761953290128 state 0x0 ref 1
00000100:00100000:3.0:1789760790.266621:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521074176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760790.266668:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25911296, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:3.0:1789760790.266678:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.266694:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=761s v=(0 0)
00010000:00010000:3.0:1789760790.266699:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760790.266705:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.266719:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760790.315917:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973646 is committed
00002000:00010000:2.0:1789760790.316062:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25911296 -> 25915392
00010000:00010000:2.0:1789760790.316076:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.316088:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.316102:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.316110:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760790.316115:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.316124:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.316153:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.316162:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60dfdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25911296->25915391] (req 25911296->25915391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760790.316256:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521074176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49632us (50163us total) trans 4294973646 rc 0/0
00000100:00100000:2.0:1789760790.316266:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6359
00000100:00100000:2.0:1789760790.316809:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761917792064 time 761953290128 state 0x2 ref 0
00000100:00100000:0.0:1789760790.319534:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760790.319615:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521074304
00000100:00100000:3.0:1789760790.319626:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521074304
00000100:00100000:3.0:1789760790.319678:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761917792064 time 761953290128 state 0x0 ref 1
00000100:00100000:3.0:1789760790.319694:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761953550544 time 761953290128 state 0x1 ref 1
00000100:00100000:3.0:1789760790.319719:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761953550544 time 762006402368 state 0x0 ref 1
00000100:00100000:3.0:1789760790.319731:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760790.319777:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25915392, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:3.0:1789760790.319786:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.319801:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:3.0:1789760790.319805:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760790.319811:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.319826:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760790.352846:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25915392 -> 25919488
00010000:00010000:0.0:1789760790.352866:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.352889:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.352898:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.352913:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760790.352917:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.352926:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.352945:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.352952:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60dfe2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25915392->25919487] (req 25915392->25919487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760790.353047:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521074304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33313us (33518us total) trans 4294973647 rc 0/0
00000100:00100000:0.0:1789760790.353057:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6360
00000100:00100000:0.0:1789760790.353067:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761953550544 time 762006402368 state 0x2 ref 0
00000001:00080000:2.0:1789760790.354227:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973647 is committed
00000100:00100000:3.0:1789760790.360576:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760790.361472:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521074432
00000100:00100000:2.0:1789760790.361483:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521074432
00000100:00100000:2.0:1789760790.361537:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 761953550544 time 762006402368 state 0x0 ref 1
00000100:00100000:2.0:1789760790.361556:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762006662784 time 762006402368 state 0x1 ref 1
00000100:00100000:2.0:1789760790.361585:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762006662784 time 762048267878 state 0x0 ref 1
00000100:00100000:2.0:1789760790.361597:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760790.361641:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25919488, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760790.361651:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.361666:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760790.361671:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760790.361678:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.361690:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760790.409661:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25919488 -> 25923584
00000001:00080000:0.0:1789760790.409679:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973648 is committed
00010000:00010000:3.0:1789760790.409680:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.409695:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.409706:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.409714:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.409719:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.409728:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.409746:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.409754:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60dfe9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25919488->25923583] (req 25919488->25923583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.409840:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48240us (49268us total) trans 4294973648 rc 0/0
00000100:00100000:3.0:1789760790.409851:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6361
00000100:00100000:3.0:1789760790.409861:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762006662784 time 762048267878 state 0x2 ref 0
00000100:00100000:3.0:1789760790.413773:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760790.414257:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521074560
00000100:00100000:2.0:1789760790.414266:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521074560
00000100:00100000:2.0:1789760790.414499:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762006662784 time 762048267878 state 0x0 ref 1
00000100:00100000:2.0:1789760790.414514:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762048528294 time 762048267878 state 0x1 ref 1
00000100:00100000:2.0:1789760790.414536:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762048528294 time 762101218985 state 0x0 ref 1
00000100:00100000:2.0:1789760790.414549:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760790.414593:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25923584, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760790.414602:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.414617:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760790.414622:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760790.414628:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.414798:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760790.498646:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973649 is committed
00002000:00010000:2.0:1789760790.498794:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25923584 -> 25927680
00010000:00010000:2.0:1789760790.498810:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.498823:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.498832:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.498840:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760790.498844:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.498853:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.498871:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.498878:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60dff0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25923584->25927679] (req 25923584->25927679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760790.498988:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 84437us (85220us total) trans 4294973649 rc 0/0
00000100:00100000:2.0:1789760790.498999:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6362
00000100:00100000:2.0:1789760790.499009:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762048528294 time 762101218985 state 0x2 ref 0
00000100:00100000:0.0:1789760790.507145:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760790.508111:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521074688
00000100:00100000:3.0:1789760790.508124:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521074688
00000100:00100000:3.0:1789760790.508185:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762048528294 time 762101218985 state 0x0 ref 1
00000100:00100000:3.0:1789760790.508200:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762101479401 time 762101218985 state 0x1 ref 1
00000100:00100000:3.0:1789760790.508226:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762101479401 time 762194909246 state 0x0 ref 1
00000100:00100000:3.0:1789760790.508239:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760790.508290:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25927680, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:3.0:1789760790.508300:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.508333:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:3.0:1789760790.508338:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760790.508346:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.508359:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760790.572582:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973650 is committed
00002000:00010000:3.0:1789760790.577765:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25927680 -> 25931776
00010000:00010000:3.0:1789760790.577785:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.577797:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.577805:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.577813:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.577817:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.577826:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.577846:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.579136:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dff7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25927680->25931775] (req 25927680->25931775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.579358:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 71116us (72217us total) trans 4294973650 rc 0/0
00000100:00100000:3.0:1789760790.579369:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6363
00000100:00100000:3.0:1789760790.579390:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762101479401 time 762194909246 state 0x2 ref 0
00000100:00100000:0.0:1789760790.585727:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760790.585835:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521074816
00000100:00100000:3.0:1789760790.585845:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521074816
00000100:00100000:3.0:1789760790.585896:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762101479401 time 762194909246 state 0x0 ref 1
00000100:00100000:3.0:1789760790.586025:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762195169662 time 762194909246 state 0x1 ref 1
00000100:00100000:3.0:1789760790.586109:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762195169662 time 762272790583 state 0x0 ref 1
00000100:00100000:3.0:1789760790.586125:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760790.586176:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25931776, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:3.0:1789760790.586186:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.586203:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:3.0:1789760790.586208:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760790.586215:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.586229:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760790.629242:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25931776 -> 25935872
00010000:00010000:2.0:1789760790.629262:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.629275:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.629283:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.629291:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760790.629296:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.629310:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.629363:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.629381:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60dffe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25931776->25935871] (req 25931776->25935871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760790.629583:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521074816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43351us (43755us total) trans 4294973651 rc 0/0
00000100:00100000:2.0:1789760790.629594:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6364
00000100:00100000:2.0:1789760790.629604:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762195169662 time 762272790583 state 0x2 ref 0
00000001:00080000:1.0:1789760790.629692:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973651 is committed
00000100:00100000:3.0:1789760790.632826:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760790.632946:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521074944
00000100:00100000:0.0:1789760790.632955:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521074944
00000100:00100000:0.0:1789760790.633011:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762195169662 time 762272790583 state 0x0 ref 1
00000100:00100000:0.0:1789760790.633026:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762273050999 time 762272790583 state 0x1 ref 1
00000100:00100000:0.0:1789760790.633058:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762273050999 time 762319740767 state 0x0 ref 1
00000100:00100000:0.0:1789760790.633072:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521074944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760790.633132:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25935872, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:0.0:1789760790.633143:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.633157:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:0.0:1789760790.633162:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760790.633168:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.633182:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760790.678640:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25935872 -> 25939968
00010000:00010000:1.0:1789760790.678661:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.678675:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.678685:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.678692:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760790.678697:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.678707:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.678727:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.678735:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e005 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25935872->25939967] (req 25935872->25939967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760790.678822:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521074944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45749us (46001us total) trans 4294973652 rc 0/0
00000100:00100000:1.0:1789760790.678833:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6365
00000100:00100000:1.0:1789760790.678843:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762273050999 time 762319740767 state 0x2 ref 0
00000001:00080000:2.0:1789760790.678928:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973652 is committed
00000100:00100000:3.0:1789760790.682411:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760790.682528:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521075072
00000100:00100000:2.0:1789760790.682544:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521075072
00000100:00100000:2.0:1789760790.682606:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762273050999 time 762319740767 state 0x0 ref 1
00000100:00100000:2.0:1789760790.682622:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762320001183 time 762319740767 state 0x1 ref 1
00000100:00100000:2.0:1789760790.682660:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762320001183 time 762369342099 state 0x0 ref 1
00000100:00100000:2.0:1789760790.682674:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521075072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760790.682727:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25939968, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760790.682737:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.682752:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760790.682758:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760790.682764:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.682779:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760790.720739:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25939968 -> 25944064
00010000:00010000:2.0:1789760790.720760:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.720774:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.720783:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.720791:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760790.720796:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.720805:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.720832:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.720839:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e00c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25939968->25944063] (req 25939968->25944063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760790.721092:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521075072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38415us (38690us total) trans 4294973653 rc 0/0
00000100:00100000:2.0:1789760790.721105:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6366
00000100:00100000:2.0:1789760790.721116:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762320001183 time 762369342099 state 0x2 ref 0
00000001:00080000:2.0:1789760790.721160:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973653 is committed
00000100:00100000:3.0:1789760790.726164:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760790.726554:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521075200
00000100:00100000:0.0:1789760790.726569:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521075200
00000100:00100000:0.0:1789760790.726640:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762320001183 time 762369342099 state 0x0 ref 1
00000100:00100000:0.0:1789760790.726656:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762369602515 time 762369342099 state 0x1 ref 1
00000100:00100000:0.0:1789760790.726676:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762369602515 time 762413359321 state 0x0 ref 1
00000100:00100000:0.0:1789760790.726688:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521075200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760790.726735:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25944064, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:0.0:1789760790.726744:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.726760:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:0.0:1789760790.726765:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760790.726771:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760790.726784:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760790.775612:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973654 is committed
00002000:00010000:3.0:1789760790.775715:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25944064 -> 25948160
00010000:00010000:3.0:1789760790.775731:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.775744:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.775754:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.775762:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.775767:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.775775:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.775794:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.775803:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e013 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25944064->25948159] (req 25944064->25948159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.775896:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521075200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49205us (49744us total) trans 4294973654 rc 0/0
00000100:00100000:3.0:1789760790.775916:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6367
00000100:00100000:3.0:1789760790.775926:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762369602515 time 762413359321 state 0x2 ref 0
00000100:00100000:3.0:1789760790.788059:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760790.789614:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521075328
00000100:00100000:2.0:1789760790.789630:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521075328
00000100:00100000:2.0:1789760790.789694:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762369602515 time 762413359321 state 0x0 ref 1
00000100:00100000:2.0:1789760790.789709:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762413619737 time 762413359321 state 0x1 ref 1
00000100:00100000:2.0:1789760790.789746:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762413619737 time 762476428103 state 0x0 ref 1
00000100:00100000:2.0:1789760790.789760:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521075328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760790.789817:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25948160, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:2.0:1789760790.789827:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.789847:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760790.789852:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760790.789858:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.789873:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760790.858150:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973655 is committed
00002000:00010000:2.0:1789760790.861868:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25948160 -> 25952256
00010000:00010000:2.0:1789760790.861888:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.861912:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.861922:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.861930:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760790.861935:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.861948:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.861967:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.861976:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e01a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25948160->25952255] (req 25948160->25952255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760790.862083:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521075328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 72322us (74037us total) trans 4294973655 rc 0/0
00000100:00100000:2.0:1789760790.862093:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6368
00000100:00100000:2.0:1789760790.862101:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762413619737 time 762476428103 state 0x2 ref 0
00000100:00100000:2.0:1789760790.870223:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760790.870368:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521075456
00000100:00100000:1.0:1789760790.870386:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521075456
00000100:00100000:1.0:1789760790.870443:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762413619737 time 762476428103 state 0x0 ref 1
00000100:00100000:1.0:1789760790.870458:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762476688519 time 762476428103 state 0x1 ref 1
00000100:00100000:1.0:1789760790.870489:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762476688519 time 762557172234 state 0x0 ref 1
00000100:00100000:1.0:1789760790.870500:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521075456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760790.870547:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25952256, mtime: 0x6aad9517, atime: 0x0, ctime: 0x6aad9517, blocks: 0xc807
00010000:00010000:1.0:1789760790.870557:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.870573:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:1.0:1789760790.870577:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760790.870582:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760790.870595:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760790.916591:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25952256 -> 25956352
00002000:00010000:2.0:1789760790.916602:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760791 -> 1789760792
00002000:00010000:2.0:1789760790.916605:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760791 -> 1789760792
00010000:00010000:2.0:1789760790.916619:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.916633:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.916642:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.916650:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760790.916654:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.916669:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.916689:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.916697:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e021 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25952256->25956351] (req 25952256->25956351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760790.916797:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521075456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46293us (46579us total) trans 4294973656 rc 0/0
00000100:00100000:2.0:1789760790.916809:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6369
00000100:00100000:2.0:1789760790.916819:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762476688519 time 762557172234 state 0x2 ref 0
00000001:00080000:3.0:1789760790.916909:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973656 is committed
00000100:00100000:3.0:1789760790.920846:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760790.921225:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521075584
00000100:00100000:2.0:1789760790.921235:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521075584
00000100:00100000:2.0:1789760790.921292:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762476688519 time 762557172234 state 0x0 ref 1
00000100:00100000:2.0:1789760790.921307:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762557432650 time 762557172234 state 0x1 ref 1
00000100:00100000:2.0:1789760790.921412:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762557432650 time 762608094045 state 0x0 ref 1
00000100:00100000:2.0:1789760790.921425:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521075584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760790.921473:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25956352, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760790.921482:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.921501:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760790.921504:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760790.921511:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760790.921524:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760790.954779:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25956352 -> 25960448
00010000:00010000:3.0:1789760790.954798:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.954812:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.954821:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.954829:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.954834:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.954844:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.954863:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.954871:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a7d4a2/0x4a99e02bc60e028 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25956352->25960447] (req 25956352->25960447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760790.955035:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973657 is committed
00000100:00100000:3.0:1789760790.955049:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521075584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33621us (34207us total) trans 4294973657 rc 0/0
00000100:00100000:3.0:1789760790.955063:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6370
00000100:00100000:3.0:1789760790.955076:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762557432650 time 762608094045 state 0x2 ref 0
00000100:00100000:1.0:1789760790.958831:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760790.958913:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521075712
00000100:00100000:3.0:1789760790.958923:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521075712
00000100:00100000:3.0:1789760790.958974:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762557432650 time 762608094045 state 0x0 ref 1
00000100:00100000:3.0:1789760790.958989:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762608354461 time 762608094045 state 0x1 ref 1
00000100:00100000:3.0:1789760790.959020:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762608354461 time 762645702508 state 0x0 ref 1
00000100:00100000:3.0:1789760790.959030:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521075712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760790.959074:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25960448, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:3.0:1789760790.959083:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.959098:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:3.0:1789760790.959111:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760790.959118:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.959132:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760790.989460:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25960448 -> 25964544
00010000:00010000:3.0:1789760790.989480:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.989495:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.989505:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.989513:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760790.989517:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.989526:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.989544:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.989552:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e02f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25960448->25964543] (req 25960448->25964543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760790.989638:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521075712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30604us (30814us total) trans 4294973658 rc 0/0
00000100:00100000:3.0:1789760790.989648:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6371
00000100:00100000:3.0:1789760790.989656:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762608354461 time 762645702508 state 0x2 ref 0
00000001:00080000:1.0:1789760790.991267:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973658 is committed
00000100:00100000:2.0:1789760790.993307:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760790.993462:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521075840
00000100:00100000:3.0:1789760790.993473:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521075840
00000100:00100000:3.0:1789760790.993529:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762608354461 time 762645702508 state 0x0 ref 1
00000100:00100000:3.0:1789760790.993545:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762645962924 time 762645702508 state 0x1 ref 1
00000100:00100000:3.0:1789760790.993610:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762645962924 time 762680292121 state 0x0 ref 1
00000100:00100000:3.0:1789760790.993623:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521075840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760790.993671:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25964544, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:3.0:1789760790.993679:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.993694:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:3.0:1789760790.993699:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760790.993705:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760790.993719:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760791.034970:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973659 is committed
00002000:00010000:2.0:1789760791.035183:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25964544 -> 25968640
00010000:00010000:2.0:1789760791.035199:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.035212:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.035222:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.035229:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760791.035234:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.035243:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.035267:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.035276:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e036 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25964544->25968639] (req 25964544->25968639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760791.035430:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521075840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41805us (42127us total) trans 4294973659 rc 0/0
00000100:00100000:2.0:1789760791.035440:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6372
00000100:00100000:2.0:1789760791.035449:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762645962924 time 762680292121 state 0x2 ref 0
00000100:00100000:0.0:1789760791.038655:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760791.038747:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521075968
00000100:00100000:2.0:1789760791.038756:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521075968
00000100:00100000:2.0:1789760791.038813:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762645962924 time 762680292121 state 0x0 ref 1
00000100:00100000:2.0:1789760791.038829:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762680552537 time 762680292121 state 0x1 ref 1
00000100:00100000:2.0:1789760791.038894:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762680552537 time 762725575997 state 0x0 ref 1
00000100:00100000:2.0:1789760791.038970:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521075968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760791.039087:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25968640, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760791.039096:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.039111:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760791.039116:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760791.039122:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.039136:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760791.072508:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973660 is committed
00002000:00010000:2.0:1789760791.072609:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25968640 -> 25972736
00010000:00010000:2.0:1789760791.072625:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.072637:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.072646:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.072655:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760791.072661:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.072670:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.072688:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.072696:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e03d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25968640->25972735] (req 25968640->25972735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760791.072784:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521075968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33814us (34136us total) trans 4294973660 rc 0/0
00000100:00100000:2.0:1789760791.072795:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6373
00000100:00100000:2.0:1789760791.072804:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762680552537 time 762725575997 state 0x2 ref 0
00000100:00100000:1.0:1789760791.078104:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760791.078218:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521076096
00000100:00100000:2.0:1789760791.078228:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521076096
00000100:00100000:2.0:1789760791.078276:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762680552537 time 762725575997 state 0x0 ref 1
00000100:00100000:2.0:1789760791.078290:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762725836413 time 762725575997 state 0x1 ref 1
00000100:00100000:2.0:1789760791.078348:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762725836413 time 762765030789 state 0x0 ref 1
00000100:00100000:2.0:1789760791.078360:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521076096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760791.078413:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25972736, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760791.078421:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.078437:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760791.078440:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760791.078446:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.078460:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.097652:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:1.0:1789760791.130620:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973661 is committed
00002000:00010000:2.0:1789760791.130721:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25972736 -> 25976832
00010000:00010000:2.0:1789760791.130736:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.130749:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.130759:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.130766:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760791.130771:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.130780:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.130799:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.130807:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e044 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25972736->25976831] (req 25972736->25976831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760791.130894:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521076096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52531us (52794us total) trans 4294973661 rc 0/0
00000100:00100000:2.0:1789760791.130916:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6374
00000100:00100000:2.0:1789760791.130926:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762725836413 time 762765030789 state 0x2 ref 0
00000100:00100000:1.0:1789760791.138471:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760791.138664:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521076224
00000100:00100000:3.0:1789760791.138674:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521076224
00000100:00100000:3.0:1789760791.138725:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762725836413 time 762765030789 state 0x0 ref 1
00000100:00100000:3.0:1789760791.138740:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762765291205 time 762765030789 state 0x1 ref 1
00000100:00100000:3.0:1789760791.138803:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762765291205 time 762825485559 state 0x0 ref 1
00000100:00100000:3.0:1789760791.138816:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521076224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760791.138864:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25976832, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:3.0:1789760791.138872:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.138889:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:3.0:1789760791.138893:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760791.138899:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.138972:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760791.161421:0:3456:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00100000:1.0:1789760791.161441:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd98461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548775808:0@lo:41:osp-pre-0-1.0
00000100:00100000:1.0:1789760791.161568:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760791.161612:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548775808
00000100:00100000:3.0:1789760791.161620:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548775808
00000100:00100000:3.0:1789760791.161672:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465
00000100:00100000:3.0:1789760791.161691:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548775808:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:3.0:1789760791.161735:0:6461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:3.0:1789760791.161794:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3456:x1876699548775808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (226us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760791.161801:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465
00000100:00100000:1.0:1789760791.161947:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfd98461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3456:1876699548775808:0@lo:41:osp-pre-0-1.0
00000001:00080000:3.0:1789760791.185875:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973662 is committed
00002000:00010000:2.0:1789760791.186111:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25976832 -> 25980928
00010000:00010000:2.0:1789760791.186127:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.186140:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.186149:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.186157:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760791.186162:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.186231:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.186251:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.186259:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e04b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25976832->25980927] (req 25976832->25980927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760791.186392:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521076224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47573us (47926us total) trans 4294973662 rc 0/0
00000100:00100000:2.0:1789760791.186403:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6375
00000100:00100000:2.0:1789760791.186416:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762765291205 time 762825485559 state 0x2 ref 0
00000100:00100000:1.0:1789760791.190699:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760791.190776:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521076352
00000100:00100000:3.0:1789760791.190784:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521076352
00000100:00100000:3.0:1789760791.190836:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762765291205 time 762825485559 state 0x0 ref 1
00000100:00100000:3.0:1789760791.190854:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762825745975 time 762825485559 state 0x1 ref 1
00000100:00100000:3.0:1789760791.190881:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762825745975 time 762877564288 state 0x0 ref 1
00000100:00100000:3.0:1789760791.190891:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521076352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760791.190945:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25980928, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:3.0:1789760791.190954:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.190968:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:3.0:1789760791.190972:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760791.190977:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.190989:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760791.222518:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25980928 -> 25985024
00010000:00010000:3.0:1789760791.222537:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.222550:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.222560:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.222574:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760791.222579:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.222589:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.222606:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.222613:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e052 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25980928->25985023] (req 25980928->25985023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760791.222701:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521076352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31805us (32006us total) trans 4294973663 rc 0/0
00000100:00100000:3.0:1789760791.222711:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6376
00000100:00100000:3.0:1789760791.222720:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762825745975 time 762877564288 state 0x2 ref 0
00000001:00080000:2.0:1789760791.222908:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973663 is committed
00000100:00100000:1.0:1789760791.226971:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760791.227110:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521076480
00000100:00100000:2.0:1789760791.227120:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521076480
00000100:00100000:2.0:1789760791.227172:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762825745975 time 762877564288 state 0x0 ref 1
00000100:00100000:2.0:1789760791.227188:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762877824704 time 762877564288 state 0x1 ref 1
00000100:00100000:2.0:1789760791.227221:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762877824704 time 762913902731 state 0x0 ref 1
00000100:00100000:2.0:1789760791.227233:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521076480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760791.227284:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25985024, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760791.227293:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.227308:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760791.227335:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760791.227343:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.227358:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760791.256797:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25985024 -> 25989120
00010000:00010000:2.0:1789760791.256818:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.256832:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.256842:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.256850:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760791.256855:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.256864:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.256884:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.256892:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e059 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25985024->25989119] (req 25985024->25989119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760791.259827:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521076480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29768us (30037us total) trans 4294973664 rc 0/0
00000100:00100000:2.0:1789760791.259847:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6377
00000100:00100000:2.0:1789760791.259858:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762877824704 time 762913902731 state 0x2 ref 0
00000001:00080000:2.0:1789760791.259909:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973664 is committed
00000100:00100000:3.0:1789760791.260554:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760791.260702:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521076608
00000100:00100000:2.0:1789760791.260711:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521076608
00000100:00100000:2.0:1789760791.260761:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762877824704 time 762913902731 state 0x0 ref 1
00000100:00100000:2.0:1789760791.260776:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762914163147 time 762913902731 state 0x1 ref 1
00000100:00100000:2.0:1789760791.260803:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762914163147 time 762947485484 state 0x0 ref 1
00000100:00100000:2.0:1789760791.260814:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521076608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760791.260863:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25989120, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760791.260873:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.260889:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:2.0:1789760791.260893:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760791.260910:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.260924:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760791.296748:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973665 is committed
00002000:00010000:3.0:1789760791.296833:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25989120 -> 25993216
00010000:00010000:3.0:1789760791.296850:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.296864:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.296879:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.296887:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760791.296891:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.296967:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.296987:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.296996:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e060 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25989120->25993215] (req 25989120->25993215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760791.297262:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521076608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36445us (36706us total) trans 4294973665 rc 0/0
00000100:00100000:3.0:1789760791.297273:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6378
00000100:00100000:3.0:1789760791.297283:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762914163147 time 762947485484 state 0x2 ref 0
00000100:00100000:0.0:1789760791.303727:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760791.304184:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521076736
00000100:00100000:3.0:1789760791.304195:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521076736
00000100:00100000:3.0:1789760791.304252:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762914163147 time 762947485484 state 0x0 ref 1
00000100:00100000:3.0:1789760791.304266:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762947745900 time 762947485484 state 0x1 ref 1
00000100:00100000:3.0:1789760791.304440:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762947745900 time 762991120998 state 0x0 ref 1
00000100:00100000:3.0:1789760791.304455:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521076736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760791.304502:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25993216, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:3.0:1789760791.304512:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.304531:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=762s v=(0 0)
00010000:00010000:3.0:1789760791.304536:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760791.304542:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.304557:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760791.355891:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973666 is committed
00002000:00010000:3.0:1789760791.356716:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25993216 -> 25997312
00010000:00010000:3.0:1789760791.356734:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.356755:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.356764:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.356771:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760791.356778:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.356786:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.356809:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.356817:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e067 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25993216->25997311] (req 25993216->25997311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760791.356925:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521076736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52468us (53204us total) trans 4294973666 rc 0/0
00000100:00100000:3.0:1789760791.356935:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6379
00000100:00100000:3.0:1789760791.356944:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762947745900 time 762991120998 state 0x2 ref 0
00000100:00100000:1.0:1789760791.364506:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760791.364691:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521076864
00000100:00100000:3.0:1789760791.364701:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521076864
00000100:00100000:3.0:1789760791.364753:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762947745900 time 762991120998 state 0x0 ref 1
00000100:00100000:3.0:1789760791.364769:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762991381414 time 762991120998 state 0x1 ref 1
00000100:00100000:3.0:1789760791.364800:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762991381414 time 763051482693 state 0x0 ref 1
00000100:00100000:3.0:1789760791.364813:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521076864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760791.364861:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 25997312, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:3.0:1789760791.364872:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.364888:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:3.0:1789760791.364893:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760791.364900:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.364914:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760791.403725:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973667 is committed
00002000:00010000:0.0:1789760791.404066:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 25997312 -> 26001408
00010000:00010000:0.0:1789760791.404083:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.404102:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.404111:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.404119:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760791.404124:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.404135:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.404155:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.404164:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e06e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [25997312->26001407] (req 25997312->26001407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760791.404300:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521076864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39484us (39804us total) trans 4294973667 rc 0/0
00000100:00100000:0.0:1789760791.404355:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6380
00000100:00100000:0.0:1789760791.404375:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762991381414 time 763051482693 state 0x2 ref 0
00000100:00100000:1.0:1789760791.411772:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760791.414338:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521076992
00000100:00100000:2.0:1789760791.414352:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521076992
00000100:00100000:2.0:1789760791.414491:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 762991381414 time 763051482693 state 0x0 ref 1
00000100:00100000:2.0:1789760791.414507:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763051743109 time 763051482693 state 0x1 ref 1
00000100:00100000:2.0:1789760791.414703:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763051743109 time 763101384209 state 0x0 ref 1
00000100:00100000:2.0:1789760791.414719:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521076992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760791.414768:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26001408, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760791.414778:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.414794:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:2.0:1789760791.414798:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760791.414804:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.414818:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760791.464074:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973668 is committed
00002000:00010000:3.0:1789760791.464240:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26001408 -> 26005504
00010000:00010000:3.0:1789760791.464256:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.464269:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.464278:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.464284:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760791.464289:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.464298:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.464340:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.464349:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e075 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26001408->26005503] (req 26001408->26005503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760791.464481:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521076992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49760us (52713us total) trans 4294973668 rc 0/0
00000100:00100000:3.0:1789760791.464492:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6381
00000100:00100000:3.0:1789760791.464501:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763051743109 time 763101384209 state 0x2 ref 0
00000100:00100000:1.0:1789760791.476728:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760791.476825:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521077120
00000100:00100000:2.0:1789760791.476835:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521077120
00000100:00100000:2.0:1789760791.476889:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763051743109 time 763101384209 state 0x0 ref 1
00000100:00100000:2.0:1789760791.476905:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763101644625 time 763101384209 state 0x1 ref 1
00000100:00100000:2.0:1789760791.476938:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763101644625 time 763163620455 state 0x0 ref 1
00000100:00100000:2.0:1789760791.476951:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521077120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760791.476997:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26005504, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760791.477007:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.477023:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:2.0:1789760791.477027:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760791.477033:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.477047:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760791.517189:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973669 is committed
00002000:00010000:2.0:1789760791.517973:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26005504 -> 26009600
00010000:00010000:2.0:1789760791.517991:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.518004:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.518014:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.518021:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760791.518026:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.518034:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.518054:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.518062:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e07c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26005504->26009599] (req 26005504->26009599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760791.518168:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521077120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41214us (41444us total) trans 4294973669 rc 0/0
00000100:00100000:2.0:1789760791.518179:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6382
00000100:00100000:2.0:1789760791.518188:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763101644625 time 763163620455 state 0x2 ref 0
00000100:00100000:3.0:1789760791.530591:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760791.534895:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521077248
00000100:00100000:2.0:1789760791.534910:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521077248
00000100:00100000:2.0:1789760791.534971:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763101644625 time 763163620455 state 0x0 ref 1
00000100:00100000:2.0:1789760791.534986:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763163880871 time 763163620455 state 0x1 ref 1
00000100:00100000:2.0:1789760791.535413:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763163880871 time 763222092904 state 0x0 ref 1
00000100:00100000:2.0:1789760791.535429:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521077248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760791.535482:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26009600, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760791.535492:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.535560:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:2.0:1789760791.535566:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760791.535573:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.535589:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760791.579235:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973670 is committed
00002000:00010000:2.0:1789760791.579402:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26009600 -> 26013696
00010000:00010000:2.0:1789760791.579418:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.579431:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.579440:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.579446:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760791.579451:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.579459:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.579476:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.579485:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e083 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26009600->26013695] (req 26009600->26013695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760791.579573:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521077248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44144us (48988us total) trans 4294973670 rc 0/0
00000100:00100000:2.0:1789760791.579584:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6383
00000100:00100000:2.0:1789760791.579594:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763163880871 time 763222092904 state 0x2 ref 0
00000100:00100000:1.0:1789760791.586384:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760791.586592:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521077376
00000100:00100000:0.0:1789760791.586603:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521077376
00000100:00100000:0.0:1789760791.586660:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763163880871 time 763222092904 state 0x0 ref 1
00000100:00100000:0.0:1789760791.586676:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763222353320 time 763222092904 state 0x1 ref 1
00000100:00100000:0.0:1789760791.586709:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763222353320 time 763273390363 state 0x0 ref 1
00000100:00100000:0.0:1789760791.586721:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521077376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760791.586772:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26013696, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:0.0:1789760791.586781:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.586798:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:0.0:1789760791.586803:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760791.586809:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.586823:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760791.651272:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973671 is committed
00002000:00010000:1.0:1789760791.654739:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26013696 -> 26017792
00010000:00010000:1.0:1789760791.654763:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.654776:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.654786:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.654793:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760791.654797:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.654806:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.654825:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.654833:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e08a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26013696->26017791] (req 26013696->26017791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760791.655296:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521077376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 68570us (68927us total) trans 4294973671 rc 0/0
00000100:00100000:1.0:1789760791.655308:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6384
00000100:00100000:1.0:1789760791.655379:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763222353320 time 763273390363 state 0x2 ref 0
00000100:00100000:1.0:1789760791.673640:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760791.673718:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521077504
00000100:00100000:3.0:1789760791.673727:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521077504
00000100:00100000:3.0:1789760791.673778:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763222353320 time 763273390363 state 0x0 ref 1
00000100:00100000:3.0:1789760791.673793:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763273650779 time 763273390363 state 0x1 ref 1
00000100:00100000:3.0:1789760791.673823:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763273650779 time 763360506199 state 0x0 ref 1
00000100:00100000:3.0:1789760791.673835:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521077504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760791.673883:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26017792, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:3.0:1789760791.673893:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.673914:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:3.0:1789760791.673918:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760791.673924:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.673938:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760791.702357:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973672 is committed
00002000:00010000:1.0:1789760791.702528:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26017792 -> 26021888
00010000:00010000:1.0:1789760791.702545:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.702558:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.702567:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.702582:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760791.702587:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.702597:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.702616:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.702625:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e091 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26017792->26021887] (req 26017792->26021887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760791.702720:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521077504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28882us (29084us total) trans 4294973672 rc 0/0
00000100:00100000:1.0:1789760791.702731:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6385
00000100:00100000:1.0:1789760791.702740:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763273650779 time 763360506199 state 0x2 ref 0
00000100:00100000:2.0:1789760791.711505:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760791.711594:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521077632
00000100:00100000:0.0:1789760791.711603:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521077632
00000100:00100000:0.0:1789760791.711652:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763273650779 time 763360506199 state 0x0 ref 1
00000100:00100000:0.0:1789760791.711667:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763360766615 time 763360506199 state 0x1 ref 1
00000100:00100000:0.0:1789760791.711920:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763360766615 time 763398599724 state 0x0 ref 1
00000100:00100000:0.0:1789760791.711936:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521077632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760791.711994:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26021888, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:0.0:1789760791.712006:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.712023:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:0.0:1789760791.712028:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760791.712036:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.712052:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760791.747167:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973673 is committed
00002000:00010000:1.0:1789760791.747361:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26021888 -> 26025984
00010000:00010000:1.0:1789760791.747391:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.747404:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.747417:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.747424:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760791.747429:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.747438:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.747463:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.747471:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033f5c4f2/0x4a99e02bc60e098 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26021888->26025983] (req 26021888->26025983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760791.747552:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521077632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35615us (36051us total) trans 4294973673 rc 0/0
00000100:00100000:1.0:1789760791.747563:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6386
00000100:00100000:1.0:1789760791.747573:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763360766615 time 763398599724 state 0x2 ref 0
00000100:00100000:3.0:1789760791.765433:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760791.765625:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521077760
00000100:00100000:2.0:1789760791.765635:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521077760
00000100:00100000:2.0:1789760791.765692:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763360766615 time 763398599724 state 0x0 ref 1
00000100:00100000:2.0:1789760791.765708:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763398860140 time 763398599724 state 0x1 ref 1
00000100:00100000:2.0:1789760791.765742:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763398860140 time 763452425569 state 0x0 ref 1
00000100:00100000:2.0:1789760791.765754:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521077760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760791.765805:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26025984, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:2.0:1789760791.765814:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.765831:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:2.0:1789760791.765835:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760791.765841:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760791.765854:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760791.801478:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973674 is committed
00002000:00010000:3.0:1789760791.801863:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26025984 -> 26030080
00010000:00010000:3.0:1789760791.801878:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.801892:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.801903:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.801911:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760791.801916:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.801926:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.801945:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.801953:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e09f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26025984->26030079] (req 26025984->26030079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760791.803193:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521077760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37431us (37761us total) trans 4294973674 rc 0/0
00000100:00100000:3.0:1789760791.803205:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6387
00000100:00100000:3.0:1789760791.803215:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763398860140 time 763452425569 state 0x2 ref 0
00000100:00100000:0.0:1789760791.808099:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760791.808169:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521077888
00000100:00100000:1.0:1789760791.808179:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521077888
00000100:00100000:1.0:1789760791.808233:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763398860140 time 763452425569 state 0x0 ref 1
00000100:00100000:1.0:1789760791.808253:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763452685985 time 763452425569 state 0x1 ref 1
00000100:00100000:1.0:1789760791.808285:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763452685985 time 763494967230 state 0x0 ref 1
00000100:00100000:1.0:1789760791.808298:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521077888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760791.808378:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26030080, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:1.0:1789760791.808387:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.808404:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:1.0:1789760791.808408:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760791.808414:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.808427:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760791.848297:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26030080 -> 26034176
00010000:00010000:1.0:1789760791.848344:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.848357:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.848375:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.848386:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760791.848391:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.848399:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.848417:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.848426:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e0a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26030080->26034175] (req 26030080->26034175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760791.848509:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521077888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40209us (40416us total) trans 4294973675 rc 0/0
00000100:00100000:1.0:1789760791.848520:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6388
00000100:00100000:1.0:1789760791.848529:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763452685985 time 763494967230 state 0x2 ref 0
00000001:00080000:2.0:1789760791.848603:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973675 is committed
00000100:00100000:2.0:1789760791.852620:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760791.852772:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521078016
00000100:00100000:1.0:1789760791.852782:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521078016
00000100:00100000:3.0:1789760791.853012:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763452685985 time 763494967230 state 0x0 ref 1
00000100:00100000:3.0:1789760791.853027:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763495227646 time 763494967230 state 0x1 ref 1
00000100:00100000:3.0:1789760791.853110:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763495227646 time 763539790991 state 0x0 ref 1
00000100:00100000:3.0:1789760791.853181:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521078016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760791.853236:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26034176, mtime: 0x6aad9518, atime: 0x0, ctime: 0x6aad9518, blocks: 0xc807
00010000:00010000:3.0:1789760791.853246:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.853268:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:3.0:1789760791.853274:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760791.853281:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.853295:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760791.899437:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26034176 -> 26038272
00002000:00010000:0.0:1789760791.899447:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760792 -> 1789760793
00002000:00010000:0.0:1789760791.899450:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760792 -> 1789760793
00010000:00010000:0.0:1789760791.899465:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.899476:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.899483:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.899489:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760791.899492:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.899498:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.899513:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.899518:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e0ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26034176->26038271] (req 26034176->26038271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760791.899599:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521078016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46473us (46983us total) trans 4294973676 rc 0/0
00000100:00100000:0.0:1789760791.899610:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6389
00000100:00100000:0.0:1789760791.899619:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763495227646 time 763539790991 state 0x2 ref 0
00000001:00080000:1.0:1789760791.899709:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973676 is committed
00000100:00100000:3.0:1789760791.903653:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760791.903755:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521078144
00000100:00100000:0.0:1789760791.903767:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521078144
00000100:00100000:0.0:1789760791.903829:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763495227646 time 763539790991 state 0x0 ref 1
00000100:00100000:0.0:1789760791.903855:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763540051407 time 763539790991 state 0x1 ref 1
00000100:00100000:0.0:1789760791.903884:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763540051407 time 763590566263 state 0x0 ref 1
00000100:00100000:0.0:1789760791.903900:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521078144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760791.903960:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26038272, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:0.0:1789760791.903970:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.903986:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:0.0:1789760791.903990:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760791.903997:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760791.904011:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760791.949651:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26038272 -> 26042368
00010000:00010000:1.0:1789760791.949672:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.949685:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.949695:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.949703:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760791.949708:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.949718:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.949738:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760791.949745:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e0b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26038272->26042367] (req 26038272->26042367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760791.949842:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521078144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45941us (46204us total) trans 4294973677 rc 0/0
00000100:00100000:1.0:1789760791.949853:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6390
00000100:00100000:1.0:1789760791.949863:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763540051407 time 763590566263 state 0x2 ref 0
00000001:00080000:2.0:1789760791.951128:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973677 is committed
00000100:00100000:2.0:1789760791.954344:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760791.954490:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521078272
00000100:00100000:3.0:1789760791.954500:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521078272
00000100:00100000:3.0:1789760791.954556:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763540051407 time 763590566263 state 0x0 ref 1
00000100:00100000:3.0:1789760791.954570:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763590826679 time 763590566263 state 0x1 ref 1
00000100:00100000:3.0:1789760791.954601:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763590826679 time 763641283689 state 0x0 ref 1
00000100:00100000:3.0:1789760791.954614:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521078272:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760791.954674:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26042368, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:3.0:1789760791.954684:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.954699:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:3.0:1789760791.954704:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760791.954711:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760791.954724:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760791.999912:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973678 is committed
00002000:00010000:3.0:1789760792.000072:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26042368 -> 26046464
00010000:00010000:3.0:1789760792.000088:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.000100:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.000110:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.000128:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760792.000133:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.000141:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.000159:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.000167:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e0bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26042368->26046463] (req 26042368->26046463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.000268:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521078272:12345-192.168.203.16@tcp:4:dd.0 Request processed in 45651us (45953us total) trans 4294973678 rc 0/0
00000100:00100000:3.0:1789760792.000282:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6391
00000100:00100000:3.0:1789760792.000292:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763590826679 time 763641283689 state 0x2 ref 0
00000100:00100000:3.0:1789760792.004706:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760792.004799:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521078400
00000100:00100000:1.0:1789760792.004808:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521078400
00000100:00100000:1.0:1789760792.004896:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763590826679 time 763641283689 state 0x0 ref 1
00000100:00100000:1.0:1789760792.004913:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763641544105 time 763641283689 state 0x1 ref 1
00000100:00080000:0.0:1789760792.004995:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:1.0:1789760792.005040:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763641544105 time 763691721372 state 0x0 ref 1
00000100:00100000:1.0:1789760792.005054:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521078400:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760792.005109:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26046464, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:1.0:1789760792.005118:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.005134:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:1.0:1789760792.005139:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760792.005146:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.005159:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760792.066980:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973679 is committed
00002000:00010000:1.0:1789760792.067157:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26046464 -> 26050560
00010000:00010000:1.0:1789760792.067173:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.067187:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.067196:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.067204:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760792.067209:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.067218:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.067237:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.067244:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26046464->26050559] (req 26046464->26050559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760792.067356:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+6:2408:x1876699521078400:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62300us (62654us total) trans 4294973679 rc 0/0
00000100:00100000:1.0:1789760792.067377:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6392
00000100:00100000:1.0:1789760792.067387:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763641544105 time 763691721372 state 0x2 ref 0
00000100:00100000:1.0:1789760792.074867:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760792.075929:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521078528
00000100:00100000:0.0:1789760792.075941:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521078528
00000100:00100000:0.0:1789760792.076006:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763641544105 time 763691721372 state 0x0 ref 1
00000100:00100000:0.0:1789760792.076022:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763691981788 time 763691721372 state 0x1 ref 1
00000100:00100000:0.0:1789760792.076055:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763691981788 time 763762737202 state 0x0 ref 1
00000100:00100000:0.0:1789760792.076067:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521078528:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760792.076119:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26050560, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:0.0:1789760792.076129:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.076145:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:0.0:1789760792.076149:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760792.076156:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.076169:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760792.112853:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26050560 -> 26054656
00010000:00010000:1.0:1789760792.112873:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760792.112885:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973680 is committed
00010000:00010000:1.0:1789760792.112886:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.112895:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.112907:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760792.112912:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.112922:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.112941:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.112949:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e0c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26050560->26054655] (req 26050560->26054655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760792.113047:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd98463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521078528:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36977us (38184us total) trans 4294973680 rc 0/0
00000100:00100000:1.0:1789760792.113056:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6393
00000100:00100000:1.0:1789760792.113066:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763691981788 time 763762737202 state 0x2 ref 0
00000100:00100000:1.0:1789760792.116866:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760792.117918:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521078656
00000100:00100000:2.0:1789760792.117930:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521078656
00000100:00100000:2.0:1789760792.117988:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763691981788 time 763762737202 state 0x0 ref 1
00000100:00100000:2.0:1789760792.118014:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763762997618 time 763762737202 state 0x1 ref 1
00000100:00100000:2.0:1789760792.118086:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763762997618 time 763804766867 state 0x0 ref 1
00000100:00100000:2.0:1789760792.118099:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521078656:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760792.118148:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26054656, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:2.0:1789760792.118157:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.118174:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:2.0:1789760792.118178:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760792.118185:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.118200:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.121796:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760792.155784:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973681 is committed
00002000:00010000:2.0:1789760792.155859:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26054656 -> 26058752
00010000:00010000:2.0:1789760792.155876:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.156134:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.156145:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.156153:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760792.156157:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.156167:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.156189:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.156196:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e0d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26054656->26058751] (req 26054656->26058751) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760792.156418:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521078656:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38317us (39557us total) trans 4294973681 rc 0/0
00000100:00100000:2.0:1789760792.156428:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6394
00000100:00100000:2.0:1789760792.156437:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763762997618 time 763804766867 state 0x2 ref 0
00000100:00100000:3.0:1789760792.159843:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760792.160038:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521078784
00000100:00100000:2.0:1789760792.160047:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521078784
00000100:00100000:2.0:1789760792.160103:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763762997618 time 763804766867 state 0x0 ref 1
00000100:00100000:2.0:1789760792.160118:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763805027283 time 763804766867 state 0x1 ref 1
00000100:00100000:2.0:1789760792.160148:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763805027283 time 763846830772 state 0x0 ref 1
00000100:00100000:2.0:1789760792.160159:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521078784:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760792.160209:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26058752, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:2.0:1789760792.160220:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.160236:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:2.0:1789760792.160240:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760792.160246:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.160260:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760792.185729:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1789760792.185750:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8c6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548775936:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1789760792.185819:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760792.185995:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548775936
00000100:00100000:2.0:1789760792.186004:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548775936
00000100:00100000:2.0:1789760792.186062:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466
00000100:00100000:2.0:1789760792.186073:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548775936:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:2.0:1789760792.186122:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:2.0:1789760792.186176:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548775936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (356us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760792.186183:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466
00000100:00100000:2.0:1789760792.186228:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8c6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548775936:0@lo:41:osp-pre-1-0.0
00000001:00080000:0.0:1789760792.188649:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973682 is committed
00002000:00010000:3.0:1789760792.188749:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26058752 -> 26062848
00010000:00010000:3.0:1789760792.188764:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.188776:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.188784:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.188791:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760792.188795:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.188803:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.188821:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.188832:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e0d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26058752->26062847] (req 26058752->26062847) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.188925:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521078784:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28762us (29088us total) trans 4294973682 rc 0/0
00000100:00100000:3.0:1789760792.188935:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6395
00000100:00100000:3.0:1789760792.188944:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763805027283 time 763846830772 state 0x2 ref 0
00000100:00100000:0.0:1789760792.193860:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760792.194100:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521078912
00000100:00100000:1.0:1789760792.194109:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521078912
00000100:00100000:1.0:1789760792.194165:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763805027283 time 763846830772 state 0x0 ref 1
00000100:00100000:1.0:1789760792.194180:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763847091188 time 763846830772 state 0x1 ref 1
00000100:00100000:1.0:1789760792.194250:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763847091188 time 763880931536 state 0x0 ref 1
00000100:00100000:1.0:1789760792.194264:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521078912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760792.194341:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26062848, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:1.0:1789760792.194351:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.194377:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:1.0:1789760792.194382:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760792.194388:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.194402:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760792.225222:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973683 is committed
00002000:00010000:1.0:1789760792.225370:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26062848 -> 26066944
00010000:00010000:1.0:1789760792.225388:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.225403:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.225412:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.225421:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760792.225426:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.225436:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.225457:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.225466:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e0de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26062848->26066943] (req 26062848->26066943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760792.225550:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521078912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31284us (31696us total) trans 4294973683 rc 0/0
00000100:00100000:1.0:1789760792.225561:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6396
00000100:00100000:1.0:1789760792.225571:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763847091188 time 763880931536 state 0x2 ref 0
00000100:00100000:2.0:1789760792.229373:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760792.229469:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521079040
00000100:00100000:1.0:1789760792.229479:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521079040
00000100:00100000:1.0:1789760792.229538:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763847091188 time 763880931536 state 0x0 ref 1
00000100:00100000:1.0:1789760792.229555:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763881191952 time 763880931536 state 0x1 ref 1
00000100:00100000:1.0:1789760792.229588:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763881191952 time 763916270166 state 0x0 ref 1
00000100:00100000:1.0:1789760792.229602:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521079040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760792.229658:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26066944, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:1.0:1789760792.229668:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.229684:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:1.0:1789760792.229690:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760792.229697:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.229711:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760792.264745:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973684 is committed
00002000:00010000:0.0:1789760792.264852:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26066944 -> 26071040
00010000:00010000:0.0:1789760792.264868:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.264881:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.264955:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.264965:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760792.264970:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.264979:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.265068:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.265078:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e0e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26066944->26071039] (req 26066944->26071039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760792.265201:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521079040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35597us (35887us total) trans 4294973684 rc 0/0
00000100:00100000:0.0:1789760792.265212:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6397
00000100:00100000:0.0:1789760792.265221:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763881191952 time 763916270166 state 0x2 ref 0
00000100:00100000:0.0:1789760792.268919:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760792.269004:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521079168
00000100:00100000:2.0:1789760792.269014:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521079168
00000100:00100000:2.0:1789760792.269065:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763881191952 time 763916270166 state 0x0 ref 1
00000100:00100000:2.0:1789760792.269081:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763916530582 time 763916270166 state 0x1 ref 1
00000100:00100000:2.0:1789760792.269105:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763916530582 time 763955788169 state 0x0 ref 1
00000100:00100000:2.0:1789760792.269119:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521079168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760792.269165:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26071040, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:2.0:1789760792.269175:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.269190:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:2.0:1789760792.269195:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760792.269201:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.269214:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760792.299448:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973685 is committed
00002000:00010000:3.0:1789760792.299549:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26071040 -> 26075136
00010000:00010000:3.0:1789760792.299564:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.299578:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.299587:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.299594:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760792.299599:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.299606:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.299629:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.299637:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e0ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26071040->26075135] (req 26071040->26075135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.299729:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521079168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30608us (30814us total) trans 4294973685 rc 0/0
00000100:00100000:3.0:1789760792.299739:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6398
00000100:00100000:3.0:1789760792.299749:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763916530582 time 763955788169 state 0x2 ref 0
00000100:00100000:0.0:1789760792.303128:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.303298:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521079296
00000100:00100000:3.0:1789760792.303308:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521079296
00000100:00100000:3.0:1789760792.303406:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763916530582 time 763955788169 state 0x0 ref 1
00000100:00100000:3.0:1789760792.303421:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763956048585 time 763955788169 state 0x1 ref 1
00000100:00100000:3.0:1789760792.303441:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763956048585 time 763990123932 state 0x0 ref 1
00000100:00100000:3.0:1789760792.303453:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521079296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760792.303503:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26075136, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:3.0:1789760792.303512:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.303527:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=763s v=(0 0)
00010000:00010000:3.0:1789760792.303532:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760792.303538:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.303551:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760792.334303:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26075136 -> 26079232
00010000:00010000:3.0:1789760792.334338:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.334351:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.334369:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.334376:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760792.334381:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.334390:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.334411:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.334419:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e0f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26075136->26079231] (req 26075136->26079231) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.334518:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521079296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31062us (31394us total) trans 4294973686 rc 0/0
00000100:00100000:3.0:1789760792.334530:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6399
00000100:00100000:3.0:1789760792.334541:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763956048585 time 763990123932 state 0x2 ref 0
00000001:00080000:0.0:1789760792.334615:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973686 is committed
00000100:00100000:2.0:1789760792.338701:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760792.338797:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521079424
00000100:00100000:1.0:1789760792.338812:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521079424
00000100:00100000:1.0:1789760792.338868:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763956048585 time 763990123932 state 0x0 ref 1
00000100:00100000:1.0:1789760792.338882:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763990384348 time 763990123932 state 0x1 ref 1
00000100:00100000:1.0:1789760792.338912:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763990384348 time 764025595183 state 0x0 ref 1
00000100:00100000:1.0:1789760792.338925:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521079424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760792.338974:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26079232, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:1.0:1789760792.338984:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.339011:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:1.0:1789760792.339016:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760792.339023:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.339043:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760792.371986:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973687 is committed
00002000:00010000:0.0:1789760792.372125:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26079232 -> 26083328
00010000:00010000:0.0:1789760792.372142:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.372155:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.372166:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.372180:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760792.372186:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.372197:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.372216:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.372225:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e0fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26079232->26083327] (req 26079232->26083327) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760792.372367:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521079424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33430us (33663us total) trans 4294973687 rc 0/0
00000100:00100000:0.0:1789760792.372379:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6400
00000100:00100000:0.0:1789760792.372389:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763990384348 time 764025595183 state 0x2 ref 0
00000100:00100000:2.0:1789760792.375763:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760792.376178:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521079552
00000100:00100000:0.0:1789760792.376188:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521079552
00000100:00100000:0.0:1789760792.376243:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 763990384348 time 764025595183 state 0x0 ref 1
00000100:00100000:0.0:1789760792.376260:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764025855599 time 764025595183 state 0x1 ref 1
00000100:00100000:0.0:1789760792.376376:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764025855599 time 764063056837 state 0x0 ref 1
00000100:00100000:0.0:1789760792.376393:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521079552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760792.376444:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26083328, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:0.0:1789760792.376453:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.376469:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:0.0:1789760792.376474:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760792.376480:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.376495:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760792.407262:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26083328 -> 26087424
00010000:00010000:0.0:1789760792.407283:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.407297:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.407307:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.407347:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760792.407352:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.407370:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.407390:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.407398:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a8e265/0x4a99e02bc60e101 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26083328->26087423] (req 26083328->26087423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760792.407485:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521079552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31088us (31725us total) trans 4294973688 rc 0/0
00000100:00100000:0.0:1789760792.407496:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6401
00000100:00100000:0.0:1789760792.407505:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764025855599 time 764063056837 state 0x2 ref 0
00000100:00100000:3.0:1789760792.411568:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.411606:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.411683:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.411709:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.411726:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.411747:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.411776:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521080320
00000100:00100000:3.0:1789760792.411785:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521080320
00000100:00100000:3.0:1789760792.411841:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764025855599 time 764063056837 state 0x0 ref 1
00000100:00100000:3.0:1789760792.411858:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764063317253 time 764063056837 state 0x1 ref 1
00000100:00100000:3.0:1789760792.411883:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764063317253 time 764098565399 state 0x0 ref 1
00000100:00100000:3.0:1789760792.411902:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521080320:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760792.411951:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26087424, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:3.0:1789760792.411959:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.411976:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:3.0:1789760792.411981:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760792.411987:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.412069:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.412504:0:6451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521079680
00000100:00100000:3.0:1789760792.412509:0:6451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521079680
00000100:00100000:3.0:1789760792.412542:0:6451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 490
00000100:00100000:3.0:1789760792.412549:0:6451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699521079680:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760792.412611:0:6451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2406:x1876699521079680:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 61us (1003us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760792.412619:0:6451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 490
00000100:00100000:3.0:1789760792.412651:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521079936
00000100:00100000:3.0:1789760792.412655:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521079936
00000100:00100000:3.0:1789760792.412688:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521080192
00000100:00100000:3.0:1789760792.412690:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521080192
00000100:00100000:3.0:1789760792.412704:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521079808
00000100:00100000:3.0:1789760792.412706:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521079808
00000100:00100000:3.0:1789760792.412718:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521080064
00000100:00100000:3.0:1789760792.412720:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521080064
00000100:00100000:3.0:1789760792.412734:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 973
00000100:00100000:3.0:1789760792.412741:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521079936:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760792.412770:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521079936:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (1088us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760792.412776:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 973
00000100:00100000:3.0:1789760792.412797:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 974
00000100:00100000:3.0:1789760792.412804:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699521080192:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760792.412830:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699521080192:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (1120us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760792.412836:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 974
00000100:00100000:3.0:1789760792.412847:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 975
00000100:00100000:3.0:1789760792.412853:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699521079808:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760792.412876:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2406:x1876699521079808:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (1148us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760792.412882:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 975
00000100:00100000:3.0:1789760792.412894:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 976
00000100:00100000:3.0:1789760792.412900:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699521080064:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760792.412925:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2406:x1876699521080064:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (1177us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760792.412931:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 976
00000100:00080000:3.0:1789760792.412960:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:3.0:1789760792.412964:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000001:00080000:1.0:1789760792.413762:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973688 is committed
00000001:00080000:1.0:1789760792.450760:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973689 is committed
00002000:00010000:3.0:1789760792.450871:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26087424 -> 26091520
00010000:00010000:3.0:1789760792.450953:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.450969:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.450979:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.451068:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760792.451074:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.451084:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.451107:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.451115:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e108 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26087424->26091519] (req 26087424->26091519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.451218:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda617f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521080320:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39314us (39655us total) trans 4294973689 rc 0/0
00000100:00100000:3.0:1789760792.451229:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6402
00000100:00100000:3.0:1789760792.451239:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764063317253 time 764098565399 state 0x2 ref 0
00000100:00100000:0.0:1789760792.454645:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.454716:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521080448
00000100:00100000:3.0:1789760792.454726:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521080448
00000100:00100000:3.0:1789760792.454796:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764063317253 time 764098565399 state 0x0 ref 1
00000100:00100000:3.0:1789760792.454813:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764098825815 time 764098565399 state 0x1 ref 1
00000100:00100000:3.0:1789760792.454842:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764098825815 time 764141524616 state 0x0 ref 1
00000100:00100000:3.0:1789760792.454859:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521080448:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760792.454973:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26091520, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:3.0:1789760792.454983:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.455066:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:3.0:1789760792.455071:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760792.455078:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.455092:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760792.486837:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973690 is committed
00002000:00010000:2.0:1789760792.487074:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26091520 -> 26095616
00010000:00010000:2.0:1789760792.487090:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.487104:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.487114:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.487122:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760792.487126:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.487141:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.487160:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.487168:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e10f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26091520->26095615] (req 26091520->26095615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760792.487301:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dadf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521080448:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32439us (32659us total) trans 4294973690 rc 0/0
00000100:00100000:2.0:1789760792.487353:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6403
00000100:00100000:2.0:1789760792.487372:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764098825815 time 764141524616 state 0x2 ref 0
00000100:00100000:3.0:1789760792.490920:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760792.490976:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521080576
00000100:00100000:2.0:1789760792.490985:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521080576
00000100:00100000:2.0:1789760792.491045:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764098825815 time 764141524616 state 0x0 ref 1
00000100:00100000:2.0:1789760792.491061:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764141785032 time 764141524616 state 0x1 ref 1
00000100:00100000:2.0:1789760792.491097:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764141785032 time 764177779067 state 0x0 ref 1
00000100:00100000:2.0:1789760792.491110:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521080576:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760792.491158:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26095616, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:2.0:1789760792.491167:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.491183:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:2.0:1789760792.491188:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760792.491195:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.491209:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760792.527460:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973691 is committed
00002000:00010000:3.0:1789760792.527592:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26095616 -> 26099712
00010000:00010000:3.0:1789760792.527608:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.527621:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.527629:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.527636:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760792.527640:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.527650:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.527669:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.527677:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e116 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26095616->26099711] (req 26095616->26099711) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.528481:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521080576:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37367us (37564us total) trans 4294973691 rc 0/0
00000100:00100000:3.0:1789760792.528493:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6404
00000100:00100000:3.0:1789760792.528502:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764141785032 time 764177779067 state 0x2 ref 0
00000100:00100000:0.0:1789760792.531446:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760792.531524:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521080704
00000100:00100000:1.0:1789760792.531533:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521080704
00000100:00100000:1.0:1789760792.531582:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764141785032 time 764177779067 state 0x0 ref 1
00000100:00100000:1.0:1789760792.531597:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764178039483 time 764177779067 state 0x1 ref 1
00000100:00100000:1.0:1789760792.531630:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764178039483 time 764218312663 state 0x0 ref 1
00000100:00100000:1.0:1789760792.531643:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521080704:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760792.531691:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26099712, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:1.0:1789760792.531700:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.531715:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:1.0:1789760792.531720:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760792.531727:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.531741:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760792.566284:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973692 is committed
00002000:00010000:2.0:1789760792.566378:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26099712 -> 26103808
00010000:00010000:2.0:1789760792.566394:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.566407:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.566416:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.566424:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760792.566429:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.566439:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.566463:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.566471:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e11d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26099712->26103807] (req 26099712->26103807) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760792.566587:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521080704:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34942us (35147us total) trans 4294973692 rc 0/0
00000100:00100000:2.0:1789760792.566597:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6405
00000100:00100000:2.0:1789760792.566606:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764178039483 time 764218312663 state 0x2 ref 0
00000100:00100000:2.0:1789760792.570413:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760792.570488:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521080832
00000100:00100000:1.0:1789760792.570498:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521080832
00000100:00100000:1.0:1789760792.570552:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764178039483 time 764218312663 state 0x0 ref 1
00000100:00100000:1.0:1789760792.570567:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764218573079 time 764218312663 state 0x1 ref 1
00000100:00100000:1.0:1789760792.570599:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764218573079 time 764257280712 state 0x0 ref 1
00000100:00100000:1.0:1789760792.570612:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521080832:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760792.570660:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26103808, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:1.0:1789760792.570669:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.570685:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:1.0:1789760792.570690:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760792.570696:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.570711:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760792.598715:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973693 is committed
00002000:00010000:1.0:1789760792.598824:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26103808 -> 26107904
00010000:00010000:1.0:1789760792.598840:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.598858:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.598866:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.598873:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760792.598878:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.598952:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.598973:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.598981:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e124 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26103808->26107903] (req 26103808->26107903) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760792.599176:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521080832:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28562us (28771us total) trans 4294973693 rc 0/0
00000100:00100000:1.0:1789760792.599187:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6406
00000100:00100000:1.0:1789760792.599196:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764218573079 time 764257280712 state 0x2 ref 0
00000100:00100000:0.0:1789760792.602762:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760792.602840:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521080960
00000100:00100000:2.0:1789760792.602849:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521080960
00000100:00100000:2.0:1789760792.602961:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764218573079 time 764257280712 state 0x0 ref 1
00000100:00100000:2.0:1789760792.602977:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764257541128 time 764257280712 state 0x1 ref 1
00000100:00100000:2.0:1789760792.603085:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764257541128 time 764289767143 state 0x0 ref 1
00000100:00100000:2.0:1789760792.603099:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521080960:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760792.603145:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26107904, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:2.0:1789760792.603153:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.603174:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:2.0:1789760792.603178:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760792.603184:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.603196:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760792.635188:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26107904 -> 26112000
00010000:00010000:3.0:1789760792.635209:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.635222:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.635231:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.635245:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760792.635250:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.635260:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.635279:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.635287:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e12b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26107904->26111999] (req 26107904->26111999) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.635432:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521080960:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32330us (32673us total) trans 4294973694 rc 0/0
00000100:00100000:3.0:1789760792.635443:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6407
00000100:00100000:3.0:1789760792.635452:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764257541128 time 764289767143 state 0x2 ref 0
00000001:00080000:3.0:1789760792.635492:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973694 is committed
00000100:00100000:1.0:1789760792.639189:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.639268:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521081088
00000100:00100000:3.0:1789760792.639278:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521081088
00000100:00100000:3.0:1789760792.639372:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764257541128 time 764289767143 state 0x0 ref 1
00000100:00100000:3.0:1789760792.639387:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764290027559 time 764289767143 state 0x1 ref 1
00000100:00100000:3.0:1789760792.639406:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764290027559 time 764326089824 state 0x0 ref 1
00000100:00100000:3.0:1789760792.639419:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081088:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760792.639467:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26112000, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:3.0:1789760792.639476:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.639492:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:3.0:1789760792.639495:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760792.639501:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.639513:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760792.668807:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973695 is committed
00002000:00010000:3.0:1789760792.668977:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26112000 -> 26116096
00010000:00010000:3.0:1789760792.669057:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.669070:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.669080:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.669087:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760792.669092:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.669103:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.669123:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.669131:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e132 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26112000->26116095] (req 26112000->26116095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.669260:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29837us (30076us total) trans 4294973695 rc 0/0
00000100:00100000:3.0:1789760792.669270:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6408
00000100:00100000:3.0:1789760792.669278:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764290027559 time 764326089824 state 0x2 ref 0
00000100:00100000:1.0:1789760792.672699:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760792.672815:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521081216
00000100:00100000:2.0:1789760792.672825:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521081216
00000100:00100000:2.0:1789760792.672876:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764290027559 time 764326089824 state 0x0 ref 1
00000100:00100000:2.0:1789760792.672891:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764326350240 time 764326089824 state 0x1 ref 1
00000100:00100000:2.0:1789760792.672949:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764326350240 time 764359630385 state 0x0 ref 1
00000100:00100000:2.0:1789760792.672963:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521081216:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760792.673010:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26116096, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:2.0:1789760792.673020:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.673035:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:2.0:1789760792.673040:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760792.673047:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.673067:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760792.697772:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdb4113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548776064:0@lo:13:osp-pre-0-0.0
00000100:00100000:3.0:1789760792.697850:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760792.698135:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:3.0:1789760792.698143:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc82ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548776192:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1789760792.698177:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760792.698220:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548776064
00000100:00100000:3.0:1789760792.698228:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548776064
00000100:00100000:3.0:1789760792.698278:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548776192
00000100:00100000:3.0:1789760792.698282:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548776192
00000100:00100000:3.0:1789760792.698304:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398
00000100:00100000:3.0:1789760792.698336:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548776064:12345-0@lo:13:osp-pre-0-0.0
00002000:00000024:3.0:1789760792.698383:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528023552 pending 1703936 free 3832545280 avail 3800039424
00000100:00100000:3.0:1789760792.698438:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548776064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (587us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760792.698447:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398
00000100:00100000:3.0:1789760792.698466:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399
00000100:00100000:3.0:1789760792.698473:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548776192:12345-0@lo:13:osp-pre-0-1.0
00002000:00000024:3.0:1789760792.698520:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 528023552 pending 1703936 free 3832545280 avail 3800039424
00000100:00100000:3.0:1789760792.698549:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548776192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (372us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760792.698555:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399
00000100:00080000:3.0:1789760792.698575:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1789760792.698614:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc82ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548776192:0@lo:13:osp-pre-0-1.0
00000100:00100000:3.0:1789760792.698634:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdb4113800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548776064:0@lo:13:osp-pre-0-0.0
00000001:00080000:2.0:1789760792.714383:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973696 is committed
00002000:00010000:0.0:1789760792.714724:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26116096 -> 26120192
00010000:00010000:0.0:1789760792.714741:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.714754:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.714769:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.714777:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760792.714781:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.714790:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.714810:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.714818:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e139 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26116096->26120191] (req 26116096->26120191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760792.714906:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521081216:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41940us (42212us total) trans 4294973696 rc 0/0
00000100:00100000:0.0:1789760792.714918:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6409
00000100:00100000:0.0:1789760792.714927:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764326350240 time 764359630385 state 0x2 ref 0
00000100:00100000:0.0:1789760792.729741:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760792.729997:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521081344
00000100:00100000:1.0:1789760792.730009:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521081344
00000100:00100000:1.0:1789760792.730063:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764326350240 time 764359630385 state 0x0 ref 1
00000100:00100000:1.0:1789760792.730077:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764359890801 time 764359630385 state 0x1 ref 1
00000100:00100000:1.0:1789760792.730160:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764359890801 time 764416842252 state 0x0 ref 1
00000100:00100000:1.0:1789760792.730173:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081344:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760792.730220:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26120192, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:1.0:1789760792.730229:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.730244:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:1.0:1789760792.730249:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760792.730256:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760792.730270:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760792.792390:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973697 is committed
00002000:00010000:2.0:1789760792.792493:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26120192 -> 26124288
00010000:00010000:2.0:1789760792.792508:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.792521:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.792530:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.792537:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760792.792542:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.792550:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.792568:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.792576:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e140 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26120192->26124287] (req 26120192->26124287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760792.792663:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081344:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62488us (62929us total) trans 4294973697 rc 0/0
00000100:00100000:2.0:1789760792.792673:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6410
00000100:00100000:2.0:1789760792.792682:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764359890801 time 764416842252 state 0x2 ref 0
00000100:00100000:1.0:1789760792.798508:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.801858:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521081472
00000100:00100000:3.0:1789760792.801874:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521081472
00000100:00100000:3.0:1789760792.801944:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764359890801 time 764416842252 state 0x0 ref 1
00000100:00100000:3.0:1789760792.801961:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764417102668 time 764416842252 state 0x1 ref 1
00000100:00100000:3.0:1789760792.801987:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764417102668 time 764488669832 state 0x0 ref 1
00000100:00100000:3.0:1789760792.802001:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521081472:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760792.802050:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26124288, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:3.0:1789760792.802059:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.802076:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:3.0:1789760792.802080:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760792.802087:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.802101:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760792.861566:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973698 is committed
00002000:00010000:0.0:1789760792.861846:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26124288 -> 26128384
00010000:00010000:0.0:1789760792.861863:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.861882:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.861902:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.861911:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760792.861916:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.861925:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.861945:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.861953:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e147 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26124288->26128383] (req 26124288->26128383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760792.862049:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521081472:12345-192.168.203.16@tcp:4:dd.0 Request processed in 60045us (63544us total) trans 4294973698 rc 0/0
00000100:00100000:0.0:1789760792.862059:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6411
00000100:00100000:0.0:1789760792.862069:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764417102668 time 764488669832 state 0x2 ref 0
00000100:00100000:0.0:1789760792.865680:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760792.865757:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521081600
00000100:00100000:3.0:1789760792.865767:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521081600
00000100:00100000:3.0:1789760792.865823:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764417102668 time 764488669832 state 0x0 ref 1
00000100:00100000:3.0:1789760792.865837:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764488930248 time 764488669832 state 0x1 ref 1
00000100:00100000:3.0:1789760792.865867:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764488930248 time 764552550345 state 0x0 ref 1
00000100:00100000:3.0:1789760792.865879:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081600:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760792.865937:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26128384, mtime: 0x6aad9519, atime: 0x0, ctime: 0x6aad9519, blocks: 0xc807
00010000:00010000:3.0:1789760792.865947:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.865963:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:3.0:1789760792.865967:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760792.865973:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760792.865988:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760792.915797:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26128384 -> 26132480
00002000:00010000:2.0:1789760792.915806:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760793 -> 1789760794
00002000:00010000:2.0:1789760792.915809:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760793 -> 1789760794
00010000:00010000:2.0:1789760792.915822:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.915834:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.915843:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.915850:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760792.915855:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.915863:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.915882:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.915904:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e14e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26128384->26132479] (req 26128384->26132479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760792.916116:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521081600:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50235us (50440us total) trans 4294973699 rc 0/0
00000100:00100000:2.0:1789760792.916127:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6412
00000100:00100000:2.0:1789760792.916137:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764488930248 time 764552550345 state 0x2 ref 0
00000001:00080000:3.0:1789760792.916225:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973699 is committed
00000100:00100000:1.0:1789760792.920507:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760792.920600:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521081728
00000100:00100000:0.0:1789760792.920611:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521081728
00000100:00100000:0.0:1789760792.920664:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764488930248 time 764552550345 state 0x0 ref 1
00000100:00100000:0.0:1789760792.920680:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764552810761 time 764552550345 state 0x1 ref 1
00000100:00100000:0.0:1789760792.920714:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764552810761 time 764607395611 state 0x0 ref 1
00000100:00100000:0.0:1789760792.920727:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081728:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760792.920774:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26132480, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:0.0:1789760792.920784:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.920800:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:0.0:1789760792.920805:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760792.920811:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.920826:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760792.973572:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973700 is committed
00002000:00010000:0.0:1789760792.973667:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26132480 -> 26136576
00010000:00010000:0.0:1789760792.973692:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.973706:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.973722:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.973730:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760792.973735:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.973743:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.973762:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760792.973769:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e155 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26132480->26136575] (req 26132480->26136575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760792.973860:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081728:12345-192.168.203.16@tcp:4:dd.0 Request processed in 53131us (53359us total) trans 4294973700 rc 0/0
00000100:00100000:0.0:1789760792.973870:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6413
00000100:00100000:0.0:1789760792.973880:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764552810761 time 764607395611 state 0x2 ref 0
00000100:00100000:1.0:1789760792.977951:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760792.978275:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521081856
00000100:00100000:2.0:1789760792.978285:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521081856
00000100:00100000:2.0:1789760792.978364:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764552810761 time 764607395611 state 0x0 ref 1
00000100:00100000:2.0:1789760792.978380:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764607656027 time 764607395611 state 0x1 ref 1
00000100:00100000:2.0:1789760792.978411:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764607656027 time 764665094560 state 0x0 ref 1
00000100:00100000:2.0:1789760792.978423:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081856:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760792.978471:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26136576, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760792.978480:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.978494:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:2.0:1789760792.978498:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760792.978503:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760792.978520:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760793.030534:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973701 is committed
00002000:00010000:0.0:1789760793.030649:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26136576 -> 26140672
00010000:00010000:0.0:1789760793.030665:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.030684:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.030693:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.030700:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760793.030704:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.030713:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.030734:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.030743:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e15c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26136576->26140671] (req 26136576->26140671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760793.030836:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081856:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52409us (52890us total) trans 4294973701 rc 0/0
00000100:00100000:0.0:1789760793.030847:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6414
00000100:00100000:0.0:1789760793.030855:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764607656027 time 764665094560 state 0x2 ref 0
00000100:00100000:1.0:1789760793.034961:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.035042:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521081984
00000100:00100000:2.0:1789760793.035052:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521081984
00000100:00100000:2.0:1789760793.035104:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764607656027 time 764665094560 state 0x0 ref 1
00000100:00100000:2.0:1789760793.035119:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764665354976 time 764665094560 state 0x1 ref 1
00000100:00100000:2.0:1789760793.035150:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764665354976 time 764721833085 state 0x0 ref 1
00000100:00100000:2.0:1789760793.035163:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081984:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.035212:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26140672, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760793.035220:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.035235:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:2.0:1789760793.035239:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.035245:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.035258:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760793.086393:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973702 is committed
00002000:00010000:2.0:1789760793.086516:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26140672 -> 26144768
00010000:00010000:2.0:1789760793.086531:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.086544:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.086554:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.086562:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760793.086567:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.086577:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.086596:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.086604:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e163 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26140672->26144767] (req 26140672->26144767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760793.086690:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521081984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51525us (51733us total) trans 4294973702 rc 0/0
00000100:00100000:2.0:1789760793.086703:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6415
00000100:00100000:2.0:1789760793.086712:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764665354976 time 764721833085 state 0x2 ref 0
00000100:00100000:1.0:1789760793.093475:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760793.093546:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521082112
00000100:00100000:3.0:1789760793.093555:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521082112
00000100:00100000:3.0:1789760793.093604:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764665354976 time 764721833085 state 0x0 ref 1
00000100:00100000:3.0:1789760793.093618:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764722093501 time 764721833085 state 0x1 ref 1
00000100:00100000:3.0:1789760793.093647:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764722093501 time 764780329693 state 0x0 ref 1
00000100:00100000:3.0:1789760793.093658:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521082112:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760793.093700:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26144768, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:3.0:1789760793.093709:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.093724:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:3.0:1789760793.093728:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760793.093734:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.093748:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.145595:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1789760793.164175:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26144768 -> 26148864
00010000:00010000:3.0:1789760793.164193:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.164206:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.164214:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.164221:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760793.164225:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.164233:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.164251:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.164258:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e16a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26144768->26148863] (req 26144768->26148863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760793.164389:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521082112:12345-192.168.203.16@tcp:4:dd.0 Request processed in 70720us (70911us total) trans 4294973703 rc 0/0
00000100:00100000:3.0:1789760793.164403:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6416
00000100:00100000:3.0:1789760793.164413:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764722093501 time 764780329693 state 0x2 ref 0
00000001:00080000:0.0:1789760793.164705:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973703 is committed
00000100:00100000:3.0:1789760793.172561:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760793.172655:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521082240
00000100:00100000:0.0:1789760793.172664:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521082240
00000100:00100000:0.0:1789760793.172713:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764722093501 time 764780329693 state 0x0 ref 1
00000100:00100000:0.0:1789760793.172728:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764780590109 time 764780329693 state 0x1 ref 1
00000100:00100000:0.0:1789760793.172801:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764780590109 time 764859483391 state 0x0 ref 1
00000100:00100000:0.0:1789760793.172813:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521082240:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760793.172857:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26148864, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:0.0:1789760793.172866:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.172889:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:0.0:1789760793.172894:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760793.172900:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.172914:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760793.221662:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26148864 -> 26152960
00010000:00010000:3.0:1789760793.221682:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.221695:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.221704:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.221712:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760793.221717:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.221726:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.221746:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.221753:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e171 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26148864->26152959] (req 26148864->26152959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760793.221844:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521082240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 49027us (49286us total) trans 4294973704 rc 0/0
00000100:00100000:3.0:1789760793.221855:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6417
00000100:00100000:3.0:1789760793.221864:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764780590109 time 764859483391 state 0x2 ref 0
00000001:00080000:0.0:1789760793.222554:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973704 is committed
00000100:00100000:3.0:1789760793.227765:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760793.227934:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521082368
00000100:00100000:0.0:1789760793.227944:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521082368
00000100:00100000:0.0:1789760793.227996:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764780590109 time 764859483391 state 0x0 ref 1
00000100:00100000:0.0:1789760793.228112:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764859743807 time 764859483391 state 0x1 ref 1
00000100:00100000:0.0:1789760793.228149:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764859743807 time 764914831198 state 0x0 ref 1
00000100:00100000:0.0:1789760793.228162:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521082368:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760793.228210:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26152960, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:0.0:1789760793.228219:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.228235:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:0.0:1789760793.228239:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760793.228247:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.228261:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760793.267219:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26152960 -> 26157056
00010000:00010000:1.0:1789760793.267238:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.267250:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.267259:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.267266:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760793.267270:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.267278:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.267295:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.267302:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4ae3bc9/0x4a99e02bc60e178 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26152960->26157055] (req 26152960->26157055) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760793.267431:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521082368:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39266us (39672us total) trans 4294973705 rc 0/0
00000100:00100000:1.0:1789760793.267441:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6418
00000100:00100000:1.0:1789760793.267451:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764859743807 time 764914831198 state 0x2 ref 0
00000001:00080000:3.0:1789760793.267531:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973705 is committed
00000100:00100000:1.0:1789760793.275547:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.275678:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521082496
00000100:00100000:2.0:1789760793.275688:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521082496
00000100:00100000:2.0:1789760793.275742:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764859743807 time 764914831198 state 0x0 ref 1
00000100:00100000:2.0:1789760793.275757:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764915091614 time 764914831198 state 0x1 ref 1
00000100:00100000:2.0:1789760793.275835:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764915091614 time 764962515584 state 0x0 ref 1
00000100:00100000:2.0:1789760793.275847:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521082496:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.275904:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26157056, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760793.275913:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.275930:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=764s v=(0 0)
00010000:00010000:2.0:1789760793.275935:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.275941:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.275955:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760793.311662:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973706 is committed
00002000:00010000:2.0:1789760793.311764:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26157056 -> 26161152
00010000:00010000:2.0:1789760793.311781:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.311794:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.311804:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.311811:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760793.311816:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.311826:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.311845:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.311853:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e17f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26157056->26161151] (req 26157056->26161151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760793.312194:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521082496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36343us (36652us total) trans 4294973706 rc 0/0
00000100:00100000:2.0:1789760793.312205:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6419
00000100:00100000:2.0:1789760793.312215:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764915091614 time 764962515584 state 0x2 ref 0
00000100:00100000:2.0:1789760793.314989:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760793.315066:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521082624
00000100:00100000:3.0:1789760793.315076:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521082624
00000100:00100000:3.0:1789760793.315132:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764915091614 time 764962515584 state 0x0 ref 1
00000100:00100000:3.0:1789760793.315147:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764962776000 time 764962515584 state 0x1 ref 1
00000100:00100000:3.0:1789760793.315179:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764962776000 time 765001860850 state 0x0 ref 1
00000100:00100000:3.0:1789760793.315191:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521082624:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760793.315236:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26161152, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:3.0:1789760793.315245:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.315261:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:3.0:1789760793.315266:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760793.315272:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.315294:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760793.348258:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973707 is committed
00002000:00010000:3.0:1789760793.348495:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26161152 -> 26165248
00010000:00010000:3.0:1789760793.348511:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.348523:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.348532:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.348540:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760793.348545:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.348555:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.348580:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.348588:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e186 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26161152->26165247] (req 26161152->26165247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760793.348723:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521082624:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33529us (33736us total) trans 4294973707 rc 0/0
00000100:00100000:3.0:1789760793.348735:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6420
00000100:00100000:3.0:1789760793.348744:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764962776000 time 765001860850 state 0x2 ref 0
00000100:00100000:3.0:1789760793.352578:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760793.352644:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521082752
00000100:00100000:0.0:1789760793.352653:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521082752
00000100:00100000:0.0:1789760793.352779:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 764962776000 time 765001860850 state 0x0 ref 1
00000100:00100000:0.0:1789760793.352794:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765002121266 time 765001860850 state 0x1 ref 1
00000100:00100000:0.0:1789760793.352826:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765002121266 time 765039508729 state 0x0 ref 1
00000100:00100000:0.0:1789760793.352841:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521082752:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760793.352888:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26165248, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:0.0:1789760793.352898:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.352914:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:0.0:1789760793.352918:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760793.352923:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.352936:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760793.386039:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973708 is committed
00002000:00010000:1.0:1789760793.386137:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26165248 -> 26169344
00010000:00010000:1.0:1789760793.386153:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.386166:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.386176:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.386183:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760793.386187:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.386196:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.386214:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.386222:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e18d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26165248->26169343] (req 26165248->26169343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760793.386347:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521082752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33470us (33738us total) trans 4294973708 rc 0/0
00000100:00100000:1.0:1789760793.386369:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6421
00000100:00100000:1.0:1789760793.386378:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765002121266 time 765039508729 state 0x2 ref 0
00000100:00100000:1.0:1789760793.394206:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760793.394301:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521082880
00000100:00100000:0.0:1789760793.394346:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521082880
00000100:00100000:2.0:1789760793.394571:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765002121266 time 765039508729 state 0x0 ref 1
00000100:00100000:2.0:1789760793.394588:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765039769145 time 765039508729 state 0x1 ref 1
00000100:00100000:2.0:1789760793.394618:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765039769145 time 765081301006 state 0x0 ref 1
00000100:00100000:2.0:1789760793.394631:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521082880:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.394691:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26169344, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760793.394700:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.394716:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:2.0:1789760793.394721:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.394735:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.394751:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760793.428631:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26169344 -> 26173440
00010000:00010000:2.0:1789760793.428655:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.428669:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.428685:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.428692:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760793.428697:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.428705:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.428723:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.428730:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e194 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26169344->26173439] (req 26169344->26173439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760793.428825:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521082880:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34191us (34626us total) trans 4294973709 rc 0/0
00000100:00100000:2.0:1789760793.428835:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6422
00000100:00100000:2.0:1789760793.428845:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765039769145 time 765081301006 state 0x2 ref 0
00000001:00080000:2.0:1789760793.428899:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973709 is committed
00000100:00100000:2.0:1789760793.432951:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760793.433130:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521083008
00000100:00100000:0.0:1789760793.433140:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521083008
00000100:00100000:0.0:1789760793.433194:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765039769145 time 765081301006 state 0x0 ref 1
00000100:00100000:0.0:1789760793.433208:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765081561422 time 765081301006 state 0x1 ref 1
00000100:00100000:0.0:1789760793.433289:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765081561422 time 765119971049 state 0x0 ref 1
00000100:00100000:0.0:1789760793.433303:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521083008:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760793.433480:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26173440, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:0.0:1789760793.433491:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.433507:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:0.0:1789760793.433513:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760793.433520:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.433534:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760793.472391:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973710 is committed
00002000:00010000:0.0:1789760793.472538:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26173440 -> 26177536
00010000:00010000:0.0:1789760793.472554:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.472568:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.472578:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.472586:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760793.472591:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.472600:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.472622:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.472631:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e19b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26173440->26177535] (req 26173440->26177535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760793.472817:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521083008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39512us (39870us total) trans 4294973710 rc 0/0
00000100:00100000:0.0:1789760793.472829:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6423
00000100:00100000:0.0:1789760793.472839:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765081561422 time 765119971049 state 0x2 ref 0
00000100:00100000:1.0:1789760793.477662:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760793.477800:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521083136
00000100:00100000:3.0:1789760793.477810:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521083136
00000100:00100000:3.0:1789760793.477864:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765081561422 time 765119971049 state 0x0 ref 1
00000100:00100000:3.0:1789760793.477887:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765120231465 time 765119971049 state 0x1 ref 1
00000100:00100000:3.0:1789760793.477916:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765120231465 time 765164599007 state 0x0 ref 1
00000100:00100000:3.0:1789760793.477928:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521083136:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760793.477972:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26177536, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:3.0:1789760793.477991:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.478005:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:3.0:1789760793.478009:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760793.478015:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.478027:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760793.513571:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973711 is committed
00002000:00010000:2.0:1789760793.514601:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26177536 -> 26181632
00010000:00010000:2.0:1789760793.514618:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.514632:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.514641:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.514649:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760793.514653:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.514663:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.514683:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.514690:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e1a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26177536->26181631] (req 26177536->26181631) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760793.514784:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521083136:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36852us (37125us total) trans 4294973711 rc 0/0
00000100:00100000:2.0:1789760793.514795:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6424
00000100:00100000:2.0:1789760793.514805:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765120231465 time 765164599007 state 0x2 ref 0
00000100:00100000:1.0:1789760793.520620:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760793.522184:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521083264
00000100:00100000:0.0:1789760793.522196:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521083264
00000100:00100000:0.0:1789760793.522253:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765120231465 time 765164599007 state 0x0 ref 1
00000100:00100000:0.0:1789760793.522269:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765164859423 time 765164599007 state 0x1 ref 1
00000100:00100000:0.0:1789760793.522297:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765164859423 time 765208979809 state 0x0 ref 1
00000100:00100000:0.0:1789760793.522326:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521083264:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760793.522446:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26181632, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:0.0:1789760793.522456:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.522472:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:0.0:1789760793.522477:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760793.522483:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.522497:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760793.552913:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26181632 -> 26185728
00010000:00010000:2.0:1789760793.552933:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.552946:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.552960:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.552968:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760793.552973:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.552993:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.553015:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.553024:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26181632->26185727] (req 26181632->26185727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760793.553107:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973712 is committed
00000100:00100000:2.0:1789760793.553127:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521083264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30814us (32511us total) trans 4294973712 rc 0/0
00000100:00100000:2.0:1789760793.553138:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6425
00000100:00100000:2.0:1789760793.553147:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765164859423 time 765208979809 state 0x2 ref 0
00000100:00100000:3.0:1789760793.557425:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.557619:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521083392
00000100:00100000:2.0:1789760793.557630:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521083392
00000100:00100000:2.0:1789760793.557689:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765164859423 time 765208979809 state 0x0 ref 1
00000100:00100000:2.0:1789760793.557706:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765209240225 time 765208979809 state 0x1 ref 1
00000100:00100000:2.0:1789760793.557739:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765209240225 time 765244422091 state 0x0 ref 1
00000100:00100000:2.0:1789760793.557753:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521083392:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.557803:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26185728, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760793.557812:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.557828:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:2.0:1789760793.557833:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.557839:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.557853:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760793.613849:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973713 is committed
00002000:00010000:3.0:1789760793.613919:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26185728 -> 26189824
00010000:00010000:3.0:1789760793.613936:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.613949:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.613955:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.613960:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760793.613963:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.613969:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.614039:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.614046:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e1b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26185728->26189823] (req 26185728->26189823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760793.614122:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521083392:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56366us (56701us total) trans 4294973713 rc 0/0
00000100:00100000:3.0:1789760793.614135:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6426
00000100:00100000:3.0:1789760793.614145:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765209240225 time 765244422091 state 0x2 ref 0
00000100:00100000:1.0:1789760793.617280:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.617668:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521083520
00000100:00100000:2.0:1789760793.617678:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521083520
00000100:00100000:0.0:1789760793.617785:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765209240225 time 765244422091 state 0x0 ref 1
00000100:00100000:0.0:1789760793.617801:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765244682507 time 765244422091 state 0x1 ref 1
00000100:00100000:0.0:1789760793.617829:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765244682507 time 765304511609 state 0x0 ref 1
00000100:00100000:0.0:1789760793.617841:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521083520:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760793.617902:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26189824, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:0.0:1789760793.617912:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.617930:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:0.0:1789760793.617935:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760793.617941:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.617955:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760793.652786:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973714 is committed
00002000:00010000:2.0:1789760793.652900:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26189824 -> 26193920
00010000:00010000:2.0:1789760793.652915:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.652934:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.652944:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.652952:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760793.652957:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.652967:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.652986:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.652994:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9c6acf/0x4a99e02bc60e1b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26189824->26193919] (req 26189824->26193919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760793.653092:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521083520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35247us (35815us total) trans 4294973714 rc 0/0
00000100:00100000:2.0:1789760793.653103:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6427
00000100:00100000:2.0:1789760793.653113:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765244682507 time 765304511609 state 0x2 ref 0
00000100:00100000:3.0:1789760793.657347:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.657952:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521083648
00000100:00100000:2.0:1789760793.657964:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521083648
00000100:00100000:2.0:1789760793.658758:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765244682507 time 765304511609 state 0x0 ref 1
00000100:00100000:2.0:1789760793.658777:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765304772025 time 765304511609 state 0x1 ref 1
00000100:00100000:2.0:1789760793.658865:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765304772025 time 765345546361 state 0x0 ref 1
00000100:00100000:2.0:1789760793.658888:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521083648:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.658945:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26193920, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760793.658955:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.658972:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:2.0:1789760793.658977:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.658993:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.659009:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760793.689575:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973715 is committed
00002000:00010000:0.0:1789760793.689682:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26193920 -> 26198016
00010000:00010000:0.0:1789760793.689698:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.689717:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.689727:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.689734:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760793.689739:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.689749:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.689770:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.689778:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028dff22b/0x4a99e02bc60e1be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26193920->26198015] (req 26193920->26198015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760793.690088:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521083648:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31207us (32779us total) trans 4294973715 rc 0/0
00000100:00100000:0.0:1789760793.690101:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6428
00000100:00100000:0.0:1789760793.690111:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765304772025 time 765345546361 state 0x2 ref 0
00000100:00100000:0.0:1789760793.694154:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.694572:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521083776
00000100:00100000:2.0:1789760793.694583:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521083776
00000100:00100000:2.0:1789760793.694637:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765304772025 time 765345546361 state 0x0 ref 1
00000100:00100000:2.0:1789760793.694652:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765345806777 time 765345546361 state 0x1 ref 1
00000100:00100000:2.0:1789760793.694683:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765345806777 time 765381365330 state 0x0 ref 1
00000100:00100000:2.0:1789760793.694698:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521083776:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.694743:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26198016, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760793.694752:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.694766:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:2.0:1789760793.694771:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.694777:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.694791:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760793.721801:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc82ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876699548776448:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.721857:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc82ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548776320:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.721969:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc82ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548776576:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.722310:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760793.722340:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760793.722418:0:6450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548776320
00000100:00100000:0.0:1789760793.722427:0:6450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548776320
00000100:00100000:0.0:1789760793.722470:0:6450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491
00000100:00100000:0.0:1789760793.722479:0:6450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548776320:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760793.722530:0:6450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e2f0499-cafa-479a-9c13-a508b560cb61+24:3455:x1876699548776320:12345-0@lo:400:kworker.0 Request processed in 51us (221us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760793.722538:0:6450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491
00000100:00100000:2.0:1789760793.722680:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc82ab1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e2f0499-cafa-479a-9c13-a508b560cb61:3455:1876699548776320:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.722688:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548776832:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.722714:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760793.722740:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548777344:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.722763:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760793.722783:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda6054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548777856:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.722803:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760793.722832:0:3455:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2]
00000100:00100000:2.0:1789760793.722838:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548778112:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1789760793.722863:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760793.722882:0:3455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfda5844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548777984:0@lo:13:osp-pre-1-0.0
00000100:00100000:2.0:1789760793.722902:0:3455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1789760793.722931:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548777344
00000100:00100000:2.0:1789760793.722935:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548777344
00000100:00100000:2.0:1789760793.722963:0:8099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548777856
00000100:00100000:2.0:1789760793.722966:0:8099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548777856
00000100:00100000:2.0:1789760793.722991:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317
00000100:00100000:2.0:1789760793.722998:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548777344:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.723039:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548777344:12345-0@lo:400:kworker.0 Request processed in 41us (275us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760793.723045:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317
00000100:00100000:2.0:1789760793.723057:0:8099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318
00000100:00100000:2.0:1789760793.723063:0:8099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548777856:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.723091:0:8099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548777856:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760793.723097:0:8099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318
00000100:00100000:2.0:1789760793.723116:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548778112
00000100:00100000:2.0:1789760793.723119:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548778112
00000100:00100000:2.0:1789760793.723143:0:8100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548777984
00000100:00100000:2.0:1789760793.723146:0:8100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548777984
00000100:00100000:2.0:1789760793.723156:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400
00000100:00100000:2.0:1789760793.723162:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548778112:12345-0@lo:13:osp-pre-1-1.0
00002000:00000024:2.0:1789760793.723192:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:2.0:1789760793.723230:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3455:x1876699548778112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (366us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760793.723236:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400
00000100:00100000:2.0:1789760793.723247:0:8100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401
00000100:00100000:2.0:1789760793.723253:0:8100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548777984:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:2.0:1789760793.723265:0:8100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104
00000100:00100000:2.0:1789760793.723290:0:8100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548777984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (387us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760793.723295:0:8100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401
00000100:00080000:2.0:1789760793.723346:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1789760793.723394:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dabad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3455:1876699548778112:0@lo:13:osp-pre-1-1.0
00000100:00100000:2.0:1789760793.723407:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda5844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548777984:0@lo:13:osp-pre-1-0.0
00000100:00100000:2.0:1789760793.723417:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548777344:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.723425:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfda6054380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548777856:0@lo:400:kworker.0
00000100:00100000:0.0:1789760793.723681:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548776832
00000100:00100000:0.0:1789760793.723686:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548776832
00000100:00100000:0.0:1789760793.723719:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467
00000100:00100000:0.0:1789760793.723726:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548776832:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1789760793.723770:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3455:x1876699548776832:12345-0@lo:400:kworker.0 Request processed in 45us (1055us total) trans 0 rc 0/0
00000100:00100000:0.0:1789760793.723776:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467
00000100:00100000:2.0:1789760793.724074:0:3455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3455:1876699548776832:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.725016:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760793.725056:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3453:1876699548777088:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.725091:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760793.725117:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3453:1876699548777600:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.725137:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760793.725158:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0]
00000100:00100000:3.0:1789760793.725165:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548776704:0@lo:400:kworker.0
00000100:00100000:0.0:1789760793.725186:0:6461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548776576
00000100:00100000:3.0:1789760793.725187:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760793.725195:0:6461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548776576
00000100:00100000:3.0:1789760793.725208:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548777216:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.725234:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760793.725240:0:6461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468
00000100:00100000:0.0:1789760793.725251:0:6461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548776576:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.725257:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548777728:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.725279:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1789760793.725309:0:6461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3453:x1876699548776576:12345-0@lo:400:kworker.0 Request processed in 60us (871us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760793.725340:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc82ab1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548776576:0@lo:400:kworker.0
00000100:00100000:0.0:1789760793.725343:0:6461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468
00000100:00100000:3.0:1789760793.725411:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548776448
00000100:00100000:3.0:1789760793.725415:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548776448
00000100:00100000:3.0:1789760793.725451:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548777088
00000100:00100000:3.0:1789760793.725460:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548777088
00000100:00100000:3.0:1789760793.725488:0:6456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548777600
00000100:00100000:3.0:1789760793.725492:0:6456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548777600
00000100:00100000:2.0:1789760793.725500:0:6457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548776704
00000100:00100000:2.0:1789760793.725506:0:6457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548776704
00000100:00100000:3.0:1789760793.725516:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977
00000100:00100000:3.0:1789760793.725529:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876699548776448:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.725535:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978
00000100:00100000:2.0:1789760793.725545:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876699548777088:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.725591:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6055180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3456:x1876699548776448:12345-0@lo:400:kworker.0 Request processed in 64us (3247us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760793.725600:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977
00000100:00100000:3.0:1789760793.725616:0:6456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979
00000100:00100000:3.0:1789760793.725624:0:6456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876699548777600:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.725707:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3453:x1876699548777088:12345-0@lo:400:kworker.0 Request processed in 163us (613us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760793.725713:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978
00000100:00100000:2.0:1789760793.725737:0:6457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980
00000100:00100000:2.0:1789760793.725744:0:6457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548776704:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1789760793.726063:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc82ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3456:1876699548776448:0@lo:400:kworker.0
00000100:00100000:1.0:1789760793.726071:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699548776960:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.726139:0:6456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3453:x1876699548777600:12345-0@lo:400:kworker.0 Request processed in 514us (998us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760793.726146:0:6456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979
00000100:00100000:3.0:1789760793.726188:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548777216
00000100:00100000:3.0:1789760793.726193:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548777216
00000100:00100000:1.0:1789760793.726206:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1789760793.726221:0:14719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548777728
00000100:00100000:3.0:1789760793.726225:0:14719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548777728
00000100:00100000:3.0:1789760793.726244:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319
00000100:00100000:3.0:1789760793.726251:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548777216:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.726284:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548777216:12345-0@lo:400:kworker.0 Request processed in 34us (1050us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760793.726290:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319
00000100:00100000:3.0:1789760793.726306:0:14719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320
00000100:00100000:3.0:1789760793.726332:0:14719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548777728:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.726373:0:14719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4113800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3453:x1876699548777728:12345-0@lo:400:kworker.0 Request processed in 61us (1093us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760793.726379:0:14719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320
00000100:00100000:2.0:1789760793.726479:0:6457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dabad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3453:x1876699548776704:12345-0@lo:400:kworker.0 Request processed in 734us (1289us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760793.726486:0:6457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980
00000100:00100000:1.0:1789760793.726526:0:3456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3456:1876699548777472:0@lo:400:kworker.0
00000100:00100000:1.0:1789760793.726902:0:3456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00080000:2.0:1789760793.726945:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:2.0:1789760793.726972:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3453:1876699548776704:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.726984:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548777216:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.726994:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3453:1876699548777728:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.727004:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3453:1876699548777088:0@lo:400:kworker.0
00000100:00100000:2.0:1789760793.727014:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3453:1876699548777600:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.730012:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548776960
00000100:00100000:3.0:1789760793.730025:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548776960
00000100:00080000:1.0:1789760793.730061:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:3.0:1789760793.730090:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548777472
00000100:00100000:3.0:1789760793.730096:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548777472
00000100:00100000:3.0:1789760793.730123:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981
00000100:00100000:3.0:1789760793.730132:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699548776960:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.730219:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda6054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3456:x1876699548776960:12345-0@lo:400:kworker.0 Request processed in 88us (4055us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760793.730227:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981
00000100:00100000:3.0:1789760793.730255:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982
00000100:00100000:3.0:1789760793.730262:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876699548777472:12345-0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.730292:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3456:x1876699548777472:12345-0@lo:400:kworker.0 Request processed in 32us (3390us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760793.730298:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982
00000100:00080000:3.0:1789760793.730367:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:3.0:1789760793.730403:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3456:1876699548776960:0@lo:400:kworker.0
00000100:00100000:3.0:1789760793.730764:0:3456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1cca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3456:1876699548777472:0@lo:400:kworker.0
00000001:00080000:2.0:1789760793.738059:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973716 is committed
00002000:00010000:0.0:1789760793.738107:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26198016 -> 26202112
00010000:00010000:0.0:1789760793.738124:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.738138:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.738155:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.738163:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760793.738175:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.738184:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.738210:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.738219:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e1c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26198016->26202111] (req 26198016->26202111) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760793.738377:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521083776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43676us (44227us total) trans 4294973716 rc 0/0
00000100:00100000:0.0:1789760793.738388:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6429
00000100:00100000:0.0:1789760793.738397:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765345806777 time 765381365330 state 0x2 ref 0
00000100:00100000:1.0:1789760793.748696:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760793.749208:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521083904
00000100:00100000:3.0:1789760793.749219:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521083904
00000100:00100000:3.0:1789760793.749269:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765345806777 time 765381365330 state 0x0 ref 1
00000100:00100000:3.0:1789760793.749482:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765381625746 time 765381365330 state 0x1 ref 1
00000100:00100000:3.0:1789760793.749509:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765381625746 time 765436190839 state 0x0 ref 1
00000100:00100000:3.0:1789760793.749524:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521083904:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760793.749573:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26202112, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:3.0:1789760793.749584:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.749600:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:3.0:1789760793.749606:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760793.749612:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.749626:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760793.780898:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973717 is committed
00002000:00010000:3.0:1789760793.781022:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26202112 -> 26206208
00010000:00010000:3.0:1789760793.781037:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.781050:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.781059:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.781067:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760793.781072:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.781081:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.781099:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.781107:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26202112->26206207] (req 26202112->26206207) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760793.781246:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521083904:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31720us (32555us total) trans 4294973717 rc 0/0
00000100:00100000:3.0:1789760793.781257:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6430
00000100:00100000:3.0:1789760793.781266:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765381625746 time 765436190839 state 0x2 ref 0
00000100:00100000:2.0:1789760793.794046:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760793.794170:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521084032
00000100:00100000:0.0:1789760793.794181:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521084032
00000100:00100000:0.0:1789760793.794236:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765381625746 time 765436190839 state 0x0 ref 1
00000100:00100000:0.0:1789760793.794255:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765436451255 time 765436190839 state 0x1 ref 1
00000100:00100000:0.0:1789760793.794340:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765436451255 time 765481021935 state 0x0 ref 1
00000100:00100000:0.0:1789760793.794373:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521084032:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760793.794424:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26206208, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:0.0:1789760793.794433:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.794450:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:0.0:1789760793.794455:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760793.794461:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760793.794475:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760793.838465:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26206208 -> 26210304
00010000:00010000:1.0:1789760793.838484:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.838499:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.838509:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.838516:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760793.838522:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.838531:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.838550:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.838560:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e1d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26206208->26210303] (req 26206208->26210303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760793.838652:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521084032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44277us (44740us total) trans 4294973718 rc 0/0
00000100:00100000:1.0:1789760793.838663:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6431
00000100:00100000:1.0:1789760793.838673:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765436451255 time 765481021935 state 0x2 ref 0
00000001:00080000:3.0:1789760793.838758:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973718 is committed
00000100:00100000:0.0:1789760793.842203:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.842304:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521084160
00000100:00100000:2.0:1789760793.842386:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521084160
00000100:00100000:2.0:1789760793.842445:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765436451255 time 765481021935 state 0x0 ref 1
00000100:00100000:2.0:1789760793.842459:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765481282351 time 765481021935 state 0x1 ref 1
00000100:00100000:2.0:1789760793.842523:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765481282351 time 765529205722 state 0x0 ref 1
00000100:00100000:2.0:1789760793.842537:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521084160:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.842584:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26210304, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760793.842592:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.842607:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:2.0:1789760793.842612:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.842618:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.842636:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760793.876463:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973719 is committed
00002000:00010000:1.0:1789760793.876669:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26210304 -> 26214400
00010000:00010000:1.0:1789760793.876685:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.876711:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.876725:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.876733:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760793.876738:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.876747:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.876768:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.876776:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e1da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26210304->26214399] (req 26210304->26214399) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760793.876865:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5847b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521084160:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34327us (34667us total) trans 4294973719 rc 0/0
00000100:00100000:1.0:1789760793.876876:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6432
00000100:00100000:1.0:1789760793.877410:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765481282351 time 765529205722 state 0x2 ref 0
00000100:00100000:0.0:1789760793.883267:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.883709:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521084288
00000100:00100000:2.0:1789760793.883720:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521084288
00000100:00100000:2.0:1789760793.883774:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765481282351 time 765529205722 state 0x0 ref 1
00000100:00100000:2.0:1789760793.883788:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765529466138 time 765529205722 state 0x1 ref 1
00000100:00100000:2.0:1789760793.883823:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765529466138 time 765570505192 state 0x0 ref 1
00000100:00100000:2.0:1789760793.883836:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521084288:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.883896:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26214400, mtime: 0x6aad951a, atime: 0x0, ctime: 0x6aad951a, blocks: 0xc807
00010000:00010000:2.0:1789760793.883906:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.883922:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:2.0:1789760793.883925:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.883932:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.883945:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760793.920388:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973720 is committed
00002000:00010000:3.0:1789760793.920493:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26214400 -> 26218496
00002000:00010000:3.0:1789760793.920498:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760794 -> 1789760795
00002000:00010000:3.0:1789760793.920502:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760794 -> 1789760795
00002000:00010000:3.0:1789760793.920504:0:8103:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 51207 -> 53255
00010000:00010000:3.0:1789760793.920517:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.920530:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.920540:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.920548:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760793.920553:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.920568:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.920587:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.920595:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e1e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26214400->26218495] (req 26214400->26218495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760793.920688:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521084288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36850us (37425us total) trans 4294973720 rc 0/0
00000100:00100000:3.0:1789760793.920699:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6433
00000100:00100000:3.0:1789760793.920709:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765529466138 time 765570505192 state 0x2 ref 0
00000100:00100000:2.0:1789760793.925478:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760793.925567:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521084416
00000100:00100000:3.0:1789760793.925577:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521084416
00000100:00100000:3.0:1789760793.925630:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765529466138 time 765570505192 state 0x0 ref 1
00000100:00100000:3.0:1789760793.925646:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765570765608 time 765570505192 state 0x1 ref 1
00000100:00100000:3.0:1789760793.925814:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765570765608 time 765612495446 state 0x0 ref 1
00000100:00100000:3.0:1789760793.925827:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521084416:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760793.925869:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26218496, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:3.0:1789760793.925928:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.925944:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:3.0:1789760793.925958:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760793.925965:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760793.925985:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760793.959293:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973721 is committed
00002000:00010000:2.0:1789760793.959398:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26218496 -> 26222592
00010000:00010000:2.0:1789760793.959415:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.959428:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.959438:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.959447:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760793.959461:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.959472:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.959491:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.959499:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e1e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26218496->26222591] (req 26218496->26222591) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760793.959596:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8c6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521084416:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33766us (34122us total) trans 4294973721 rc 0/0
00000100:00100000:2.0:1789760793.959606:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6434
00000100:00100000:2.0:1789760793.959615:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765570765608 time 765612495446 state 0x2 ref 0
00000100:00100000:0.0:1789760793.963571:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760793.963662:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521084544
00000100:00100000:1.0:1789760793.963670:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521084544
00000100:00100000:1.0:1789760793.963714:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765570765608 time 765612495446 state 0x0 ref 1
00000100:00100000:1.0:1789760793.963726:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765612755862 time 765612495446 state 0x1 ref 1
00000100:00100000:1.0:1789760793.963747:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765612755862 time 765650430196 state 0x0 ref 1
00000100:00100000:1.0:1789760793.963759:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521084544:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760793.963806:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26222592, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760793.963814:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.963830:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:1.0:1789760793.963834:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760793.963839:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.963853:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760793.989664:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973722 is committed
00002000:00010000:1.0:1789760793.989822:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26222592 -> 26226688
00010000:00010000:1.0:1789760793.989838:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.989850:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.989859:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.989872:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760793.989934:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.989945:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.989973:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760793.989988:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e1ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26222592->26226687] (req 26222592->26226687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760793.990125:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521084544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26363us (26556us total) trans 4294973722 rc 0/0
00000100:00100000:1.0:1789760793.990137:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6435
00000100:00100000:1.0:1789760793.990147:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765612755862 time 765650430196 state 0x2 ref 0
00000100:00100000:1.0:1789760793.994656:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760793.994742:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521084672
00000100:00100000:2.0:1789760793.994752:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521084672
00000100:00100000:2.0:1789760793.994803:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765612755862 time 765650430196 state 0x0 ref 1
00000100:00100000:2.0:1789760793.994819:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765650690612 time 765650430196 state 0x1 ref 1
00000100:00100000:2.0:1789760793.994852:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765650690612 time 765681534713 state 0x0 ref 1
00000100:00100000:2.0:1789760793.994865:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521084672:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760793.994921:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26226688, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:2.0:1789760793.994930:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.994946:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:2.0:1789760793.994950:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760793.994957:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760793.994970:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760794.029941:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973723 is committed
00002000:00010000:1.0:1789760794.030024:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26226688 -> 26230784
00010000:00010000:1.0:1789760794.030040:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.030052:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.030067:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.030075:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.030079:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.030088:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.030108:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.030114:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000733fb2d8/0x4a99e02bc60e1f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26226688->26230783] (req 26226688->26230783) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.030204:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521084672:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35336us (35552us total) trans 4294973723 rc 0/0
00000100:00100000:1.0:1789760794.030214:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6436
00000100:00100000:1.0:1789760794.030223:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765650690612 time 765681534713 state 0x2 ref 0
00000100:00100000:2.0:1789760794.038986:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760794.039086:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521084800
00000100:00100000:3.0:1789760794.039097:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521084800
00000100:00100000:3.0:1789760794.039167:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765650690612 time 765681534713 state 0x0 ref 1
00000100:00100000:3.0:1789760794.039181:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765681795129 time 765681534713 state 0x1 ref 1
00000100:00100000:3.0:1789760794.039216:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765681795129 time 765725898944 state 0x0 ref 1
00000100:00100000:3.0:1789760794.039229:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521084800:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760794.039279:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26230784, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:3.0:1789760794.039288:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.039304:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:3.0:1789760794.039309:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760794.039373:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.039388:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760794.039840:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:2.0:1789760794.071612:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973724 is committed
00002000:00010000:1.0:1789760794.072491:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26230784 -> 26234880
00010000:00010000:1.0:1789760794.072508:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.072525:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.072534:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.072541:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.072546:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.072554:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.072572:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.072580:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e1fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26230784->26234879] (req 26230784->26234879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.072677:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521084800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33446us (33696us total) trans 4294973724 rc 0/0
00000100:00100000:1.0:1789760794.072687:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6437
00000100:00100000:1.0:1789760794.072696:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765681795129 time 765725898944 state 0x2 ref 0
00000100:00100000:0.0:1789760794.083794:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760794.083983:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521084928
00000100:00100000:3.0:1789760794.083993:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521084928
00000100:00100000:3.0:1789760794.084046:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765681795129 time 765725898944 state 0x0 ref 1
00000100:00100000:3.0:1789760794.084062:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765726159360 time 765725898944 state 0x1 ref 1
00000100:00100000:3.0:1789760794.084145:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765726159360 time 765770827153 state 0x0 ref 1
00000100:00100000:3.0:1789760794.084158:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521084928:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760794.084209:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26234880, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:3.0:1789760794.084218:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.084235:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:3.0:1789760794.084239:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760794.084245:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.084258:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760794.119770:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973725 is committed
00002000:00010000:2.0:1789760794.119941:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26234880 -> 26238976
00010000:00010000:2.0:1789760794.119956:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.119975:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.119984:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.119992:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760794.119997:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.120006:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.120026:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.120033:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e204 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26234880->26238975] (req 26234880->26238975) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760794.120168:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521084928:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36007us (36388us total) trans 4294973725 rc 0/0
00000100:00100000:2.0:1789760794.120178:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6438
00000100:00100000:2.0:1789760794.120187:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765726159360 time 765770827153 state 0x2 ref 0
00000100:00100000:0.0:1789760794.125983:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.126408:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521085056
00000100:00100000:1.0:1789760794.126417:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521085056
00000100:00100000:1.0:1789760794.126538:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765726159360 time 765770827153 state 0x0 ref 1
00000100:00100000:1.0:1789760794.126555:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765771087569 time 765770827153 state 0x1 ref 1
00000100:00100000:3.0:1789760794.126674:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765771087569 time 765813353808 state 0x0 ref 1
00000100:00100000:3.0:1789760794.126690:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521085056:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760794.126739:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26238976, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:3.0:1789760794.126748:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.126765:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:3.0:1789760794.126973:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760794.127048:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.127063:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.181544:0:9882:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1789760794.205678:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973726 is committed
00002000:00010000:3.0:1789760794.205912:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26238976 -> 26243072
00010000:00010000:3.0:1789760794.205928:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.205941:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.205950:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.205957:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760794.205962:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.205971:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.205990:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.205997:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e20b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26238976->26243071] (req 26238976->26243071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760794.206087:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5844a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521085056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 79396us (80109us total) trans 4294973726 rc 0/0
00000100:00100000:3.0:1789760794.206098:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6439
00000100:00100000:3.0:1789760794.206108:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765771087569 time 765813353808 state 0x2 ref 0
00000100:00100000:3.0:1789760794.209742:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.209893:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521085184
00000100:00100000:1.0:1789760794.209903:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521085184
00000100:00100000:1.0:1789760794.209955:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765771087569 time 765813353808 state 0x0 ref 1
00000100:00100000:1.0:1789760794.209970:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765813614224 time 765813353808 state 0x1 ref 1
00000100:00100000:1.0:1789760794.210058:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765813614224 time 765896740012 state 0x0 ref 1
00000100:00100000:1.0:1789760794.210072:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521085184:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.210124:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26243072, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760794.210133:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.210148:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:1.0:1789760794.210164:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.210171:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.210185:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760794.245484:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973727 is committed
00002000:00010000:1.0:1789760794.245654:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26243072 -> 26247168
00010000:00010000:1.0:1789760794.245670:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.245682:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.245691:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.245698:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.245702:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.245710:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.245728:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.245735:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e212 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26243072->26247167] (req 26243072->26247167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.245826:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521085184:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35750us (36087us total) trans 4294973727 rc 0/0
00000100:00100000:1.0:1789760794.245836:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6440
00000100:00100000:1.0:1789760794.245846:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765813614224 time 765896740012 state 0x2 ref 0
00000100:00100000:3.0:1789760794.248910:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.249522:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521085312
00000100:00100000:1.0:1789760794.249532:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521085312
00000100:00100000:1.0:1789760794.249583:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765813614224 time 765896740012 state 0x0 ref 1
00000100:00100000:1.0:1789760794.249599:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765897000428 time 765896740012 state 0x1 ref 1
00000100:00100000:1.0:1789760794.249628:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765897000428 time 765936310825 state 0x0 ref 1
00000100:00100000:1.0:1789760794.249639:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521085312:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.249685:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26247168, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760794.249694:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.249708:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:1.0:1789760794.249712:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.249719:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.249732:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760794.296512:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973728 is committed
00002000:00010000:0.0:1789760794.296595:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26247168 -> 26251264
00010000:00010000:0.0:1789760794.296611:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.296623:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.296631:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.296637:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760794.296642:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.296651:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.296669:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.296677:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e219 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26247168->26251263] (req 26247168->26251263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760794.297292:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521085312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47648us (48384us total) trans 4294973728 rc 0/0
00000100:00100000:0.0:1789760794.297304:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6441
00000100:00100000:0.0:1789760794.297368:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765897000428 time 765936310825 state 0x2 ref 0
00000100:00100000:3.0:1789760794.301180:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760794.305754:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521085440
00000100:00100000:2.0:1789760794.305768:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521085440
00000100:00100000:3.0:1789760794.305962:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765897000428 time 765936310825 state 0x0 ref 1
00000100:00100000:3.0:1789760794.306087:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765936571241 time 765936310825 state 0x1 ref 1
00000100:00100000:3.0:1789760794.306123:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765936571241 time 765992805455 state 0x0 ref 1
00000100:00100000:3.0:1789760794.306137:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521085440:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760794.306188:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26251264, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:3.0:1789760794.306198:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.306214:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=765s v=(0 0)
00010000:00010000:3.0:1789760794.306218:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760794.306224:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.306237:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760794.350423:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973729 is committed
00002000:00010000:0.0:1789760794.350575:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26251264 -> 26255360
00010000:00010000:0.0:1789760794.350592:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.350604:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.350613:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.350621:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760794.350626:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.350636:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.350658:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.350667:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e220 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26251264->26255359] (req 26251264->26255359) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760794.350761:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521085440:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44623us (49585us total) trans 4294973729 rc 0/0
00000100:00100000:0.0:1789760794.350772:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6442
00000100:00100000:0.0:1789760794.350782:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765936571241 time 765992805455 state 0x2 ref 0
00000100:00100000:3.0:1789760794.355205:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.355366:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521085568
00000100:00100000:1.0:1789760794.355376:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521085568
00000100:00100000:1.0:1789760794.355526:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765936571241 time 765992805455 state 0x0 ref 1
00000100:00100000:1.0:1789760794.355540:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765993065871 time 765992805455 state 0x1 ref 1
00000100:00100000:1.0:1789760794.355568:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765993065871 time 766042251043 state 0x0 ref 1
00000100:00100000:1.0:1789760794.355581:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521085568:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.355629:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26255360, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760794.355638:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.355653:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760794.355657:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.355664:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.355678:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760794.390403:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973730 is committed
00002000:00010000:1.0:1789760794.390496:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26255360 -> 26259456
00010000:00010000:1.0:1789760794.390512:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.390524:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.390530:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.390535:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.390539:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.390546:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.390560:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.390564:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e227 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26255360->26259455] (req 26255360->26259455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.390637:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1d8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521085568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35055us (35438us total) trans 4294973730 rc 0/0
00000100:00100000:1.0:1789760794.390648:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6443
00000100:00100000:1.0:1789760794.390657:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765993065871 time 766042251043 state 0x2 ref 0
00000100:00100000:3.0:1789760794.394673:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.395187:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521085696
00000100:00100000:1.0:1789760794.395197:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521085696
00000100:00100000:1.0:1789760794.395252:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 765993065871 time 766042251043 state 0x0 ref 1
00000100:00100000:1.0:1789760794.395268:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766042511459 time 766042251043 state 0x1 ref 1
00000100:00100000:1.0:1789760794.395301:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766042511459 time 766081983533 state 0x0 ref 1
00000100:00100000:1.0:1789760794.395493:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521085696:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.395545:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26259456, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760794.395555:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.395570:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760794.395575:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.395582:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.395596:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760794.426592:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973731 is committed
00002000:00010000:3.0:1789760794.426684:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26259456 -> 26263552
00010000:00010000:3.0:1789760794.426700:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.426713:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.426723:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.426730:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760794.426736:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.426753:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.426772:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.426780:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e22e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26259456->26263551] (req 26259456->26263551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760794.426913:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521085696:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31591us (32240us total) trans 4294973731 rc 0/0
00000100:00100000:3.0:1789760794.426924:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6444
00000100:00100000:3.0:1789760794.426935:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766042511459 time 766081983533 state 0x2 ref 0
00000100:00100000:0.0:1789760794.430500:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.430616:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521085824
00000100:00100000:1.0:1789760794.430627:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521085824
00000100:00100000:1.0:1789760794.430674:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766042511459 time 766081983533 state 0x0 ref 1
00000100:00100000:1.0:1789760794.430689:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766082243949 time 766081983533 state 0x1 ref 1
00000100:00100000:1.0:1789760794.430749:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766082243949 time 766117430468 state 0x0 ref 1
00000100:00100000:1.0:1789760794.430761:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521085824:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.430807:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26263552, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760794.430816:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.430832:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760794.430836:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.430843:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.430855:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760794.464607:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26263552 -> 26267648
00010000:00010000:1.0:1789760794.464627:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.464640:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.464649:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.464657:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.464662:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.464671:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.464689:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.464698:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e235 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26263552->26267647] (req 26263552->26267647) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.464790:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521085824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34024us (34293us total) trans 4294973732 rc 0/0
00000100:00100000:1.0:1789760794.464801:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6445
00000100:00100000:1.0:1789760794.464811:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766082243949 time 766117430468 state 0x2 ref 0
00000001:00080000:2.0:1789760794.465244:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973732 is committed
00000100:00100000:2.0:1789760794.468500:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760794.468806:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521085952
00000100:00100000:0.0:1789760794.468817:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521085952
00000100:00100000:0.0:1789760794.468870:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766082243949 time 766117430468 state 0x0 ref 1
00000100:00100000:0.0:1789760794.468897:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766117690884 time 766117430468 state 0x1 ref 1
00000100:00100000:0.0:1789760794.468926:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766117690884 time 766155608496 state 0x0 ref 1
00000100:00100000:0.0:1789760794.468939:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521085952:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760794.468986:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26267648, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:0.0:1789760794.468995:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.469011:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:0.0:1789760794.469015:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760794.469021:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.469036:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760794.500169:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973733 is committed
00002000:00010000:1.0:1789760794.500387:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26267648 -> 26271744
00010000:00010000:1.0:1789760794.500403:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.500418:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.500428:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.500435:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.500440:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.500449:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.500468:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.500481:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015c9bd81/0x4a99e02bc60e23c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26267648->26271743] (req 26267648->26271743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.500573:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521085952:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31630us (32077us total) trans 4294973733 rc 0/0
00000100:00100000:1.0:1789760794.500583:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6446
00000100:00100000:1.0:1789760794.500593:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766117690884 time 766155608496 state 0x2 ref 0
00000100:00100000:3.0:1789760794.503796:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.503883:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521086080
00000100:00100000:1.0:1789760794.503894:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521086080
00000100:00100000:1.0:1789760794.503948:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766117690884 time 766155608496 state 0x0 ref 1
00000100:00100000:1.0:1789760794.503962:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766155868912 time 766155608496 state 0x1 ref 1
00000100:00100000:1.0:1789760794.504002:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766155868912 time 766190684877 state 0x0 ref 1
00000100:00100000:1.0:1789760794.504013:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521086080:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.504055:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26271744, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760794.504064:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.504078:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760794.504082:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.504089:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.504106:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760794.559612:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973734 is committed
00002000:00010000:1.0:1789760794.561505:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26271744 -> 26275840
00010000:00010000:1.0:1789760794.561527:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.561542:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.561553:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.561562:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.561568:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.561577:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.561597:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.561606:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e243 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26271744->26275839] (req 26271744->26275839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.561724:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521086080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 57707us (57933us total) trans 4294973734 rc 0/0
00000100:00100000:1.0:1789760794.561735:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6447
00000100:00100000:1.0:1789760794.561746:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766155868912 time 766190684877 state 0x2 ref 0
00000100:00100000:0.0:1789760794.565297:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760794.565578:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521086208
00000100:00100000:3.0:1789760794.565588:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521086208
00000100:00100000:3.0:1789760794.565649:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766155868912 time 766190684877 state 0x0 ref 1
00000100:00100000:3.0:1789760794.565671:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766190945293 time 766190684877 state 0x1 ref 1
00000100:00100000:3.0:1789760794.565700:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766190945293 time 766252383114 state 0x0 ref 1
00000100:00100000:3.0:1789760794.565712:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521086208:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760794.565756:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26275840, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:3.0:1789760794.565765:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.565786:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:3.0:1789760794.565790:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760794.565797:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.565810:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760794.627805:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973735 is committed
00002000:00010000:3.0:1789760794.627926:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26275840 -> 26279936
00010000:00010000:3.0:1789760794.627944:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.627957:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.627965:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.628044:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760794.628051:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.628061:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.628086:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.628093:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e24a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26275840->26279935] (req 26275840->26279935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760794.628190:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521086208:12345-192.168.203.16@tcp:4:dd.0 Request processed in 62475us (62899us total) trans 4294973735 rc 0/0
00000100:00100000:3.0:1789760794.628200:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6448
00000100:00100000:3.0:1789760794.628210:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766190945293 time 766252383114 state 0x2 ref 0
00000100:00100000:2.0:1789760794.633182:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760794.633373:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521086336
00000100:00100000:0.0:1789760794.633393:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521086336
00000100:00100000:0.0:1789760794.633449:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766190945293 time 766252383114 state 0x0 ref 1
00000100:00100000:0.0:1789760794.633465:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766252643530 time 766252383114 state 0x1 ref 1
00000100:00100000:0.0:1789760794.633487:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766252643530 time 766320169999 state 0x0 ref 1
00000100:00100000:0.0:1789760794.633498:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521086336:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760794.633550:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26279936, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:0.0:1789760794.633560:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.633576:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:0.0:1789760794.633580:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760794.633586:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760794.633600:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760794.665187:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26279936 -> 26284032
00010000:00010000:2.0:1789760794.665205:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.665215:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.665222:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.665226:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760794.665230:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.665236:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.665253:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.665258:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000979c6014/0x4a99e02bc60e251 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26279936->26284031] (req 26279936->26284031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760794.665391:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521086336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31889us (32215us total) trans 4294973736 rc 0/0
00000100:00100000:2.0:1789760794.665402:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6449
00000100:00100000:2.0:1789760794.665411:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766252643530 time 766320169999 state 0x2 ref 0
00000001:00080000:3.0:1789760794.665481:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973736 is committed
00000100:00100000:0.0:1789760794.669559:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.669653:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521086464
00000100:00100000:1.0:1789760794.669662:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521086464
00000100:00100000:1.0:1789760794.669714:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766252643530 time 766320169999 state 0x0 ref 1
00000100:00100000:1.0:1789760794.669729:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766320430415 time 766320169999 state 0x1 ref 1
00000100:00100000:1.0:1789760794.669804:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766320430415 time 766356485739 state 0x0 ref 1
00000100:00100000:1.0:1789760794.669817:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521086464:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.669861:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26284032, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760794.669869:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.669892:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760794.669897:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.669903:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.669918:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760794.709006:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973737 is committed
00002000:00010000:1.0:1789760794.709490:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26284032 -> 26288128
00010000:00010000:1.0:1789760794.709506:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.709518:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.709526:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.709533:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.709538:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.709545:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.709563:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.709570:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e258 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26284032->26288127] (req 26284032->26288127) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.709720:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521086464:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39900us (40165us total) trans 4294973737 rc 0/0
00000100:00100000:1.0:1789760794.709735:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6450
00000100:00100000:1.0:1789760794.709744:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766320430415 time 766356485739 state 0x2 ref 0
00000100:00100000:1.0:1789760794.716126:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760794.717603:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521086592
00000100:00100000:2.0:1789760794.717617:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521086592
00000100:00100000:2.0:1789760794.717679:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766320430415 time 766356485739 state 0x0 ref 1
00000100:00100000:2.0:1789760794.717695:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766356746155 time 766356485739 state 0x1 ref 1
00000100:00100000:2.0:1789760794.717731:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766356746155 time 766404412744 state 0x0 ref 1
00000100:00100000:2.0:1789760794.717745:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521086592:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760794.717793:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26288128, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:2.0:1789760794.717803:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.717820:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:2.0:1789760794.717825:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760794.717831:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.717851:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760794.754606:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973738 is committed
00002000:00010000:1.0:1789760794.755876:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26288128 -> 26292224
00010000:00010000:1.0:1789760794.755897:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.755910:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.755919:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.755927:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.755933:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.755942:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.755963:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.755975:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d9b58a1/0x4a99e02bc60e25f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26288128->26292223] (req 26288128->26292223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.756072:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521086592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38326us (39951us total) trans 4294973738 rc 0/0
00000100:00100000:1.0:1789760794.756083:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6451
00000100:00100000:1.0:1789760794.756095:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766356746155 time 766404412744 state 0x2 ref 0
00000100:00100000:2.0:1789760794.762103:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760794.762451:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521086720
00000100:00100000:3.0:1789760794.762462:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521086720
00000100:00100000:3.0:1789760794.762517:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766356746155 time 766404412744 state 0x0 ref 1
00000100:00100000:3.0:1789760794.762672:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766404673160 time 766404412744 state 0x1 ref 1
00000100:00100000:1.0:1789760794.762827:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766404673160 time 766449502738 state 0x0 ref 1
00000100:00100000:1.0:1789760794.762845:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521086720:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.762898:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26292224, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:1.0:1789760794.762908:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.762989:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760794.762995:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.763001:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.763016:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760794.802414:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973739 is committed
00002000:00010000:2.0:1789760794.803293:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26292224 -> 26296320
00010000:00010000:2.0:1789760794.803309:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.803356:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.803365:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.803372:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760794.803377:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.803385:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.803404:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.803412:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e266 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26292224->26296319] (req 26292224->26296319) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760794.803509:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521086720:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40664us (41409us total) trans 4294973739 rc 0/0
00000100:00100000:2.0:1789760794.803520:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6452
00000100:00100000:2.0:1789760794.803530:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766404673160 time 766449502738 state 0x2 ref 0
00000100:00100000:0.0:1789760794.815010:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760794.815805:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521086848
00000100:00100000:2.0:1789760794.815819:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521086848
00000100:00100000:2.0:1789760794.815876:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766404673160 time 766449502738 state 0x0 ref 1
00000100:00100000:2.0:1789760794.815890:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766449763154 time 766449502738 state 0x1 ref 1
00000100:00100000:2.0:1789760794.815911:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766449763154 time 766502594460 state 0x0 ref 1
00000100:00100000:2.0:1789760794.815922:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521086848:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760794.815969:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26296320, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:2.0:1789760794.815978:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.815993:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:2.0:1789760794.815997:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760794.816003:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.816016:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760794.851411:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26296320 -> 26300416
00010000:00010000:2.0:1789760794.851431:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.851445:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.851453:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.851460:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760794.851464:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.851473:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.851491:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.851498:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e26d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26296320->26300415] (req 26296320->26300415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760794.851591:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521086848:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35664us (36586us total) trans 4294973740 rc 0/0
00000100:00100000:2.0:1789760794.851604:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6453
00000100:00100000:2.0:1789760794.851614:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766449763154 time 766502594460 state 0x2 ref 0
00000001:00080000:1.0:1789760794.853277:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973740 is committed
00000100:00100000:1.0:1789760794.855817:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760794.855970:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521086976
00000100:00100000:2.0:1789760794.856044:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521086976
00000100:00100000:2.0:1789760794.856097:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766449763154 time 766502594460 state 0x0 ref 1
00000100:00100000:2.0:1789760794.856112:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766502854876 time 766502594460 state 0x1 ref 1
00000100:00100000:2.0:1789760794.856166:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766502854876 time 766542848280 state 0x0 ref 1
00000100:00100000:2.0:1789760794.856180:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521086976:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760794.856230:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26300416, mtime: 0x6aad951b, atime: 0x0, ctime: 0x6aad951b, blocks: 0xd007
00010000:00010000:2.0:1789760794.856239:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.856361:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:2.0:1789760794.856367:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760794.856374:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.856390:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760794.899242:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973741 is committed
00002000:00010000:2.0:1789760794.899442:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26300416 -> 26304512
00002000:00010000:2.0:1789760794.899447:0:8104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760795 -> 1789760796
00002000:00010000:2.0:1789760794.899450:0:8104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760795 -> 1789760796
00010000:00010000:2.0:1789760794.899462:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.899474:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.899482:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.899489:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760794.899494:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.899504:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.899523:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.899531:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007371eb3/0x4a99e02bc60e274 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26300416->26304511] (req 26300416->26304511) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760794.899621:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521086976:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43439us (43808us total) trans 4294973741 rc 0/0
00000100:00100000:2.0:1789760794.899631:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6454
00000100:00100000:2.0:1789760794.899640:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766502854876 time 766542848280 state 0x2 ref 0
00000100:00100000:1.0:1789760794.907648:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760794.907813:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521087104
00000100:00100000:2.0:1789760794.907823:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521087104
00000100:00100000:2.0:1789760794.907933:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766502854876 time 766542848280 state 0x0 ref 1
00000100:00100000:2.0:1789760794.907949:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766543108696 time 766542848280 state 0x1 ref 1
00000100:00100000:2.0:1789760794.908072:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766543108696 time 766594754418 state 0x0 ref 1
00000100:00100000:2.0:1789760794.908085:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521087104:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760794.908129:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26304512, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:2.0:1789760794.908138:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.908152:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:2.0:1789760794.908156:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760794.908161:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760794.908175:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760794.942624:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973742 is committed
00002000:00010000:1.0:1789760794.942789:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26304512 -> 26308608
00010000:00010000:1.0:1789760794.942805:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.942819:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.942828:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.942835:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760794.942840:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.942858:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.943204:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.943214:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e27b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26304512->26308607] (req 26304512->26308607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760794.944209:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521087104:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36118us (36563us total) trans 4294973742 rc 0/0
00000100:00100000:1.0:1789760794.944222:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6455
00000100:00100000:1.0:1789760794.944232:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766543108696 time 766594754418 state 0x2 ref 0
00000100:00100000:0.0:1789760794.948293:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.948497:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521087232
00000100:00100000:1.0:1789760794.948507:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521087232
00000100:00100000:1.0:1789760794.948569:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766543108696 time 766594754418 state 0x0 ref 1
00000100:00100000:1.0:1789760794.948586:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766595014834 time 766594754418 state 0x1 ref 1
00000100:00100000:1.0:1789760794.948733:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766595014834 time 766635413868 state 0x0 ref 1
00000100:00100000:1.0:1789760794.948747:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521087232:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.948796:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26308608, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:1.0:1789760794.948805:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.948822:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760794.948827:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.948834:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.948848:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760794.980278:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973743 is committed
00002000:00010000:3.0:1789760794.980432:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26308608 -> 26312704
00010000:00010000:3.0:1789760794.980448:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.980461:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.980471:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.980478:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760794.980483:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.980492:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.980513:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760794.980522:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043a59fa5/0x4a99e02bc60e282 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26308608->26312703] (req 26308608->26312703) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760794.980667:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521087232:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31908us (32369us total) trans 4294973743 rc 0/0
00000100:00100000:3.0:1789760794.980679:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6456
00000100:00100000:3.0:1789760794.980688:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766595014834 time 766635413868 state 0x2 ref 0
00000100:00100000:2.0:1789760794.992406:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760794.992484:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521087360
00000100:00100000:1.0:1789760794.992494:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521087360
00000100:00100000:1.0:1789760794.992555:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766595014834 time 766635413868 state 0x0 ref 1
00000100:00100000:1.0:1789760794.992570:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766635674284 time 766635413868 state 0x1 ref 1
00000100:00100000:1.0:1789760794.992598:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766635674284 time 766679281049 state 0x0 ref 1
00000100:00100000:1.0:1789760794.992615:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521087360:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760794.992769:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26312704, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:1.0:1789760794.992780:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.992797:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760794.992801:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760794.992808:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760794.992822:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760795.031629:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973744 is committed
00002000:00010000:3.0:1789760795.031789:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26312704 -> 26316800
00010000:00010000:3.0:1789760795.031806:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.031825:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.031835:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.031842:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595cc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760795.031846:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.031855:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.031988:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.031999:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e061eda/0x4a99e02bc60e289 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26312704->26316799] (req 26312704->26316799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760795.032116:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521087360:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39498us (39714us total) trans 4294973744 rc 0/0
00000100:00100000:3.0:1789760795.032127:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6457
00000100:00100000:3.0:1789760795.032136:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766635674284 time 766679281049 state 0x2 ref 0
00000100:00100000:1.0:1789760795.035093:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760795.035236:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521087488
00000100:00100000:2.0:1789760795.035245:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521087488
00000100:00100000:2.0:1789760795.035296:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766635674284 time 766679281049 state 0x0 ref 1
00000100:00100000:2.0:1789760795.035422:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766679541465 time 766679281049 state 0x1 ref 1
00000100:00100000:2.0:1789760795.035471:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766679541465 time 766722153509 state 0x0 ref 1
00000100:00100000:2.0:1789760795.035488:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521087488:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760795.035585:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26316800, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:2.0:1789760795.035595:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.035610:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:2.0:1789760795.035615:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760795.035621:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.035636:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760795.066209:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973745 is committed
00002000:00010000:3.0:1789760795.066294:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26316800 -> 26320896
00010000:00010000:3.0:1789760795.066309:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.066336:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.066355:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.066363:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760795.066368:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.066377:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.066395:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.066403:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf24ba54/0x4a99e02bc60e290 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26316800->26320895] (req 26316800->26320895) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760795.066523:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521087488:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31036us (31434us total) trans 4294973745 rc 0/0
00000100:00100000:3.0:1789760795.066534:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6458
00000100:00100000:3.0:1789760795.066542:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766679541465 time 766722153509 state 0x2 ref 0
00000100:00100000:2.0:1789760795.077640:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760795.077937:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521087616
00000100:00100000:1.0:1789760795.077947:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521087616
00000100:00100000:1.0:1789760795.078006:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766679541465 time 766722153509 state 0x0 ref 1
00000100:00100000:1.0:1789760795.078023:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766722413925 time 766722153509 state 0x1 ref 1
00000100:00100000:1.0:1789760795.078058:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766722413925 time 766764740657 state 0x0 ref 1
00000100:00100000:1.0:1789760795.078071:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521087616:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760795.078132:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26320896, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:1.0:1789760795.078142:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760795.078159:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760795.078163:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760795.078169:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760795.078184:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760795.108285:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973746 is committed
00002000:00010000:2.0:1789760795.108452:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26320896 -> 26324992
00010000:00010000:2.0:1789760795.108468:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.108482:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.108491:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.108499:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ca00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760795.108504:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.108513:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.108534:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.108543:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e196384c/0x4a99e02bc60e297 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26320896->26324991] (req 26320896->26324991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760795.108684:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521087616:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30610us (31050us total) trans 4294973746 rc 0/0
00000100:00100000:2.0:1789760795.108695:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6459
00000100:00100000:2.0:1789760795.108705:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766722413925 time 766764740657 state 0x2 ref 0
00000100:00100000:1.0:1789760795.116067:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760795.116285:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521087744
00000100:00100000:3.0:1789760795.116295:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521087744
00000100:00100000:0.0:1789760795.117054:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766722413925 time 766764740657 state 0x0 ref 1
00000100:00100000:0.0:1789760795.117075:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766765001073 time 766764740657 state 0x1 ref 1
00000100:00100000:0.0:1789760795.117145:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766765001073 time 766803826341 state 0x0 ref 1
00000100:00100000:0.0:1789760795.117161:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521087744:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760795.117224:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26324992, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:0.0:1789760795.117234:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.117250:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:0.0:1789760795.117254:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760795.117261:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.117275:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760795.143798:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26324992 -> 26329088
00010000:00010000:0.0:1789760795.143817:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.143830:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.143839:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.143851:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760795.143857:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.143877:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.143899:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.143907:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080e312aa/0x4a99e02bc60e29e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26324992->26329087] (req 26324992->26329087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760795.143996:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521087744:12345-192.168.203.16@tcp:4:dd.0 Request processed in 26834us (27933us total) trans 4294973747 rc 0/0
00000100:00100000:0.0:1789760795.144007:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6460
00000100:00100000:0.0:1789760795.144017:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766765001073 time 766803826341 state 0x2 ref 0
00000001:00080000:3.0:1789760795.145501:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973747 is committed
00000100:00100000:0.0:1789760795.151172:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760795.151694:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521087872
00000100:00100000:3.0:1789760795.151706:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521087872
00000100:00100000:3.0:1789760795.151778:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766765001073 time 766803826341 state 0x0 ref 1
00000100:00100000:3.0:1789760795.151792:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766804086757 time 766803826341 state 0x1 ref 1
00000100:00100000:3.0:1789760795.151816:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766804086757 time 766838499443 state 0x0 ref 1
00000100:00100000:3.0:1789760795.151829:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521087872:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760795.152230:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26329088, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:3.0:1789760795.152241:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.152256:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:3.0:1789760795.152261:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760795.152268:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.152281:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760795.179706:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973748 is committed
00002000:00010000:3.0:1789760795.179957:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26329088 -> 26333184
00010000:00010000:3.0:1789760795.179973:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.179987:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.179996:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.180004:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760795.180009:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.180018:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.180037:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.180045:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26329088->26333183] (req 26329088->26333183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760795.180174:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc892b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521087872:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28343us (29013us total) trans 4294973748 rc 0/0
00000100:00100000:3.0:1789760795.180187:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6461
00000100:00100000:3.0:1789760795.180197:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766804086757 time 766838499443 state 0x2 ref 0
00000100:00100000:0.0:1789760795.185639:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760795.185817:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521088000
00000100:00100000:3.0:1789760795.185828:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521088000
00000100:00100000:3.0:1789760795.185885:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766804086757 time 766838499443 state 0x0 ref 1
00000100:00100000:3.0:1789760795.185901:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766838759859 time 766838499443 state 0x1 ref 1
00000100:00100000:3.0:1789760795.185962:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766838759859 time 766872643975 state 0x0 ref 1
00000100:00100000:3.0:1789760795.185976:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521088000:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760795.186025:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26333184, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:3.0:1789760795.186035:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.186052:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:3.0:1789760795.186056:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760795.186063:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.186078:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.193450:0:6444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760795.222997:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973749 is committed
00002000:00010000:3.0:1789760795.223108:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26333184 -> 26337280
00010000:00010000:3.0:1789760795.223124:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.223137:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.223153:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.223160:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760795.223165:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.223175:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.223198:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.223207:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26333184->26337279] (req 26333184->26337279) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760795.223305:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda745b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521088000:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37328us (37672us total) trans 4294973749 rc 0/0
00000100:00100000:3.0:1789760795.223356:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6462
00000100:00100000:3.0:1789760795.223366:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766838759859 time 766872643975 state 0x2 ref 0
00000100:00100000:2.0:1789760795.226484:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760795.226889:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521088128
00000100:00100000:1.0:1789760795.226899:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521088128
00000100:00100000:1.0:1789760795.226955:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766838759859 time 766872643975 state 0x0 ref 1
00000100:00100000:1.0:1789760795.226970:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766872904391 time 766872643975 state 0x1 ref 1
00000100:00100000:1.0:1789760795.226999:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766872904391 time 766913681769 state 0x0 ref 1
00000100:00100000:1.0:1789760795.227012:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521088128:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760795.227070:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26337280, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:1.0:1789760795.227083:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760795.227101:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:1.0:1789760795.227106:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760795.227113:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760795.227129:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760795.277999:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973750 is committed
00002000:00010000:3.0:1789760795.278410:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26337280 -> 26341376
00010000:00010000:3.0:1789760795.278597:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.278618:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.278628:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.278636:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760795.278640:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.278649:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.278670:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.278677:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e2b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26337280->26341375] (req 26337280->26341375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760795.278814:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521088128:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51798us (52335us total) trans 4294973750 rc 0/0
00000100:00100000:3.0:1789760795.278826:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6463
00000100:00100000:3.0:1789760795.278835:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766872904391 time 766913681769 state 0x2 ref 0
00000100:00100000:0.0:1789760795.287733:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760795.287844:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521088256
00000100:00100000:2.0:1789760795.287854:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521088256
00000100:00100000:2.0:1789760795.287910:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766872904391 time 766913681769 state 0x0 ref 1
00000100:00100000:2.0:1789760795.287927:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766913942185 time 766913681769 state 0x1 ref 1
00000100:00100000:2.0:1789760795.287965:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766913942185 time 766974646767 state 0x0 ref 1
00000100:00100000:2.0:1789760795.287978:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521088256:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760795.288027:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26341376, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:2.0:1789760795.288036:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.288052:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=766s v=(0 0)
00010000:00010000:2.0:1789760795.288056:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760795.288063:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.288077:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760795.319827:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973751 is committed
00002000:00010000:2.0:1789760795.319894:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26341376 -> 26345472
00010000:00010000:2.0:1789760795.319911:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.319925:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.319934:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.319941:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760795.319946:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.319955:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.319977:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.319985:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26341376->26345471] (req 26341376->26345471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760795.320081:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521088256:12345-192.168.203.16@tcp:4:dd.0 Request processed in 32100us (32353us total) trans 4294973751 rc 0/0
00000100:00100000:2.0:1789760795.320091:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6464
00000100:00100000:2.0:1789760795.320101:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766913942185 time 766974646767 state 0x2 ref 0
00000100:00100000:0.0:1789760795.323635:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760795.323846:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521088384
00000100:00100000:3.0:1789760795.323855:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521088384
00000100:00100000:3.0:1789760795.323910:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766913942185 time 766974646767 state 0x0 ref 1
00000100:00100000:3.0:1789760795.323926:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766974907183 time 766974646767 state 0x1 ref 1
00000100:00100000:3.0:1789760795.324085:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766974907183 time 767010766452 state 0x0 ref 1
00000100:00100000:3.0:1789760795.324098:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521088384:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760795.324147:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26345472, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:3.0:1789760795.324156:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.324181:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:3.0:1789760795.324186:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760795.324193:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.324207:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760795.364735:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26345472 -> 26349568
00010000:00010000:0.0:1789760795.364754:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.364766:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.364773:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.364780:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760795.364785:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.364793:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.364809:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.364816:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26345472->26349567] (req 26345472->26349567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760795.364911:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521088384:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40809us (41386us total) trans 4294973752 rc 0/0
00000100:00100000:0.0:1789760795.364921:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6465
00000100:00100000:0.0:1789760795.364932:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766974907183 time 767010766452 state 0x2 ref 0
00000001:00080000:2.0:1789760795.365087:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973752 is committed
00000100:00100000:1.0:1789760795.368040:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760795.368456:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521088512
00000100:00100000:3.0:1789760795.368467:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521088512
00000100:00100000:3.0:1789760795.368521:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 766974907183 time 767010766452 state 0x0 ref 1
00000100:00100000:3.0:1789760795.368537:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767011026868 time 767010766452 state 0x1 ref 1
00000100:00100000:3.0:1789760795.368573:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767011026868 time 767055255417 state 0x0 ref 1
00000100:00100000:3.0:1789760795.368588:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521088512:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760795.368638:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26349568, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:3.0:1789760795.368647:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.368663:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:3.0:1789760795.368667:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760795.368672:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.368682:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760795.396610:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973753 is committed
00002000:00010000:3.0:1789760795.396721:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26349568 -> 26353664
00010000:00010000:3.0:1789760795.396737:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.396751:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.396761:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.396770:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760795.396775:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.396785:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.396805:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.396814:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26349568->26353663] (req 26349568->26353663) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760795.397006:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521088512:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28415us (28970us total) trans 4294973753 rc 0/0
00000100:00100000:3.0:1789760795.397018:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6466
00000100:00100000:3.0:1789760795.397028:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767011026868 time 767055255417 state 0x2 ref 0
00000100:00100000:1.0:1789760795.401298:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760795.401747:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521088640
00000100:00100000:3.0:1789760795.401756:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521088640
00000100:00100000:3.0:1789760795.401806:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767011026868 time 767055255417 state 0x0 ref 1
00000100:00100000:3.0:1789760795.401820:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767055515833 time 767055255417 state 0x1 ref 1
00000100:00100000:3.0:1789760795.401889:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767055515833 time 767088571492 state 0x0 ref 1
00000100:00100000:3.0:1789760795.401902:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda5f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521088640:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760795.401947:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26353664, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:3.0:1789760795.401956:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.402038:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:3.0:1789760795.402043:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760795.402049:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.402064:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760795.446075:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973754 is committed
00002000:00010000:2.0:1789760795.449775:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26353664 -> 26357760
00010000:00010000:2.0:1789760795.449796:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.449809:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.449818:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.449827:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760795.449832:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.449841:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.449861:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.449938:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e2cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26353664->26357759] (req 26353664->26357759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760795.450181:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda5f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521088640:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48276us (48888us total) trans 4294973754 rc 0/0
00000100:00100000:2.0:1789760795.450192:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6467
00000100:00100000:2.0:1789760795.450202:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767055515833 time 767088571492 state 0x2 ref 0
00000100:00100000:1.0:1789760795.455633:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760795.455722:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521088768
00000100:00100000:2.0:1789760795.455732:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521088768
00000100:00100000:2.0:1789760795.455785:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767055515833 time 767088571492 state 0x0 ref 1
00000100:00100000:2.0:1789760795.455800:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767088831908 time 767088571492 state 0x1 ref 1
00000100:00100000:2.0:1789760795.455861:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767088831908 time 767142543254 state 0x0 ref 1
00000100:00100000:2.0:1789760795.455876:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521088768:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760795.455924:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26357760, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:2.0:1789760795.455933:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.455949:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760795.455953:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760795.455960:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.456061:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760795.517114:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973755 is committed
00002000:00010000:2.0:1789760795.517195:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26357760 -> 26361856
00010000:00010000:2.0:1789760795.517212:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.517225:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.517235:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.517242:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760795.517248:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.517258:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.517278:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.517286:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26357760->26361855] (req 26357760->26361855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760795.517595:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521088768:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61715us (61965us total) trans 4294973755 rc 0/0
00000100:00100000:2.0:1789760795.517607:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6468
00000100:00100000:2.0:1789760795.517617:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767088831908 time 767142543254 state 0x2 ref 0
00000100:00100000:1.0:1789760795.521255:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760795.522393:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521088896
00000100:00100000:0.0:1789760795.522405:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521088896
00000100:00100000:0.0:1789760795.522463:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767088831908 time 767142543254 state 0x0 ref 1
00000100:00100000:0.0:1789760795.522478:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767142803670 time 767142543254 state 0x1 ref 1
00000100:00100000:0.0:1789760795.522506:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767142803670 time 767209188609 state 0x0 ref 1
00000100:00100000:0.0:1789760795.522519:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521088896:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760795.522568:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26361856, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:0.0:1789760795.522578:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.522595:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:0.0:1789760795.522599:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760795.522606:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.522619:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760795.569495:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973756 is committed
00002000:00010000:0.0:1789760795.569612:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26361856 -> 26365952
00010000:00010000:0.0:1789760795.569628:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.569642:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.569652:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.569672:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760795.569678:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.569688:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.569708:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.569716:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016d4bc97/0x4a99e02bc60e2dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26361856->26365951] (req 26361856->26365951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760795.569812:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521088896:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47289us (48559us total) trans 4294973756 rc 0/0
00000100:00100000:0.0:1789760795.569823:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6469
00000100:00100000:0.0:1789760795.569833:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767142803670 time 767209188609 state 0x2 ref 0
00000100:00100000:1.0:1789760795.575866:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760795.575999:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521089024
00000100:00100000:3.0:1789760795.576010:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521089024
00000100:00100000:3.0:1789760795.576069:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767142803670 time 767209188609 state 0x0 ref 1
00000100:00100000:3.0:1789760795.576084:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767209449025 time 767209188609 state 0x1 ref 1
00000100:00100000:3.0:1789760795.576116:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767209449025 time 767262794151 state 0x0 ref 1
00000100:00100000:3.0:1789760795.576130:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc16adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521089024:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760795.576176:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26365952, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:3.0:1789760795.576186:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.576201:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:3.0:1789760795.576206:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760795.576212:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.576230:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760795.619332:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973757 is committed
00002000:00010000:3.0:1789760795.619490:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26365952 -> 26370048
00010000:00010000:3.0:1789760795.619505:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.619519:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.619528:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.619535:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760795.619541:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.619549:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.619567:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.619574:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e2e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26365952->26370047] (req 26365952->26370047) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760795.619762:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc16adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521089024:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43630us (43900us total) trans 4294973757 rc 0/0
00000100:00100000:3.0:1789760795.619774:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6470
00000100:00100000:3.0:1789760795.619783:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767209449025 time 767262794151 state 0x2 ref 0
00000100:00100000:1.0:1789760795.625586:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760795.626144:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521089152
00000100:00100000:2.0:1789760795.626155:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521089152
00000100:00100000:2.0:1789760795.626207:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767209449025 time 767262794151 state 0x0 ref 1
00000100:00100000:2.0:1789760795.626222:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767263054567 time 767262794151 state 0x1 ref 1
00000100:00100000:2.0:1789760795.626255:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767263054567 time 767312937563 state 0x0 ref 1
00000100:00100000:2.0:1789760795.626267:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521089152:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760795.626354:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26370048, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:2.0:1789760795.626364:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.626379:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760795.626383:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760795.626389:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.626402:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760795.673265:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973758 is committed
00002000:00010000:0.0:1789760795.673694:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26370048 -> 26374144
00010000:00010000:0.0:1789760795.673710:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.673729:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.673738:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.673746:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760795.673750:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.673760:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.673778:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.673787:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e2eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26370048->26374143] (req 26370048->26374143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760795.674071:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521089152:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47800us (48488us total) trans 4294973758 rc 0/0
00000100:00100000:0.0:1789760795.674082:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6471
00000100:00100000:0.0:1789760795.674093:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767263054567 time 767312937563 state 0x2 ref 0
00000100:00100000:1.0:1789760795.681776:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760795.682079:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521089280
00000100:00100000:2.0:1789760795.682089:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521089280
00000100:00100000:2.0:1789760795.682146:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767263054567 time 767312937563 state 0x0 ref 1
00000100:00100000:2.0:1789760795.682161:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767313197979 time 767312937563 state 0x1 ref 1
00000100:00100000:2.0:1789760795.682227:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767313197979 time 767368907909 state 0x0 ref 1
00000100:00100000:2.0:1789760795.682241:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521089280:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760795.682290:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26374144, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:2.0:1789760795.682300:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.682582:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760795.682588:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760795.682594:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.682615:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760795.728018:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973759 is committed
00002000:00010000:0.0:1789760795.728135:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26374144 -> 26378240
00010000:00010000:0.0:1789760795.728163:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.728188:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.728198:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.728207:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02aa00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760795.728213:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.728227:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.728247:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.728255:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b62417d/0x4a99e02bc60e2f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26374144->26378239] (req 26374144->26378239) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760795.728396:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521089280:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46152us (46622us total) trans 4294973759 rc 0/0
00000100:00100000:0.0:1789760795.728407:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6472
00000100:00100000:0.0:1789760795.728501:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767313197979 time 767368907909 state 0x2 ref 0
00000100:00100000:1.0:1789760795.735985:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760795.740934:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521089408
00000100:00100000:0.0:1789760795.740946:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521089408
00000100:00100000:2.0:1789760795.741250:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767313197979 time 767368907909 state 0x0 ref 1
00000100:00100000:2.0:1789760795.741266:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767369168325 time 767368907909 state 0x1 ref 1
00000100:00100000:2.0:1789760795.741300:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767369168325 time 767427983120 state 0x0 ref 1
00000100:00100000:2.0:1789760795.741343:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521089408:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760795.741393:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26378240, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:2.0:1789760795.741402:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.741417:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760795.741422:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760795.741429:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.741442:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760795.800186:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973760 is committed
00002000:00010000:2.0:1789760795.800256:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26378240 -> 26382336
00010000:00010000:2.0:1789760795.800272:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.800284:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.800293:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.800300:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760795.800304:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.800347:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.800600:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.800610:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e2f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26378240->26382335] (req 26378240->26382335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760795.800700:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521089408:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59385us (64719us total) trans 4294973760 rc 0/0
00000100:00100000:2.0:1789760795.800710:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6473
00000100:00100000:2.0:1789760795.800719:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767369168325 time 767427983120 state 0x2 ref 0
00000100:00100000:1.0:1789760795.806667:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760795.806818:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521089536
00000100:00100000:3.0:1789760795.806829:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521089536
00000100:00100000:3.0:1789760795.806891:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767369168325 time 767427983120 state 0x0 ref 1
00000100:00100000:3.0:1789760795.806907:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767428243536 time 767427983120 state 0x1 ref 1
00000100:00100000:3.0:1789760795.806986:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767428243536 time 767493668248 state 0x0 ref 1
00000100:00100000:3.0:1789760795.807000:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521089536:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760795.807046:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26382336, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:3.0:1789760795.807055:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.807070:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:3.0:1789760795.807075:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760795.807081:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.807094:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760795.866391:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26382336 -> 26386432
00010000:00010000:2.0:1789760795.866409:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.866422:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.866430:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.866437:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760795.866441:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.866450:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.866468:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.866475:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e300 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26382336->26386431] (req 26382336->26386431) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760795.866574:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521089536:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59571us (59910us total) trans 4294973761 rc 0/0
00000100:00100000:2.0:1789760795.866584:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6474
00000100:00100000:2.0:1789760795.866595:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767428243536 time 767493668248 state 0x2 ref 0
00000001:00080000:0.0:1789760795.866727:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973761 is committed
00000100:00100000:0.0:1789760795.871235:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760795.871429:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521089664
00000100:00100000:1.0:1789760795.871438:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521089664
00000100:00100000:1.0:1789760795.871493:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767428243536 time 767493668248 state 0x0 ref 1
00000100:00100000:1.0:1789760795.871649:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767493928664 time 767493668248 state 0x1 ref 1
00000100:00100000:1.0:1789760795.871717:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767493928664 time 767558398148 state 0x0 ref 1
00000100:00100000:1.0:1789760795.871731:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521089664:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760795.871778:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26386432, mtime: 0x6aad951c, atime: 0x0, ctime: 0x6aad951c, blocks: 0xd007
00010000:00010000:1.0:1789760795.871787:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760795.871803:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:1.0:1789760795.871807:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760795.871813:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760795.871827:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760795.906630:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26386432 -> 26390528
00002000:00010000:2.0:1789760795.906639:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760796 -> 1789760797
00002000:00010000:2.0:1789760795.906642:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760796 -> 1789760797
00010000:00010000:2.0:1789760795.906655:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.906667:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.906676:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.906683:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760795.906688:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.906696:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.906714:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.906722:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e307 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26386432->26390527] (req 26386432->26390527) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760795.906817:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521089664:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35084us (35587us total) trans 4294973762 rc 0/0
00000100:00100000:2.0:1789760795.906829:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6475
00000100:00100000:2.0:1789760795.906838:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767493928664 time 767558398148 state 0x2 ref 0
00000001:00080000:3.0:1789760795.906980:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973762 is committed
00000100:00100000:3.0:1789760795.913583:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760795.913740:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521089792
00000100:00100000:0.0:1789760795.913751:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521089792
00000100:00100000:0.0:1789760795.913803:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767493928664 time 767558398148 state 0x0 ref 1
00000100:00100000:0.0:1789760795.913818:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767558658564 time 767558398148 state 0x1 ref 1
00000100:00100000:0.0:1789760795.913849:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767558658564 time 767600531857 state 0x0 ref 1
00000100:00100000:0.0:1789760795.913861:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521089792:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760795.913919:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26390528, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:0.0:1789760795.913929:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.913946:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:0.0:1789760795.913951:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760795.913958:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760795.913971:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760795.975649:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26390528 -> 26394624
00010000:00010000:3.0:1789760795.975672:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.975688:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.975697:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.975705:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760795.975710:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.975719:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.975738:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760795.975746:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dbe3ac7/0x4a99e02bc60e30e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26390528->26394623] (req 26390528->26394623) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760795.975840:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521089792:12345-192.168.203.16@tcp:4:dd.0 Request processed in 61976us (62262us total) trans 4294973763 rc 0/0
00000100:00100000:3.0:1789760795.975851:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6476
00000100:00100000:3.0:1789760795.975860:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767558658564 time 767600531857 state 0x2 ref 0
00000001:00080000:3.0:1789760795.975907:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973763 is committed
00000100:00100000:0.0:1789760795.993101:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760795.993272:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521089920
00000100:00100000:2.0:1789760795.993282:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521089920
00000100:00100000:2.0:1789760795.993779:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767558658564 time 767600531857 state 0x0 ref 1
00000100:00100000:2.0:1789760795.993794:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767600792273 time 767600531857 state 0x1 ref 1
00000100:00100000:2.0:1789760795.993825:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767600792273 time 767680507715 state 0x0 ref 1
00000100:00100000:2.0:1789760795.993840:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521089920:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760795.993894:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26394624, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760795.993904:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.993920:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760795.993925:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760795.993931:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760795.993948:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760796.045347:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26394624 -> 26398720
00010000:00010000:2.0:1789760796.045372:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.045386:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.045396:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.045404:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760796.045409:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.045418:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.045438:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.045446:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e315 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26394624->26398719] (req 26394624->26398719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760796.045543:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521089920:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51701us (52446us total) trans 4294973764 rc 0/0
00000100:00100000:2.0:1789760796.045554:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6477
00000100:00100000:2.0:1789760796.045564:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767600792273 time 767680507715 state 0x2 ref 0
00000100:00100000:1.0:1789760796.049596:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760796.049716:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521090048
00000100:00100000:2.0:1789760796.049726:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521090048
00000100:00100000:2.0:1789760796.049785:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767600792273 time 767680507715 state 0x0 ref 1
00000100:00100000:2.0:1789760796.049803:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767680768131 time 767680507715 state 0x1 ref 1
00000100:00100000:2.0:1789760796.049878:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767680768131 time 767736560744 state 0x0 ref 1
00000100:00100000:2.0:1789760796.049891:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521090048:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760796.049937:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26398720, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760796.049947:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.049972:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760796.049976:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760796.049982:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.049995:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00080000:1.0:1789760796.050648:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000001:00080000:0.0:1789760796.050789:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973764 is committed
00000001:00080000:1.0:1789760796.097408:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973765 is committed
00002000:00010000:2.0:1789760796.097547:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26398720 -> 26402816
00010000:00010000:2.0:1789760796.097563:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.097576:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.097592:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.097600:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760796.097606:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.097615:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.097635:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.097643:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e31c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26398720->26402815] (req 26398720->26402815) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760796.097777:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b9c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521090048:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47883us (48187us total) trans 4294973765 rc 0/0
00000100:00100000:2.0:1789760796.097789:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6478
00000100:00100000:2.0:1789760796.097799:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767680768131 time 767736560744 state 0x2 ref 0
00000100:00100000:1.0:1789760796.101603:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760796.101688:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521090176
00000100:00100000:2.0:1789760796.101697:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521090176
00000100:00100000:2.0:1789760796.101746:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767680768131 time 767736560744 state 0x0 ref 1
00000100:00100000:2.0:1789760796.101759:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767736821160 time 767736560744 state 0x1 ref 1
00000100:00100000:2.0:1789760796.101815:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767736821160 time 767788497941 state 0x0 ref 1
00000100:00100000:2.0:1789760796.101827:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521090176:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760796.101882:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26402816, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760796.101890:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.101906:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760796.101910:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760796.101916:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.101929:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760796.143276:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26402816 -> 26406912
00010000:00010000:2.0:1789760796.143295:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.143309:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.143347:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.143355:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760796.143361:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.143370:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.143390:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.143398:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e323 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26402816->26406911] (req 26402816->26406911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760796.143488:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521090176:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41656us (41887us total) trans 4294973766 rc 0/0
00000100:00100000:2.0:1789760796.143497:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6479
00000100:00100000:2.0:1789760796.143507:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767736821160 time 767788497941 state 0x2 ref 0
00000001:00080000:1.0:1789760796.143580:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973766 is committed
00000100:00100000:1.0:1789760796.146388:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760796.146543:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521090304
00000100:00100000:3.0:1789760796.146553:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521090304
00000100:00100000:3.0:1789760796.146606:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767736821160 time 767788497941 state 0x0 ref 1
00000100:00100000:3.0:1789760796.146621:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767788758357 time 767788497941 state 0x1 ref 1
00000100:00100000:3.0:1789760796.146645:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767788758357 time 767833327671 state 0x0 ref 1
00000100:00100000:3.0:1789760796.146655:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521090304:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760796.146698:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26406912, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:3.0:1789760796.146706:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.146722:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:3.0:1789760796.146726:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760796.146732:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.146746:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760796.174006:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26406912 -> 26411008
00010000:00010000:3.0:1789760796.174027:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.174040:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.174050:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.174058:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760796.174063:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.174072:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.174090:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.174098:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e32a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26406912->26411007] (req 26406912->26411007) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760796.174186:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521090304:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27526us (27801us total) trans 4294973767 rc 0/0
00000100:00100000:3.0:1789760796.174197:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6480
00000100:00100000:3.0:1789760796.174206:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767788758357 time 767833327671 state 0x2 ref 0
00000001:00080000:1.0:1789760796.176632:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973767 is committed
00000100:00100000:3.0:1789760796.177280:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760796.177761:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521090432
00000100:00100000:2.0:1789760796.177770:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521090432
00000100:00100000:2.0:1789760796.177816:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767788758357 time 767833327671 state 0x0 ref 1
00000100:00100000:2.0:1789760796.177830:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767833588087 time 767833327671 state 0x1 ref 1
00000100:00100000:2.0:1789760796.177866:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767833588087 time 767864542024 state 0x0 ref 1
00000100:00100000:2.0:1789760796.177878:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521090432:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760796.177925:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26411008, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760796.177935:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.177951:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760796.177955:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760796.177971:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.177985:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760796.209470:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26411008 -> 26415104
00010000:00010000:3.0:1789760796.209489:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.209502:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.209512:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.209519:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02bc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760796.209523:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.209532:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.209551:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.209559:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b181a62/0x4a99e02bc60e331 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26411008->26415103] (req 26411008->26415103) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760796.209648:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521090432:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31766us (32367us total) trans 4294973768 rc 0/0
00000100:00100000:3.0:1789760796.209662:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6481
00000100:00100000:3.0:1789760796.209672:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767833588087 time 767864542024 state 0x2 ref 0
00000001:00080000:0.0:1789760796.212273:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973768 is committed
00000100:00100000:0.0:1789760796.213241:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760796.213348:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521090560
00000100:00100000:2.0:1789760796.213357:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521090560
00000100:00100000:2.0:1789760796.213406:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767833588087 time 767864542024 state 0x0 ref 1
00000100:00100000:2.0:1789760796.213420:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767864802440 time 767864542024 state 0x1 ref 1
00000100:00100000:2.0:1789760796.213445:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767864802440 time 767900128190 state 0x0 ref 1
00000100:00100000:2.0:1789760796.213457:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521090560:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760796.213503:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26415104, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760796.213512:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.213528:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760796.213532:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760796.213539:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.213553:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.217917:0:6445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:0.0:1789760796.243788:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973769 is committed
00002000:00010000:3.0:1789760796.243880:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26415104 -> 26419200
00010000:00010000:3.0:1789760796.243895:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.243908:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.243918:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.243925:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760796.243930:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.243939:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.243958:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.244033:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e338 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26415104->26419199] (req 26415104->26419199) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760796.244156:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521090560:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30696us (30915us total) trans 4294973769 rc 0/0
00000100:00100000:3.0:1789760796.244166:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6482
00000100:00100000:3.0:1789760796.244175:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767864802440 time 767900128190 state 0x2 ref 0
00000100:00100000:1.0:1789760796.247790:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760796.247936:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521090688
00000100:00100000:2.0:1789760796.247945:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521090688
00000100:00100000:2.0:1789760796.248050:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767864802440 time 767900128190 state 0x0 ref 1
00000100:00100000:2.0:1789760796.248065:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767900388606 time 767900128190 state 0x1 ref 1
00000100:00100000:2.0:1789760796.248118:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767900388606 time 767934800024 state 0x0 ref 1
00000100:00100000:2.0:1789760796.248130:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521090688:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760796.248172:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26419200, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760796.248180:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.248196:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760796.248200:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760796.248207:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.248220:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760796.274951:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26419200 -> 26423296
00010000:00010000:1.0:1789760796.274979:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.274993:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.275004:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.275019:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02be00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760796.275024:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.275034:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.275053:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.275061:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd3a8d0d/0x4a99e02bc60e33f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26419200->26423295] (req 26419200->26423295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760796.275148:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521090688:12345-192.168.203.16@tcp:4:dd.0 Request processed in 27014us (27362us total) trans 4294973770 rc 0/0
00000100:00100000:1.0:1789760796.275157:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6483
00000100:00100000:1.0:1789760796.275166:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767900388606 time 767934800024 state 0x2 ref 0
00000001:00080000:0.0:1789760796.275508:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973770 is committed
00000100:00100000:0.0:1789760796.278487:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760796.278560:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521090816
00000100:00100000:3.0:1789760796.278569:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521090816
00000100:00100000:3.0:1789760796.278616:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767900388606 time 767934800024 state 0x0 ref 1
00000100:00100000:3.0:1789760796.278630:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767935060440 time 767934800024 state 0x1 ref 1
00000100:00100000:3.0:1789760796.278687:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767935060440 time 767965369535 state 0x0 ref 1
00000100:00100000:3.0:1789760796.278699:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521090816:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760796.278740:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26423296, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:3.0:1789760796.278749:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.278764:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:3.0:1789760796.278768:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760796.278774:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.278787:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760796.285851:0:3454:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00100000:0.0:1789760796.291090:0:3454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc8dabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548778240:0@lo:41:osp-pre-0-1.0
00000100:00100000:0.0:1789760796.291155:0:3454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760796.291261:0:6462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548778240
00000100:00100000:1.0:1789760796.291270:0:6462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548778240
00000100:00100000:1.0:1789760796.291339:0:6462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469
00000100:00100000:1.0:1789760796.291350:0:6462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548778240:12345-0@lo:41:osp-pre-0-1.0
00000004:00000024:1.0:1789760796.291388:0:6462:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208
00000100:00100000:1.0:1789760796.291433:0:6462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3454:x1876699548778240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (277us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760796.291444:0:6462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469
00000100:00100000:1.0:1789760796.291481:0:3454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfc8dabb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3454:1876699548778240:0@lo:41:osp-pre-0-1.0
00000001:00080000:0.0:1789760796.302730:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973771 is committed
00002000:00010000:0.0:1789760796.302895:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26423296 -> 26427392
00010000:00010000:0.0:1789760796.302909:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.302923:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.302933:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.302941:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760796.302946:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.302954:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.303137:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.303147:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e346 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26423296->26427391] (req 26423296->26427391) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760796.303230:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521090816:12345-192.168.203.16@tcp:4:dd.0 Request processed in 24529us (24746us total) trans 4294973771 rc 0/0
00000100:00100000:0.0:1789760796.303240:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6484
00000100:00100000:0.0:1789760796.303249:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767935060440 time 767965369535 state 0x2 ref 0
00000100:00100000:2.0:1789760796.306820:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760796.306943:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521090944
00000100:00100000:3.0:1789760796.306953:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521090944
00000100:00100000:3.0:1789760796.307114:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767935060440 time 767965369535 state 0x0 ref 1
00000100:00100000:3.0:1789760796.307129:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767965629951 time 767965369535 state 0x1 ref 1
00000100:00100000:3.0:1789760796.307192:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767965629951 time 767993873674 state 0x0 ref 1
00000100:00100000:3.0:1789760796.307204:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521090944:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760796.307821:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26427392, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760796.307833:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.307849:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=767s v=(0 0)
00010000:00010000:2.0:1789760796.307854:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760796.307868:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.307882:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760796.342504:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26427392 -> 26431488
00010000:00010000:2.0:1789760796.342522:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.342536:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.342544:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.342551:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760796.342556:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.342564:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.342587:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.342594:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e34d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26427392->26431487] (req 26427392->26431487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760796.342684:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2407:x1876699521090944:12345-192.168.203.16@tcp:4:dd.0 Request processed in 35478us (35867us total) trans 4294973772 rc 0/0
00000100:00100000:2.0:1789760796.342694:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6485
00000100:00100000:2.0:1789760796.342704:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767965629951 time 767993873674 state 0x2 ref 0
00000001:00080000:2.0:1789760796.344439:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973772 is committed
00000100:00100000:1.0:1789760796.346089:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760796.346214:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521091072
00000100:00100000:0.0:1789760796.346223:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521091072
00000100:00100000:0.0:1789760796.346269:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767965629951 time 767993873674 state 0x0 ref 1
00000100:00100000:0.0:1789760796.346281:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767994134090 time 767993873674 state 0x1 ref 1
00000100:00100000:0.0:1789760796.346353:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767994134090 time 768032996637 state 0x0 ref 1
00000100:00100000:0.0:1789760796.346367:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521091072:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760796.346417:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26431488, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:0.0:1789760796.346427:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.346448:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:0.0:1789760796.346453:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760796.346459:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.346480:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760796.394299:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973773 is committed
00002000:00010000:0.0:1789760796.394459:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26431488 -> 26435584
00010000:00010000:0.0:1789760796.394475:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.394488:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.394497:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.394505:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760796.394511:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.394579:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.394600:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.394607:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e354 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26431488->26435583] (req 26431488->26435583) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760796.394733:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8b3d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521091072:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48365us (48647us total) trans 4294973773 rc 0/0
00000100:00100000:0.0:1789760796.394744:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6486
00000100:00100000:0.0:1789760796.394754:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767994134090 time 768032996637 state 0x2 ref 0
00000100:00100000:0.0:1789760796.398904:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760796.398991:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521091200
00000100:00100000:2.0:1789760796.399011:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521091200
00000100:00100000:2.0:1789760796.399078:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 767994134090 time 768032996637 state 0x0 ref 1
00000100:00100000:2.0:1789760796.399093:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768033257053 time 768032996637 state 0x1 ref 1
00000100:00100000:2.0:1789760796.399124:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768033257053 time 768085805826 state 0x0 ref 1
00000100:00100000:2.0:1789760796.399137:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521091200:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760796.399186:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26435584, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760796.399195:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.399216:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:2.0:1789760796.399221:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760796.399227:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.399241:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760796.473942:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973774 is committed
00002000:00010000:0.0:1789760796.474417:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26435584 -> 26439680
00010000:00010000:0.0:1789760796.474433:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.474445:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.474454:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.474462:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760796.474467:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.474475:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.474494:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.474507:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059680b26/0x4a99e02bc60e35b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26435584->26439679] (req 26435584->26439679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760796.474595:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521091200:12345-192.168.203.16@tcp:4:dd.0 Request processed in 75456us (75695us total) trans 4294973774 rc 0/0
00000100:00100000:0.0:1789760796.474605:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6487
00000100:00100000:0.0:1789760796.474614:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768033257053 time 768085805826 state 0x2 ref 0
00000100:00100000:1.0:1789760796.484285:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760796.485171:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521091328
00000100:00100000:3.0:1789760796.485183:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521091328
00000100:00100000:3.0:1789760796.485246:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768033257053 time 768085805826 state 0x0 ref 1
00000100:00100000:3.0:1789760796.485263:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768086066242 time 768085805826 state 0x1 ref 1
00000100:00100000:3.0:1789760796.485296:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768086066242 time 768171978081 state 0x0 ref 1
00000100:00100000:3.0:1789760796.485310:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521091328:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760796.485394:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26439680, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:3.0:1789760796.485404:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.485421:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760796.485426:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760796.485434:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.485448:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760796.558885:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973775 is committed
00002000:00010000:3.0:1789760796.559041:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26439680 -> 26443776
00010000:00010000:3.0:1789760796.559056:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.559070:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.559080:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.559089:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760796.559093:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.559103:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.559123:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.559131:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e362 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26439680->26443775] (req 26439680->26443775) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760796.559296:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521091328:12345-192.168.203.16@tcp:4:dd.0 Request processed in 73983us (75015us total) trans 4294973775 rc 0/0
00000100:00100000:3.0:1789760796.559307:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6488
00000100:00100000:3.0:1789760796.559354:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768086066242 time 768171978081 state 0x2 ref 0
00000100:00100000:1.0:1789760796.570694:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760796.570786:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521091456
00000100:00100000:3.0:1789760796.570796:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521091456
00000100:00100000:3.0:1789760796.570847:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768086066242 time 768171978081 state 0x0 ref 1
00000100:00100000:3.0:1789760796.570872:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768172238497 time 768171978081 state 0x1 ref 1
00000100:00100000:3.0:1789760796.570902:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768172238497 time 768257585076 state 0x0 ref 1
00000100:00100000:3.0:1789760796.570915:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521091456:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760796.570974:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26443776, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:3.0:1789760796.570983:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.571000:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760796.571004:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760796.571010:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.571024:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760796.616758:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973776 is committed
00002000:00010000:2.0:1789760796.616925:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26443776 -> 26447872
00010000:00010000:2.0:1789760796.616942:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.616955:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.616964:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.616971:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760796.616976:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.616985:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.617007:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.617015:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e369 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26443776->26447871] (req 26443776->26447871) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760796.617150:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7429c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521091456:12345-192.168.203.16@tcp:4:dd.0 Request processed in 46232us (46461us total) trans 4294973776 rc 0/0
00000100:00100000:2.0:1789760796.617160:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6489
00000100:00100000:2.0:1789760796.617169:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768172238497 time 768257585076 state 0x2 ref 0
00000100:00100000:0.0:1789760796.626437:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760796.626540:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521091584
00000100:00100000:3.0:1789760796.626550:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521091584
00000100:00100000:3.0:1789760796.626607:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768172238497 time 768257585076 state 0x0 ref 1
00000100:00100000:3.0:1789760796.626624:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768257845492 time 768257585076 state 0x1 ref 1
00000100:00100000:3.0:1789760796.626656:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768257845492 time 768313339550 state 0x0 ref 1
00000100:00100000:3.0:1789760796.626668:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521091584:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760796.626721:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26447872, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:3.0:1789760796.626731:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.626747:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760796.626751:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760796.626758:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.626772:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760796.663093:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26447872 -> 26451968
00010000:00010000:1.0:1789760796.663113:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.663127:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.663137:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.663145:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760796.663150:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.663161:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.663180:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.663194:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e370 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26447872->26451967] (req 26447872->26451967) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760796.663291:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521091584:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36618us (36857us total) trans 4294973777 rc 0/0
00000100:00100000:1.0:1789760796.663302:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6490
00000100:00100000:1.0:1789760796.663357:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768257845492 time 768313339550 state 0x2 ref 0
00000001:00080000:1.0:1789760796.663396:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973777 is committed
00000100:00100000:1.0:1789760796.672778:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760796.672893:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521091712
00000100:00100000:0.0:1789760796.672903:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521091712
00000100:00100000:0.0:1789760796.672970:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768257845492 time 768313339550 state 0x0 ref 1
00000100:00100000:0.0:1789760796.672986:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768313599966 time 768313339550 state 0x1 ref 1
00000100:00100000:0.0:1789760796.673018:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768313599966 time 768359700648 state 0x0 ref 1
00000100:00100000:0.0:1789760796.673031:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521091712:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760796.673075:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26451968, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:0.0:1789760796.673084:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.673100:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:0.0:1789760796.673105:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760796.673111:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.673126:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760796.710708:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26451968 -> 26456064
00010000:00010000:0.0:1789760796.710729:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.710743:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.710753:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.710761:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760796.710766:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.710775:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.710795:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.710803:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e377 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26451968->26456063] (req 26451968->26456063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760796.710894:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521091712:12345-192.168.203.16@tcp:4:dd.0 Request processed in 37859us (38121us total) trans 4294973778 rc 0/0
00000100:00100000:0.0:1789760796.710905:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6491
00000100:00100000:0.0:1789760796.710915:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768313599966 time 768359700648 state 0x2 ref 0
00000001:00080000:1.0:1789760796.711154:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973778 is committed
00000100:00100000:1.0:1789760796.717103:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760796.717257:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521091840
00000100:00100000:0.0:1789760796.717268:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521091840
00000100:00100000:0.0:1789760796.717479:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768313599966 time 768359700648 state 0x0 ref 1
00000100:00100000:0.0:1789760796.717495:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768359961064 time 768359700648 state 0x1 ref 1
00000100:00100000:1.0:1789760796.717599:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768359961064 time 768404279895 state 0x0 ref 1
00000100:00100000:1.0:1789760796.717614:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521091840:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760796.717662:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26456064, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:1.0:1789760796.717671:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.717687:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:1.0:1789760796.717691:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760796.717698:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.717713:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760796.768515:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973779 is committed
00002000:00010000:2.0:1789760796.768601:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26456064 -> 26460160
00010000:00010000:2.0:1789760796.768619:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.768633:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.768642:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.768650:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760796.768655:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.768664:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.768690:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.768698:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089947b5c/0x4a99e02bc60e37e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26456064->26460159] (req 26456064->26460159) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760796.768841:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521091840:12345-192.168.203.16@tcp:4:dd.0 Request processed in 51224us (51742us total) trans 4294973779 rc 0/0
00000100:00100000:2.0:1789760796.768853:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6492
00000100:00100000:2.0:1789760796.768872:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768359961064 time 768404279895 state 0x2 ref 0
00000100:00100000:0.0:1789760796.772746:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760796.772843:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521091968
00000100:00100000:2.0:1789760796.772854:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521091968
00000100:00100000:2.0:1789760796.773040:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768359961064 time 768404279895 state 0x0 ref 1
00000100:00100000:2.0:1789760796.773055:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768404540311 time 768404279895 state 0x1 ref 1
00000100:00100000:2.0:1789760796.773122:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768404540311 time 768459803493 state 0x0 ref 1
00000100:00100000:2.0:1789760796.773134:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521091968:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760796.773185:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26460160, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:2.0:1789760796.773193:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.773208:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:2.0:1789760796.773213:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760796.773219:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760796.773232:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1789760796.814136:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26460160 -> 26464256
00010000:00010000:3.0:1789760796.814157:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.814176:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.814185:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.814194:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a600 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760796.814198:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.814208:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.814226:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.814233:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f01dd3/0x4a99e02bc60e385 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26460160->26464255] (req 26460160->26464255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760796.814472:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521091968:12345-192.168.203.16@tcp:4:dd.0 Request processed in 41335us (41730us total) trans 4294973780 rc 0/0
00000100:00100000:3.0:1789760796.814484:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6493
00000100:00100000:3.0:1789760796.814493:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768404540311 time 768459803493 state 0x2 ref 0
00000001:00080000:0.0:1789760796.815671:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973780 is committed
00000100:00100000:1.0:1789760796.818867:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760796.819056:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521092096
00000100:00100000:3.0:1789760796.819066:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521092096
00000100:00100000:3.0:1789760796.819121:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768404540311 time 768459803493 state 0x0 ref 1
00000100:00100000:3.0:1789760796.819135:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768460063909 time 768459803493 state 0x1 ref 1
00000100:00100000:3.0:1789760796.819167:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768460063909 time 768505849882 state 0x0 ref 1
00000100:00100000:3.0:1789760796.819179:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521092096:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760796.819226:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26464256, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:3.0:1789760796.819235:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.819250:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760796.819254:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760796.819261:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.819273:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760796.857697:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26464256 -> 26468352
00010000:00010000:1.0:1789760796.857718:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.857733:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.857742:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.857749:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813efc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760796.857754:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.857765:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.857785:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.857794:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007fd26ae/0x4a99e02bc60e38c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26464256->26468351] (req 26464256->26468351) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760796.857894:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2405:x1876699521092096:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38712us (39041us total) trans 4294973781 rc 0/0
00000100:00100000:1.0:1789760796.857906:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6494
00000100:00100000:1.0:1789760796.857916:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768460063909 time 768505849882 state 0x2 ref 0
00000001:00080000:2.0:1789760796.858761:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973781 is committed
00000100:00100000:3.0:1789760796.862488:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760796.862696:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521092224
00000100:00100000:0.0:1789760796.862707:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521092224
00000100:00100000:0.0:1789760796.862765:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768460063909 time 768505849882 state 0x0 ref 1
00000100:00100000:0.0:1789760796.862780:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768506110298 time 768505849882 state 0x1 ref 1
00000100:00100000:0.0:1789760796.862812:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768506110298 time 768549494403 state 0x0 ref 1
00000100:00100000:0.0:1789760796.862825:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521092224:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760796.862884:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26468352, mtime: 0x6aad951d, atime: 0x0, ctime: 0x6aad951d, blocks: 0xd007
00010000:00010000:0.0:1789760796.862894:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.862910:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:0.0:1789760796.862914:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760796.862920:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.862934:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760796.890723:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973782 is committed
00002000:00010000:1.0:1789760796.890871:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26468352 -> 26472448
00002000:00010000:1.0:1789760796.890877:0:8103:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789760797 -> 1789760798
00002000:00010000:1.0:1789760796.890880:0:8103:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789760797 -> 1789760798
00010000:00010000:1.0:1789760796.890894:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.890907:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.890916:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.890923:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760796.890927:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.890937:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.891071:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.891083:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e393 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26468352->26472447] (req 26468352->26472447) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760796.891174:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8daba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521092224:12345-192.168.203.16@tcp:4:dd.0 Request processed in 28346us (28692us total) trans 4294973782 rc 0/0
00000100:00100000:1.0:1789760796.891185:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6495
00000100:00100000:1.0:1789760796.891194:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768506110298 time 768549494403 state 0x2 ref 0
00000100:00100000:0.0:1789760796.895392:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760796.895504:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521092352
00000100:00100000:1.0:1789760796.895514:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521092352
00000100:00100000:1.0:1789760796.895570:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768506110298 time 768549494403 state 0x0 ref 1
00000100:00100000:1.0:1789760796.895585:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768549754819 time 768549494403 state 0x1 ref 1
00000100:00100000:1.0:1789760796.895678:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768549754819 time 768582360147 state 0x0 ref 1
00000100:00100000:1.0:1789760796.895691:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2406:x1876699521092352:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760796.895746:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26472448, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:1.0:1789760796.895755:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.895770:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:1.0:1789760796.895774:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760796.895780:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.895793:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760796.924883:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26472448 -> 26476544
00010000:00010000:1.0:1789760796.924906:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.924920:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.924930:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.924938:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760796.924944:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.925102:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.925125:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.925134:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081c8a36e/0x4a99e02bc60e39a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26472448->26476543] (req 26472448->26476543) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760796.925229:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2406:x1876699521092352:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29534us (29843us total) trans 4294973783 rc 0/0
00000100:00100000:1.0:1789760796.925243:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6496
00000100:00100000:1.0:1789760796.925253:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768549754819 time 768582360147 state 0x2 ref 0
00000100:00100000:1.0:1789760796.928627:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760796.928699:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521092480
00000100:00100000:3.0:1789760796.928709:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521092480
00000100:00100000:3.0:1789760796.928763:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768549754819 time 768582360147 state 0x0 ref 1
00000100:00100000:3.0:1789760796.928779:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768582620563 time 768582360147 state 0x1 ref 1
00000100:00100000:3.0:1789760796.928808:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768582620563 time 768615490060 state 0x0 ref 1
00000100:00100000:3.0:1789760796.928821:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521092480:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760796.928881:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26476544, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:3.0:1789760796.928890:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.928905:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760796.928909:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760796.928915:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760796.928928:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760796.931822:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973783 is committed
00000001:00080000:1.0:1789760796.958367:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973784 is committed
00002000:00010000:0.0:1789760796.958493:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26476544 -> 26480640
00010000:00010000:0.0:1789760796.958509:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.958521:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.958529:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.958537:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760796.958541:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.958549:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.958572:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760796.958580:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ddcbf79/0x4a99e02bc60e3a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26476544->26480639] (req 26476544->26480639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760796.958673:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521092480:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29849us (30049us total) trans 4294973784 rc 0/0
00000100:00100000:0.0:1789760796.958684:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6497
00000100:00100000:0.0:1789760796.958694:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768582620563 time 768615490060 state 0x2 ref 0
00000100:00100000:3.0:1789760796.962992:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760796.963611:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521092608
00000100:00100000:1.0:1789760796.963622:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521092608
00000100:00100000:1.0:1789760796.963677:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768582620563 time 768615490060 state 0x0 ref 1
00000100:00100000:1.0:1789760796.963692:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768615750476 time 768615490060 state 0x1 ref 1
00000100:00100000:1.0:1789760796.963764:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768615750476 time 768650445677 state 0x0 ref 1
00000100:00100000:1.0:1789760796.963777:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521092608:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760796.963828:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26480640, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:1.0:1789760796.963837:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.963862:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:1.0:1789760796.963868:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760796.963873:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.963888:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760796.996532:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973785 is committed
00002000:00010000:1.0:1789760796.996643:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26480640 -> 26484736
00010000:00010000:1.0:1789760796.996659:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.996673:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.996683:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.996690:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760796.996695:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.996705:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.996723:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760796.996731:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26480640->26484735] (req 26480640->26484735) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760796.996822:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521092608:12345-192.168.203.16@tcp:4:dd.0 Request processed in 33042us (33836us total) trans 4294973785 rc 0/0
00000100:00100000:1.0:1789760796.996837:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6498
00000100:00100000:1.0:1789760796.996847:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768615750476 time 768650445677 state 0x2 ref 0
00000100:00100000:1.0:1789760797.000182:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760797.000271:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521092736
00000100:00100000:0.0:1789760797.000282:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521092736
00000100:00100000:0.0:1789760797.000372:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768615750476 time 768650445677 state 0x0 ref 1
00000100:00100000:0.0:1789760797.000386:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768650706093 time 768650445677 state 0x1 ref 1
00000100:00100000:0.0:1789760797.000416:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768650706093 time 768687098970 state 0x0 ref 1
00000100:00100000:0.0:1789760797.000428:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521092736:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760797.000474:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26484736, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:0.0:1789760797.000482:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.000501:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:0.0:1789760797.000506:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760797.000513:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.000526:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:0.0:1789760797.031522:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26484736 -> 26488832
00010000:00010000:0.0:1789760797.031543:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.031557:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.031566:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.031574:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760797.031579:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.031588:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.031671:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.031680:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5868cab/0x4a99e02bc60e3af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26484736->26488831] (req 26484736->26488831) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760797.031770:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521092736:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31338us (31593us total) trans 4294973786 rc 0/0
00000100:00100000:0.0:1789760797.031780:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6499
00000100:00100000:0.0:1789760797.031790:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768650706093 time 768687098970 state 0x2 ref 0
00000001:00080000:3.0:1789760797.031924:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973786 is committed
00000100:00100000:0.0:1789760797.037034:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760797.037123:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521092864
00000100:00100000:3.0:1789760797.037132:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521092864
00000100:00100000:3.0:1789760797.037188:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768650706093 time 768687098970 state 0x0 ref 1
00000100:00100000:3.0:1789760797.037203:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768687359386 time 768687098970 state 0x1 ref 1
00000100:00100000:1.0:1789760797.037455:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768687359386 time 768724133423 state 0x0 ref 1
00000100:00100000:1.0:1789760797.037470:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521092864:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760797.037519:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26488832, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:1.0:1789760797.037528:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.037544:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:1.0:1789760797.037549:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760797.037555:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.037570:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760797.084378:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973787 is committed
00002000:00010000:3.0:1789760797.084473:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26488832 -> 26492928
00010000:00010000:3.0:1789760797.084489:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.084502:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.084611:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.084619:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595ce00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760797.084624:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.084632:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.084652:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.084660:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000433f7c5a/0x4a99e02bc60e3b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26488832->26492927] (req 26488832->26492927) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760797.084754:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdb4bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521092864:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47282us (47725us total) trans 4294973787 rc 0/0
00000100:00100000:3.0:1789760797.084764:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6500
00000100:00100000:3.0:1789760797.084774:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768687359386 time 768724133423 state 0x2 ref 0
00000100:00100000:2.0:1789760797.089930:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760797.090025:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521092992
00000100:00100000:3.0:1789760797.090034:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521092992
00000100:00100000:3.0:1789760797.090157:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768687359386 time 768724133423 state 0x0 ref 1
00000100:00100000:3.0:1789760797.090173:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768724393839 time 768724133423 state 0x1 ref 1
00000100:00100000:3.0:1789760797.090199:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768724393839 time 768776882078 state 0x0 ref 1
00000100:00100000:3.0:1789760797.090211:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521092992:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760797.090260:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26492928, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:3.0:1789760797.090271:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.090287:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760797.090291:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760797.090298:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.090342:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760797.128287:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973788 is committed
00002000:00010000:3.0:1789760797.128688:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26492928 -> 26497024
00010000:00010000:3.0:1789760797.128704:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.128717:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.128725:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.128732:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760797.128737:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.128745:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.128764:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.128771:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26492928->26497023] (req 26492928->26497023) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760797.128949:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521092992:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38734us (39023us total) trans 4294973788 rc 0/0
00000100:00100000:3.0:1789760797.128969:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6501
00000100:00100000:3.0:1789760797.128979:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768724393839 time 768776882078 state 0x2 ref 0
00000100:00100000:0.0:1789760797.132429:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760797.132527:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521093120
00000100:00100000:3.0:1789760797.132537:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521093120
00000100:00100000:3.0:1789760797.132590:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768724393839 time 768776882078 state 0x0 ref 1
00000100:00100000:3.0:1789760797.132604:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768777142494 time 768776882078 state 0x1 ref 1
00000100:00100000:3.0:1789760797.132637:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768777142494 time 768819320408 state 0x0 ref 1
00000100:00100000:3.0:1789760797.132649:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521093120:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760797.132698:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26497024, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:3.0:1789760797.132708:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.132724:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760797.132728:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760797.132734:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.132748:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760797.170649:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973789 is committed
00002000:00010000:0.0:1789760797.170839:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26497024 -> 26501120
00010000:00010000:0.0:1789760797.170854:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.170929:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.170940:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.170947:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760797.170953:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.170968:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.170988:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.170996:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e81707/0x4a99e02bc60e3c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26497024->26501119] (req 26497024->26501119) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760797.171416:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521093120:12345-192.168.203.16@tcp:4:dd.0 Request processed in 38764us (38990us total) trans 4294973789 rc 0/0
00000100:00100000:0.0:1789760797.171427:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6502
00000100:00100000:0.0:1789760797.171436:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768777142494 time 768819320408 state 0x2 ref 0
00000100:00100000:0.0:1789760797.179188:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760797.179287:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521093248
00000100:00100000:1.0:1789760797.179297:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521093248
00000100:00100000:1.0:1789760797.179403:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768777142494 time 768819320408 state 0x0 ref 1
00000100:00100000:1.0:1789760797.179419:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768819580824 time 768819320408 state 0x1 ref 1
00000100:00100000:1.0:1789760797.179452:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768819580824 time 768866134471 state 0x0 ref 1
00000100:00100000:1.0:1789760797.179466:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521093248:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760797.179514:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26501120, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:1.0:1789760797.179524:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.179540:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:1.0:1789760797.179545:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760797.179552:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.179567:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760797.214261:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26501120 -> 26505216
00010000:00010000:2.0:1789760797.214281:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.214294:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.214302:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.214309:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760797.214338:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.214348:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.214372:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.214379:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000893d4973/0x4a99e02bc60e3cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26501120->26505215] (req 26501120->26505215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760797.214464:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521093248:12345-192.168.203.16@tcp:4:dd.0 Request processed in 34997us (35282us total) trans 4294973790 rc 0/0
00000100:00100000:2.0:1789760797.214474:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6503
00000100:00100000:2.0:1789760797.214482:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768819580824 time 768866134471 state 0x2 ref 0
00000001:00080000:3.0:1789760797.214976:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973790 is committed
00000100:00100000:2.0:1789760797.218041:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760797.218715:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521093376
00000100:00100000:1.0:1789760797.218727:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521093376
00000100:00100000:1.0:1789760797.218782:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768819580824 time 768866134471 state 0x0 ref 1
00000100:00100000:1.0:1789760797.218798:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768866394887 time 768866134471 state 0x1 ref 1
00000100:00100000:0.0:1789760797.218936:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768866394887 time 768905614515 state 0x0 ref 1
00000100:00100000:0.0:1789760797.219019:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521093376:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760797.219142:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26505216, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:0.0:1789760797.219162:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.219179:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:0.0:1789760797.219184:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760797.219192:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.219209:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.243046:0:9880:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:3.0:1789760797.255223:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973791 is committed
00002000:00010000:0.0:1789760797.255347:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26505216 -> 26509312
00010000:00010000:0.0:1789760797.255365:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.255378:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.255386:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.255394:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc5a00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760797.255399:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.255409:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.255428:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.255436:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5668579/0x4a99e02bc60e3d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26505216->26509311] (req 26505216->26509311) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760797.255526:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521093376:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36572us (37487us total) trans 4294973791 rc 0/0
00000100:00100000:0.0:1789760797.255536:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6504
00000100:00100000:0.0:1789760797.255546:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768866394887 time 768905614515 state 0x2 ref 0
00000100:00100000:0.0:1789760797.259093:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760797.259150:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521093504
00000100:00100000:3.0:1789760797.259160:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521093504
00000100:00100000:3.0:1789760797.259216:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768866394887 time 768905614515 state 0x0 ref 1
00000100:00100000:3.0:1789760797.259232:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768905874931 time 768905614515 state 0x1 ref 1
00000100:00100000:3.0:1789760797.259311:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768905874931 time 768945992383 state 0x0 ref 1
00000100:00100000:3.0:1789760797.259372:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521093504:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760797.259424:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26509312, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:3.0:1789760797.259434:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.259457:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760797.259462:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760797.259469:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.259485:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:0.0:1789760797.287948:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973792 is committed
00002000:00010000:2.0:1789760797.288251:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26509312 -> 26513408
00010000:00010000:2.0:1789760797.288271:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.288285:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.288295:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.288304:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee200 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760797.288308:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.288353:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.288372:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.288379:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3be386/0x4a99e02bc60e3d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26509312->26513407] (req 26509312->26513407) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760797.288470:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521093504:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29097us (29381us total) trans 4294973792 rc 0/0
00000100:00100000:2.0:1789760797.288480:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6505
00000100:00100000:2.0:1789760797.288488:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768905874931 time 768945992383 state 0x2 ref 0
00000100:00100000:1.0:1789760797.292588:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760797.292653:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521093632
00000100:00100000:3.0:1789760797.292663:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521093632
00000100:00100000:3.0:1789760797.292716:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768905874931 time 768945992383 state 0x0 ref 1
00000100:00100000:3.0:1789760797.292732:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768946252799 time 768945992383 state 0x1 ref 1
00000100:00100000:3.0:1789760797.292801:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768946252799 time 768979483116 state 0x0 ref 1
00000100:00100000:3.0:1789760797.292813:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521093632:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760797.292859:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26513408, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:3.0:1789760797.292868:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.292883:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=768s v=(0 0)
00010000:00010000:3.0:1789760797.292887:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760797.292892:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.292910:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760797.305416:0:3453:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00100000:2.0:1789760797.305437:0:3453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9cfdc1ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548778368:0@lo:41:osp-pre-1-0.0
00000100:00100000:2.0:1789760797.305583:0:3453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1789760797.305718:0:7304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699548778368
00000100:00100000:1.0:1789760797.305726:0:7304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699548778368
00000100:00100000:1.0:1789760797.305851:0:7304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470
00000100:00100000:1.0:1789760797.305861:0:7304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548778368:12345-0@lo:41:osp-pre-1-0.0
00000004:00000024:1.0:1789760797.305902:0:7304:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280
00000100:00100000:1.0:1789760797.305953:0:7304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3453:x1876699548778368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (373us total) trans 0 rc 0/0
00000100:00100000:1.0:1789760797.305962:0:7304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470
00000100:00100000:1.0:1789760797.306050:0:3453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9cfdc1ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3453:1876699548778368:0@lo:41:osp-pre-1-0.0
00000001:00080000:3.0:1789760797.321794:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973793 is committed
00002000:00010000:2.0:1789760797.321937:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26513408 -> 26517504
00010000:00010000:2.0:1789760797.321952:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.321965:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.321974:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.321982:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ee000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760797.321986:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.321994:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.322015:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.322023:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019ec3ad5/0x4a99e02bc60e3e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26513408->26517503] (req 26513408->26517503) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760797.322148:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521093632:12345-192.168.203.16@tcp:4:dd.0 Request processed in 29332us (29565us total) trans 4294973793 rc 0/0
00000100:00100000:2.0:1789760797.322159:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6506
00000100:00100000:2.0:1789760797.322168:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768946252799 time 768979483116 state 0x2 ref 0
00000100:00100000:3.0:1789760797.327764:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760797.327878:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521093760
00000100:00100000:1.0:1789760797.327888:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521093760
00000100:00100000:1.0:1789760797.327943:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768946252799 time 768979483116 state 0x0 ref 1
00000100:00100000:1.0:1789760797.327959:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768979743532 time 768979483116 state 0x1 ref 1
00000100:00100000:1.0:1789760797.327992:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768979743532 time 769014675024 state 0x0 ref 1
00000100:00100000:1.0:1789760797.328004:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521093760:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760797.328050:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26517504, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:1.0:1789760797.328060:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.328076:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:1.0:1789760797.328081:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760797.328087:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.328102:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760797.375951:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973794 is committed
00002000:00010000:0.0:1789760797.376283:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26517504 -> 26521600
00010000:00010000:0.0:1789760797.376299:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.376349:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.376505:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.376515:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595dc00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760797.376521:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.376530:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.376550:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.376559:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b401329/0x4a99e02bc60e3e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26517504->26521599] (req 26517504->26521599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760797.376708:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521093760:12345-192.168.203.16@tcp:4:dd.0 Request processed in 48699us (48948us total) trans 4294973794 rc 0/0
00000100:00100000:1.0:1789760797.376724:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6507
00000100:00100000:1.0:1789760797.376734:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768979743532 time 769014675024 state 0x2 ref 0
00000100:00100000:1.0:1789760797.381818:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760797.381995:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521093888
00000100:00100000:0.0:1789760797.382004:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521093888
00000100:00100000:0.0:1789760797.382498:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 768979743532 time 769014675024 state 0x0 ref 1
00000100:00100000:0.0:1789760797.382515:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769014935440 time 769014675024 state 0x1 ref 1
00000100:00100000:0.0:1789760797.383172:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769014935440 time 769069851019 state 0x0 ref 1
00000100:00100000:0.0:1789760797.383191:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521093888:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760797.383303:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26521600, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:0.0:1789760797.383356:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.383374:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:0.0:1789760797.383379:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760797.383385:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.383399:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:1.0:1789760797.435169:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26521600 -> 26525696
00000001:00080000:3.0:1789760797.435256:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973795 is committed
00010000:00010000:1.0:1789760797.435268:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.435285:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.435295:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.435303:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4e00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760797.435443:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.435465:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.435498:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.435507:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007414442a/0x4a99e02bc60e3ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26521600->26525695] (req 26521600->26525695) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760797.435623:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda7428380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521093888:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52432us (53809us total) trans 4294973795 rc 0/0
00000100:00100000:1.0:1789760797.435633:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6508
00000100:00100000:1.0:1789760797.435642:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769014935440 time 769069851019 state 0x2 ref 0
00000100:00100000:0.0:1789760797.446197:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760797.446398:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521094016
00000100:00100000:3.0:1789760797.446408:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521094016
00000100:00100000:3.0:1789760797.446460:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769014935440 time 769069851019 state 0x0 ref 1
00000100:00100000:3.0:1789760797.446475:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769070111435 time 769069851019 state 0x1 ref 1
00000100:00100000:3.0:1789760797.446507:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769070111435 time 769133190055 state 0x0 ref 1
00000100:00100000:3.0:1789760797.446519:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521094016:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760797.446568:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26525696, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:3.0:1789760797.446576:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.446593:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:3.0:1789760797.446597:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760797.446603:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.446617:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760797.502845:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973796 is committed
00002000:00010000:0.0:1789760797.502970:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26525696 -> 26529792
00010000:00010000:0.0:1789760797.502985:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.502999:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.503009:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.503018:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813eec00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:0.0:1789760797.503023:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.503033:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.503056:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.503065:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e3f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26525696->26529791] (req 26525696->26529791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1789760797.503169:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2405:x1876699521094016:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56646us (56978us total) trans 4294973796 rc 0/0
00000100:00100000:0.0:1789760797.503180:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6509
00000100:00100000:0.0:1789760797.503190:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769070111435 time 769133190055 state 0x2 ref 0
00000100:00100000:3.0:1789760797.509087:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760797.509252:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521094144
00000100:00100000:2.0:1789760797.509263:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521094144
00000100:00100000:2.0:1789760797.509359:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769070111435 time 769133190055 state 0x0 ref 1
00000100:00100000:2.0:1789760797.509375:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769133450471 time 769133190055 state 0x1 ref 1
00000100:00100000:2.0:1789760797.509406:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769133450471 time 769196088910 state 0x0 ref 1
00000100:00100000:2.0:1789760797.509420:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521094144:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760797.509467:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26529792, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:2.0:1789760797.509478:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.509494:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:2.0:1789760797.509499:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760797.509515:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.509530:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760797.530708:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760797.530748:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760797.530771:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760797.530790:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760797.530811:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760797.530835:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521094528
00000100:00100000:2.0:1789760797.530844:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521094528
00000100:00100000:2.0:1789760797.531005:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521094784
00000100:00100000:2.0:1789760797.531009:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521094784
00000100:00100000:2.0:1789760797.531024:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521094400
00000100:00100000:2.0:1789760797.531027:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521094400
00000100:00100000:2.0:1789760797.531037:0:6458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521094656
00000100:00100000:2.0:1789760797.531039:0:6458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521094656
00000100:00100000:2.0:1789760797.531053:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 983
00000100:00100000:2.0:1789760797.531063:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521094528:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760797.531131:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521094528:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (381us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760797.531139:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 983
00000100:00100000:2.0:1789760797.531153:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 984
00000100:00100000:2.0:1789760797.531159:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521094784:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760797.531181:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521094784:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (409us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760797.531188:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 984
00000100:00100000:2.0:1789760797.531198:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 985
00000100:00100000:2.0:1789760797.531203:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699521094400:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760797.531224:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+8:2408:x1876699521094400:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (433us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760797.531230:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 985
00000100:00100000:2.0:1789760797.531239:0:6458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 986
00000100:00100000:2.0:1789760797.531245:0:6458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521094656:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:2.0:1789760797.531264:0:6458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b876aacc-ec8d-4d49-a838-3d0f5d079a4b+5:2408:x1876699521094656:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 19us (453us total) trans 0 rc 0/0
00000100:00100000:2.0:1789760797.531270:0:6458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 986
00000100:00080000:1.0:1789760797.531611:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00080000:1.0:1789760797.531616:0:6452:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001
00000100:00100000:3.0:1789760797.532590:0:6448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521094272
00000100:00100000:3.0:1789760797.532599:0:6448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521094272
00000100:00100000:3.0:1789760797.532636:0:6448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 492
00000100:00100000:3.0:1789760797.532644:0:6448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd9001e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699521094272:12345-192.168.203.16@tcp:400:kworker.0
00000100:00100000:3.0:1789760797.532688:0:6448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd9001e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f65b2a7-adb1-4b6b-ac21-1a14368a4e1c+13:2408:x1876699521094272:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 45us (1989us total) trans 0 rc 0/0
00000100:00100000:3.0:1789760797.532695:0:6448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 492
00000001:00080000:3.0:1789760797.539576:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973797 is committed
00002000:00010000:3.0:1789760797.539883:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26529792 -> 26533888
00010000:00010000:3.0:1789760797.539960:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.539973:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.539982:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.539991:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02a800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760797.539996:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.540006:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.540027:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.540036:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713d0def/0x4a99e02bc60e3fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26529792->26533887] (req 26529792->26533887) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760797.540130:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8dab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521094144:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30708us (31048us total) trans 4294973797 rc 0/0
00000100:00100000:3.0:1789760797.540141:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6510
00000100:00100000:3.0:1789760797.540150:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769133450471 time 769196088910 state 0x2 ref 0
00000100:00100000:2.0:1789760797.546581:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760797.546683:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521094912
00000100:00100000:1.0:1789760797.546693:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521094912
00000100:00100000:1.0:1789760797.546744:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769133450471 time 769196088910 state 0x0 ref 1
00000100:00100000:1.0:1789760797.546759:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769196349326 time 769196088910 state 0x1 ref 1
00000100:00100000:1.0:1789760797.546791:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769196349326 time 769233474142 state 0x0 ref 1
00000100:00100000:1.0:1789760797.546803:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521094912:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760797.546851:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26533888, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:1.0:1789760797.546861:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.546876:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:1.0:1789760797.546881:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760797.546887:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.547023:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:2.0:1789760797.583483:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26533888 -> 26537984
00010000:00010000:2.0:1789760797.583506:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.583525:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.583533:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.583541:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595c400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760797.583546:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.583555:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.583575:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.583582:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000943ba98e/0x4a99e02bc60e403 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26533888->26537983] (req 26533888->26537983) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760797.583688:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfdc1ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+7:2408:x1876699521094912:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36881us (37110us total) trans 4294973798 rc 0/0
00000100:00100000:2.0:1789760797.583699:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6511
00000100:00100000:2.0:1789760797.583709:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769196349326 time 769233474142 state 0x2 ref 0
00000001:00080000:3.0:1789760797.587011:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973798 is committed
00000100:00100000:0.0:1789760797.587131:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:1.0:1789760797.587235:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521095040
00000100:00100000:1.0:1789760797.587245:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521095040
00000100:00100000:1.0:1789760797.587305:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769196349326 time 769233474142 state 0x0 ref 1
00000100:00100000:1.0:1789760797.587404:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769233734558 time 769233474142 state 0x1 ref 1
00000100:00100000:1.0:1789760797.587467:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769233734558 time 769274148439 state 0x0 ref 1
00000100:00100000:1.0:1789760797.587481:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521095040:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:1.0:1789760797.587528:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26537984, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:1.0:1789760797.587538:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.587553:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:1.0:1789760797.587558:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1789760797.587565:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.587580:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760797.617295:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973799 is committed
00002000:00010000:1.0:1789760797.617491:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26537984 -> 26542080
00010000:00010000:1.0:1789760797.617510:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.617530:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.617541:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.617548:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfda595d000 already unused, calling callback (ffffffffc1526350)
00010000:00010000:1.0:1789760797.617554:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.617564:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.617584:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1789760797.617593:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069645649/0x4a99e02bc60e40a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26537984->26542079] (req 26537984->26542079) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1789760797.617732:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521095040:12345-192.168.203.16@tcp:4:dd.0 Request processed in 30238us (30591us total) trans 4294973799 rc 0/0
00000100:00100000:1.0:1789760797.617744:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6512
00000100:00100000:1.0:1789760797.617752:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769233734558 time 769274148439 state 0x2 ref 0
00000100:00100000:1.0:1789760797.622014:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:0.0:1789760797.622130:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521095168
00000100:00100000:0.0:1789760797.622141:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521095168
00000100:00100000:0.0:1789760797.622197:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769233734558 time 769274148439 state 0x0 ref 1
00000100:00100000:0.0:1789760797.622212:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769274408855 time 769274148439 state 0x1 ref 1
00000100:00100000:0.0:1789760797.622286:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769274408855 time 769308968114 state 0x0 ref 1
00000100:00100000:0.0:1789760797.622300:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521095168:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:0.0:1789760797.622385:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26542080, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:0.0:1789760797.622395:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.622412:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:0.0:1789760797.622416:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1789760797.622422:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1789760797.622437:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:2.0:1789760797.653576:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973800 is committed
00002000:00010000:3.0:1789760797.653689:0:14638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26542080 -> 26546176
00010000:00010000:3.0:1789760797.653705:0:14638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.653719:0:14638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.653727:0:14638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.653734:0:14638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfdc1cc4c00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760797.653740:0:14638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.653750:0:14638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.653770:0:14638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.653779:0:14638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096563d68/0x4a99e02bc60e411 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26542080->26546175] (req 26542080->26546175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760797.654071:0:14638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521095168:12345-192.168.203.16@tcp:4:dd.0 Request processed in 31767us (32218us total) trans 4294973800 rc 0/0
00000100:00100000:3.0:1789760797.654082:0:14638:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6513
00000100:00100000:3.0:1789760797.654092:0:14638:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769274408855 time 769308968114 state 0x2 ref 0
00000100:00100000:2.0:1789760797.657649:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760797.657723:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521095296
00000100:00100000:3.0:1789760797.657733:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521095296
00000100:00100000:3.0:1789760797.657781:0:8105:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769274408855 time 769308968114 state 0x0 ref 1
00000100:00100000:3.0:1789760797.657795:0:8105:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769309228530 time 769308968114 state 0x1 ref 1
00000100:00100000:3.0:1789760797.657866:0:8105:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769309228530 time 769344548704 state 0x0 ref 1
00000100:00100000:3.0:1789760797.657878:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521095296:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760797.658060:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26546176, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:3.0:1789760797.658070:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.658086:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:3.0:1789760797.658090:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760797.658097:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.658109:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760797.711774:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973801 is committed
00002000:00010000:3.0:1789760797.712059:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26546176 -> 26550272
00010000:00010000:3.0:1789760797.712075:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.712089:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.712099:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.712107:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd813ef800 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760797.712111:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.712122:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.712142:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.712151:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119b7071/0x4a99e02bc60e418 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26546176->26550271] (req 26546176->26550271) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760797.712287:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc82ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521095296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54405us (54642us total) trans 4294973801 rc 0/0
00000100:00100000:3.0:1789760797.712298:0:8105:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6514
00000100:00100000:3.0:1789760797.712308:0:8105:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769309228530 time 769344548704 state 0x2 ref 0
00000100:00100000:0.0:1789760797.716098:0:3447:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760797.716402:0:8103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521095424
00000100:00100000:2.0:1789760797.716411:0:8103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521095424
00000100:00100000:2.0:1789760797.716466:0:8103:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769309228530 time 769344548704 state 0x0 ref 1
00000100:00100000:2.0:1789760797.716481:0:8103:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769344809120 time 769344548704 state 0x1 ref 1
00000100:00100000:2.0:1789760797.716538:0:8103:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769344809120 time 769403219461 state 0x0 ref 1
00000100:00100000:2.0:1789760797.716551:0:8103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521095424:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760797.716599:0:8103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26550272, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:2.0:1789760797.716608:0:8103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.716623:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:2.0:1789760797.716627:0:8103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760797.716632:0:8103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.716645:0:8103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:1.0:1789760797.751584:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973802 is committed
00002000:00010000:3.0:1789760797.752177:0:8103:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26550272 -> 26554368
00010000:00010000:3.0:1789760797.752194:0:8103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.752208:0:8103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.752218:0:8103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.752227:0:8103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02b400 already unused, calling callback (ffffffffc1526350)
00010000:00010000:3.0:1789760797.752232:0:8103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.752242:0:8103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.752266:0:8103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.752275:0:8103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03a8301/0x4a99e02bc60e41f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26550272->26554367] (req 26550272->26554367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1789760797.752592:0:8103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc8cc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2407:x1876699521095424:12345-192.168.203.16@tcp:4:dd.0 Request processed in 36038us (36497us total) trans 4294973802 rc 0/0
00000100:00100000:3.0:1789760797.752602:0:8103:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6515
00000100:00100000:3.0:1789760797.752612:0:8103:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769344809120 time 769403219461 state 0x2 ref 0
00000100:00100000:1.0:1789760797.757737:0:3446:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:2.0:1789760797.758222:0:8104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521095552
00000100:00100000:2.0:1789760797.758232:0:8104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521095552
00000100:00100000:2.0:1789760797.758287:0:8104:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769344809120 time 769403219461 state 0x0 ref 1
00000100:00100000:2.0:1789760797.758302:0:8104:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769403479877 time 769403219461 state 0x1 ref 1
00000100:00100000:2.0:1789760797.758423:0:8104:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769403479877 time 769445104530 state 0x0 ref 1
00000100:00100000:2.0:1789760797.758436:0:8104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521095552:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:2.0:1789760797.758485:0:8104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26554368, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:2.0:1789760797.758494:0:8104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.758510:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:2.0:1789760797.758515:0:8104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:2.0:1789760797.758521:0:8104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.758535:0:8104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000001:00080000:3.0:1789760797.797587:0:8128:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294973803 is committed
00002000:00010000:2.0:1789760797.797780:0:8104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 26554368 -> 26558464
00010000:00010000:2.0:1789760797.797796:0:8104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.797810:0:8104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.797820:0:8104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.797828:0:8104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc8b02ba00 already unused, calling callback (ffffffffc1526350)
00010000:00010000:2.0:1789760797.797834:0:8104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.797844:0:8104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.797877:0:8104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1789760797.797887:0:8104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001644ff02/0x4a99e02bc60e426 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26554368->26558463] (req 26554368->26558463) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1789760797.797992:0:8104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfda742bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521095552:12345-192.168.203.16@tcp:4:dd.0 Request processed in 39552us (40260us total) trans 4294973803 rc 0/0
00000100:00100000:2.0:1789760797.798003:0:8104:0:(nrs_tbf.c:3377:nrs_tbf_req_stop()) NRS stop tbf request from 12345-192.168.203.16@tcp, seq: 6516
00000100:00100000:2.0:1789760797.798014:0:8104:0:(nrs_tbf.c:1542:nrs_tbf_lru_add()) ost_io.0 NRS: TBF LRU add: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769403479877 time 769445104530 state 0x2 ref 0
00000100:00100000:2.0:1789760797.802090:0:3448:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp)
00000100:00100000:3.0:1789760797.802207:0:14638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876699521095680
00000100:00100000:3.0:1789760797.802217:0:14638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876699521095680
00000100:00100000:3.0:1789760797.802270:0:14638:0:(nrs_tbf.c:1562:nrs_tbf_lru_tryhit()) ost_io.0 NRS: TBF LRU hit: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769403479877 time 769445104530 state 0x0 ref 1
00000100:00100000:3.0:1789760797.802286:0:14638:0:(nrs_tbf.c:3322:nrs_tbf_req_add()) ost_io.0 NRS: TBF enqueues: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769445364946 time 769445104530 state 0x1 ref 1
00000100:00100000:3.0:1789760797.802350:0:14638:0:(nrs_tbf.c:3136:nrs_req_dequeue_bps()) ost_io.0 NRS: TBF dequeues in BPS mode: class@ffff9cfc8b076600 key nid={192.168.203.16@tcp}&opcode={ost_write} rule@0xffff9cfd8120b400 gen 0 rate 15 depth 3 token 3 deadline 769445364946 time 769489031963 state 0x0 ref 1
00000100:00100000:3.0:1789760797.802362:0:14638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc82ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cd5436e5-f1f0-4365-9253-ba3c783ea432+5:2408:x1876699521095680:12345-192.168.203.16@tcp:4:dd.0
00002000:00010000:3.0:1789760797.802411:0:14638:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 26558464, mtime: 0x6aad951e, atime: 0x0, ctime: 0x6aad951e, blocks: 0xd007
00010000:00010000:3.0:1789760797.802420:0:14638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e42d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.802439:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=769s v=(0 0)
00010000:00010000:3.0:1789760797.802443:0:14638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1789760797.802449:0:14638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e42d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26558464->26562559] (req 26558464->26562559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1789760797.802461:0:14638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000051f1344/0x4a99e02bc60e42d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [26558464->26562559] (req 26558464->26562559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
Debug log: 57375 lines, 57375 kept, 0 dropped, 0 bad.